-- Logs begin at Fri 2022-09-16 07:15:25 UTC, end at Fri 2022-09-16 08:15:32 UTC. -- Sep 16 07:40:28.433270 dv-cinder-740146-20-smb systemd[1]: Starting Devstack devstack@keystone.service... Sep 16 07:40:28.442042 dv-cinder-740146-20-smb devstack@keystone.service[81419]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Sep 16 07:40:28.444065 dv-cinder-740146-20-smb devstack@keystone.service[81419]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Sep 16 07:40:28 2022] *** Sep 16 07:40:28.444065 dv-cinder-740146-20-smb devstack@keystone.service[81419]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 16 07:40:28.444065 dv-cinder-740146-20-smb devstack@keystone.service[81419]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 16 07:40:28.444065 dv-cinder-740146-20-smb devstack@keystone.service[81419]: nodename: dv-cinder-740146-20-smb Sep 16 07:40:28.444065 dv-cinder-740146-20-smb devstack@keystone.service[81419]: machine: x86_64 Sep 16 07:40:28.444065 dv-cinder-740146-20-smb devstack@keystone.service[81419]: clock source: unix Sep 16 07:40:28.444065 dv-cinder-740146-20-smb devstack@keystone.service[81419]: pcre jit disabled Sep 16 07:40:28.444065 dv-cinder-740146-20-smb devstack@keystone.service[81419]: detected number of CPU cores: 4 Sep 16 07:40:28.444065 dv-cinder-740146-20-smb devstack@keystone.service[81419]: current working directory: / Sep 16 07:40:28.444065 dv-cinder-740146-20-smb devstack@keystone.service[81419]: detected binary path: /usr/bin/uwsgi-core Sep 16 07:40:28.444065 dv-cinder-740146-20-smb devstack@keystone.service[81419]: your processes number limit is 47680 Sep 16 07:40:28.444645 dv-cinder-740146-20-smb devstack@keystone.service[81419]: your memory page size is 4096 bytes Sep 16 07:40:28.444645 dv-cinder-740146-20-smb devstack@keystone.service[81419]: detected max file descriptor number: 2048 Sep 16 07:40:28.444645 dv-cinder-740146-20-smb devstack@keystone.service[81419]: lock engine: pthread robust mutexes Sep 16 07:40:28.444645 dv-cinder-740146-20-smb devstack@keystone.service[81419]: thunder lock: enabled Sep 16 07:40:28.444645 dv-cinder-740146-20-smb devstack@keystone.service[81419]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Sep 16 07:40:28.444645 dv-cinder-740146-20-smb devstack@keystone.service[81419]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 16 07:40:28.484350 dv-cinder-740146-20-smb devstack@keystone.service[81419]: Python main interpreter initialized at 0x5558a696b9c0 Sep 16 07:40:28.484350 dv-cinder-740146-20-smb devstack@keystone.service[81419]: python threads support enabled Sep 16 07:40:28.484350 dv-cinder-740146-20-smb devstack@keystone.service[81419]: your server socket listen backlog is limited to 100 connections Sep 16 07:40:28.484350 dv-cinder-740146-20-smb devstack@keystone.service[81419]: your mercy for graceful operations on workers is 90 seconds Sep 16 07:40:28.484705 dv-cinder-740146-20-smb devstack@keystone.service[81419]: mapped 403077 bytes (393 KB) for 2 cores Sep 16 07:40:28.484785 dv-cinder-740146-20-smb devstack@keystone.service[81419]: *** Operational MODE: preforking *** Sep 16 07:40:28.485037 dv-cinder-740146-20-smb devstack@keystone.service[81419]: *** uWSGI is running in multiple interpreter mode *** Sep 16 07:40:28.485037 dv-cinder-740146-20-smb devstack@keystone.service[81419]: spawned uWSGI master process (pid: 81419) Sep 16 07:40:28.485232 dv-cinder-740146-20-smb systemd[1]: Started Devstack devstack@keystone.service. Sep 16 07:40:28.489746 dv-cinder-740146-20-smb devstack@keystone.service[81419]: spawned uWSGI worker 1 (pid: 81430, cores: 1) Sep 16 07:40:28.489746 dv-cinder-740146-20-smb devstack@keystone.service[81419]: spawned uWSGI worker 2 (pid: 81431, cores: 1) Sep 16 07:40:28.489746 dv-cinder-740146-20-smb devstack@keystone.service[81419]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 16 07:40:32.786588 dv-cinder-740146-20-smb devstack@keystone.service[81430]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 16 07:40:32.786588 dv-cinder-740146-20-smb devstack@keystone.service[81430]: from cryptography.utils import int_from_bytes Sep 16 07:40:32.787386 dv-cinder-740146-20-smb devstack@keystone.service[81430]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 16 07:40:32.787386 dv-cinder-740146-20-smb devstack@keystone.service[81430]: from cryptography.utils import int_from_bytes Sep 16 07:40:32.816141 dv-cinder-740146-20-smb devstack@keystone.service[81431]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 16 07:40:32.816141 dv-cinder-740146-20-smb devstack@keystone.service[81431]: from cryptography.utils import int_from_bytes Sep 16 07:40:32.816676 dv-cinder-740146-20-smb devstack@keystone.service[81431]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 16 07:40:32.816676 dv-cinder-740146-20-smb devstack@keystone.service[81431]: from cryptography.utils import int_from_bytes Sep 16 07:40:32.838646 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 16 07:40:32.838844 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 16 07:40:32.839038 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] command line args: [] {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 16 07:40:32.839310 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 16 07:40:32.839487 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] ================================================================================ {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 16 07:40:32.839742 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] admin_token = **** {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 07:40:32.839994 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] config_dir = [] {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 07:40:32.840182 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 07:40:32.840363 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] config_source = [] {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 07:40:32.840540 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] debug = True {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 07:40:32.840735 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 07:40:32.841747 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 07:40:32.841747 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 07:40:32.841747 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 07:40:32.841747 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 07:40:32.842000 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] list_limit = None {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 07:40:32.842294 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] log_config_append = None {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 07:40:32.842294 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 07:40:32.842544 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] log_dir = None {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 07:40:32.842656 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] log_file = None {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 07:40:32.842887 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 07:40:32.843134 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 07:40:32.843382 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 07:40:32.843629 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 07:40:32.843806 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 07:40:32.843981 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 07:40:32.844226 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 07:40:32.844474 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 07:40:32.844709 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 07:40:32.844943 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 07:40:32.845173 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 07:40:32.845405 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 07:40:32.845650 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 07:40:32.845924 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 07:40:32.846200 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 07:40:32.846685 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.57/identity {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 07:40:32.846863 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] publish_errors = False {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 07:40:32.847170 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 07:40:32.847403 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 07:40:32.847582 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 07:40:32.847830 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 07:40:32.848065 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 07:40:32.848303 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] standard_threads = False {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 07:40:32.848534 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 07:40:32.848777 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 07:40:32.848953 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 07:40:32.849129 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] use_journal = False {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 07:40:32.849306 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] use_json = False {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 07:40:32.849479 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] use_stderr = False {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 07:40:32.849655 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] use_syslog = False {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 07:40:32.849910 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 07:40:32.850166 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.850406 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.850668 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.850909 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.851159 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.851400 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.851650 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.851885 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.852133 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.852381 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.852631 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.852866 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.853114 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.853350 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.853598 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.853870 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.854108 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.854364 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.854622 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.854866 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.855102 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.855358 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.855623 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.855878 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.856129 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.856361 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.856592 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.856824 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.857058 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.857308 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.857559 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.857810 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.858043 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.858289 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.858537 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.858776 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.859023 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.859257 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.859492 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.859728 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.859965 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.860195 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.860424 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.860656 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.860893 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.861140 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.861372 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.861608 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.861863 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.862102 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.862339 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.863127 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.863364 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.863606 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.863845 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.864083 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.864322 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.864561 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.864794 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.865044 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.865281 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.865519 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.865775 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.866042 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.866718 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.866960 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.867203 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.867448 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.867718 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.867957 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.868210 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.868336 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 16 07:40:32.868455 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.868531 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 16 07:40:32.868693 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.868776 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] command line args: [] {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 16 07:40:32.868928 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.869007 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 16 07:40:32.869163 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.869247 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] ================================================================================ {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 16 07:40:32.869410 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.869488 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] admin_token = **** {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 07:40:32.869651 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.869759 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] config_dir = [] {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 07:40:32.869892 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 07:40:32.869968 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.870076 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] config_source = [] {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 07:40:32.870152 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.870303 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] debug = True {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 07:40:32.870382 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.870458 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 07:40:32.870616 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.870702 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 07:40:32.870856 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.870938 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 07:40:32.871092 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.871175 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 07:40:32.871330 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.871434 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 07:40:32.871572 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.871693 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] list_limit = None {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 07:40:32.871809 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.871893 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] log_config_append = None {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 07:40:32.871986 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 07:40:32.872073 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.872188 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] log_dir = None {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 07:40:32.872298 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.872377 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] log_file = None {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 07:40:32.872550 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.872628 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 07:40:32.872792 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.872875 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 07:40:32.873033 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.873140 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 07:40:32.873276 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.873388 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 07:40:32.873514 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.873598 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 07:40:32.873755 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 07:40:32.873846 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.873999 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.874075 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 07:40:32.874233 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.874316 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 07:40:32.874467 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 07:40:32.874543 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.874697 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.874778 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 07:40:32.874929 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 07:40:32.875006 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.875159 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.875239 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 07:40:32.875401 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.875568 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 07:40:32.875643 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.875718 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 07:40:32.875876 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.875952 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 07:40:32.876114 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.876371 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.876448 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.57/identity {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 07:40:32.876569 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] publish_errors = False {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 07:40:32.876644 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.876802 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 07:40:32.876879 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.877032 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 07:40:32.877107 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] auth.external = None {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.877211 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 07:40:32.877303 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.877458 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 07:40:32.877580 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.877692 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 07:40:32.877838 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.877952 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] standard_threads = False {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 07:40:32.878066 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] auth.password = None {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.878779 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 07:40:32.879019 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] auth.token = None {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.879185 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 07:40:32.879480 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.879635 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 07:40:32.879768 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] use_journal = False {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 07:40:32.879933 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.880070 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] use_json = False {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 07:40:32.880196 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] use_stderr = False {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 07:40:32.880361 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] use_syslog = False {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 07:40:32.880497 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.880579 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 07:40:32.880704 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.880781 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.880897 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.880972 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.881145 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.881226 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.881385 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.881466 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.881626 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] credential.caching = True {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.881707 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.881905 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.881997 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.882159 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.882249 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.882397 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.882516 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.882643 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.882719 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.882890 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.882978 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.883126 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.883210 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.883360 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.883435 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.883615 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.883703 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.883852 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.883929 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.884098 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.884174 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.884348 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.884440 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.884890 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.884976 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.885137 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.885255 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.885381 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.885466 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.885630 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.885707 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.885886 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] federation.caching = True {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.885962 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.886125 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.886215 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.886375 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.886453 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.886623 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.886705 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.886856 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.886941 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.887090 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.887171 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.887322 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.887438 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.887556 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.887641 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.887797 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.887923 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.888056 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.888147 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.888283 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.888369 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.888518 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.888594 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.888748 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.888824 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] identity.caching = True {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.888994 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.889080 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.889241 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.889316 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.889475 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.889551 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.889698 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.889811 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.889969 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.890048 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.890203 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.890287 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.890448 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.890565 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.890684 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.890763 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.890918 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.890996 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.891158 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.891234 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.891392 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.891469 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.891624 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.891700 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.891869 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.891946 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.892118 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.892195 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.892356 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.892433 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.892588 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.892691 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.892843 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.892922 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.893079 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.893164 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.893327 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.893406 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.893564 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.893641 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.893929 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.894024 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.894145 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.894274 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.894383 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.894623 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.894715 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.894868 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.894947 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.895111 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.895189 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.895361 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.895448 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.895595 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.895674 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.895844 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.895934 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.896087 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.896165 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.896320 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.896397 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.896569 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.896649 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.896806 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.896892 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.897037 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.897115 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.897273 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.897350 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.897502 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.897596 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.897759 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.897842 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.898002 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.898080 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.898245 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.898336 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.898485 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.898564 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.898723 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.898803 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.898975 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.899067 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.899256 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.899334 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.899507 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.899589 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.899743 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.899830 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.899980 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.900059 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.900224 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.900302 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.900461 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.900547 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.900708 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.900786 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.900942 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.901020 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.901174 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] ldap.user = None {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.901252 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.901406 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.901484 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.901641 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.901736 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.901910 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.902002 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.902159 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.902235 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.902402 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.902521 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.902648 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.902727 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.902886 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.902964 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.903119 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.903197 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.903341 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.903421 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.903583 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.903662 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.903822 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.903902 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.904056 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.904135 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.904286 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.904363 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.904519 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.904596 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.904770 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.904849 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.905007 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.905084 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.905239 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.905316 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.905471 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.905549 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.905707 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.905849 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.905973 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.906050 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.906210 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.906288 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.906445 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.906521 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.906686 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.906806 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.906934 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.907027 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.907185 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] auth.external = None {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.907269 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.907418 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.907496 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.907672 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.907754 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.907905 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.907983 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.908149 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.908227 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] auth.password = None {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.908386 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.908466 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] auth.token = None {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.908621 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.908699 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.908858 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.908936 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.909105 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.909185 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.909347 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.909434 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.909607 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.909833 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.909946 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.910102 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] resource.caching = True {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.910187 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.910361 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.910446 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.910610 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.910697 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] credential.caching = True {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.910848 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.910926 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.911098 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.911176 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.911349 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.911436 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.911585 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.911664 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.911832 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.911910 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.912068 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.912154 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.912308 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.912387 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.912543 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] role.caching = True {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.912627 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.912791 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] role.driver = sql {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.912877 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.913023 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.913102 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.913272 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.913351 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.913522 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.913612 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.913791 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.913882 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.914040 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.914118 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.914288 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.914368 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.914534 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.914612 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] federation.caching = True {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.914782 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.914860 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.915031 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.915110 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.915263 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.915342 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.915496 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.915573 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.915745 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.915823 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.915982 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.916059 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.916227 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.916304 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.916464 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.916636 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.916714 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.916875 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.916953 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.917126 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.917213 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.917377 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.917456 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] identity.caching = True {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.917628 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.917706 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.917900 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.917990 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.918135 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.918219 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.918367 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.918444 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.918617 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.918704 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.918849 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.918927 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.919080 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.919158 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.919314 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.919400 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.919548 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.919627 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.919798 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.919876 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.920030 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.920115 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.920263 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.920341 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.920507 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.920585 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.920745 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.920830 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.920977 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.921056 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.921212 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] token.caching = True {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.921291 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.921451 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.921532 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.921699 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.921840 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.921958 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.922037 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.922218 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.922299 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.922467 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.922546 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.922702 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.922780 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.922934 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.923014 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.923170 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.923248 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.923411 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.923489 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.923646 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.923724 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.923885 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.923964 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.924119 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.924196 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.924366 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.924446 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.924630 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.924706 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.924859 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.924945 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.925643 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.925804 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.925921 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.926136 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.926215 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] database.connection = **** {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.926398 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.926475 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.926647 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.926735 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.926887 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.926966 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.927126 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.927240 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.927361 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.927485 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.927597 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.927729 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.927833 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.927970 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.928068 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.928234 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.928314 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.928486 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.928565 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.928760 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.928838 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.928995 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.929075 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.929241 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.929318 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.929478 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.929556 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.929742 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.929825 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.929970 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.930050 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.930210 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.930312 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.930445 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.930524 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.930614 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 16 07:40:32.930722 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] ldap.user = None {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.930989 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.931271 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.931515 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.931773 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.932021 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.932268 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.932504 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.932733 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.932969 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.933207 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.933444 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.933695 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.933968 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.934222 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.934466 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.934731 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.934977 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.935228 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.935481 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.935729 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.935987 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.936246 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.936505 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.936752 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.937121 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.937392 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.937661 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.937941 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.938191 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.938432 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.938671 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.938932 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.939183 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.939427 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.939662 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.939902 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.940145 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] resource.caching = True {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.940399 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.940719 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.941626 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.942102 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.942364 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.942606 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.942881 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.943124 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.943368 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.943609 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] role.caching = True {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.943859 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] role.driver = sql {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.944117 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.944370 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.944619 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.944890 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.945141 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.945413 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.945697 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.945976 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.946248 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.946503 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.946754 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.947040 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.947292 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.947563 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.947990 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.948249 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.948522 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.948775 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.949025 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.949276 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.949515 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.949818 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.950086 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.950337 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.950588 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.950845 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.951080 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.951355 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.951633 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.951904 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.952164 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.952403 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.952651 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.952893 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] token.caching = True {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.953153 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.953405 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.953678 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.953981 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.954240 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.954491 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.954737 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.954979 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.955250 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.955491 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.955753 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.956014 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.956333 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.956867 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.957119 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.957415 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.957711 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.958004 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] database.connection = **** {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.958254 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.958544 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.958803 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.959053 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.959308 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.959571 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.959832 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.960096 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.960343 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.960601 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.960758 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81430) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 16 07:40:32.960841 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.960997 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81430) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 16 07:40:32.961113 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.961225 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81430) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 16 07:40:32.961386 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.961627 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.961898 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.962132 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.962376 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.962634 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:40:32.962805 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 16 07:40:32.969521 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81430) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 16 07:40:32.990459 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81431) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 16 07:40:32.990692 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81431) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 16 07:40:32.990919 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81431) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 16 07:40:32.997798 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81430) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 16 07:40:32.998032 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81430) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 16 07:40:32.999846 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81431) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 16 07:40:33.020230 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81431) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 16 07:40:33.020461 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81431) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 16 07:40:33.052222 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81430) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 16 07:40:33.060145 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81431) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 16 07:40:33.102384 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81430) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 16 07:40:33.102617 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81430) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 16 07:40:33.108972 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81431) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 16 07:40:33.109213 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81431) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 16 07:40:33.260933 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81430) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 16 07:40:33.261161 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81430) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 16 07:40:33.261380 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81430) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 16 07:40:33.261600 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81430) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 16 07:40:33.261846 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81430) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 16 07:40:33.262066 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81430) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 16 07:40:33.262190 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81431) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 16 07:40:33.262434 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81431) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 16 07:40:33.262662 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81431) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 16 07:40:33.262884 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81431) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 16 07:40:33.263102 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81431) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 16 07:40:33.263335 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81431) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 16 07:40:33.286685 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81430) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 16 07:40:33.286924 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81430) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 16 07:40:33.287144 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81430) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 16 07:40:33.287341 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81431) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 16 07:40:33.287426 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81430) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 16 07:40:33.287580 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81431) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 16 07:40:33.287663 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81430) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 16 07:40:33.287796 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81430) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 16 07:40:33.287887 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81431) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 16 07:40:33.288012 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81430) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 16 07:40:33.288095 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81431) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 16 07:40:33.288251 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81431) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 16 07:40:33.288468 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81431) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 16 07:40:33.288685 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81431) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 16 07:40:33.299103 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81430) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 16 07:40:33.299779 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81431) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 16 07:40:33.311731 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81430) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 16 07:40:33.311919 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81430) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 16 07:40:33.312145 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81430) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 16 07:40:33.312293 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81431) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 16 07:40:33.312376 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81430) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 16 07:40:33.312546 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81431) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 16 07:40:33.312627 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81430) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 16 07:40:33.312773 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81431) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 16 07:40:33.312863 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81430) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 16 07:40:33.312991 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81430) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 16 07:40:33.313072 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81431) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 16 07:40:33.313208 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81431) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 16 07:40:33.313442 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81431) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 16 07:40:33.313655 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81431) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 16 07:40:33.330497 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81430) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 07:40:33.330707 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81430) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 16 07:40:33.330789 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 07:40:33.330997 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 16 07:40:33.331077 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81430) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 07:40:33.331264 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81430) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 16 07:40:33.331915 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 07:40:33.332225 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81430) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 07:40:33.332307 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 16 07:40:33.332494 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81430) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 07:40:33.332680 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 07:40:33.332762 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81430) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 07:40:33.332952 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 07:40:33.333032 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81430) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 07:40:33.333218 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 07:40:33.333481 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 07:40:33.342603 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81430) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 07:40:33.342883 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81430) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 07:40:33.343156 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81430) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 07:40:33.343357 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 07:40:33.343637 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 07:40:33.343725 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81430) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 07:40:33.343910 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 07:40:33.344194 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 07:40:33.350771 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81430) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 16 07:40:33.351897 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81431) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 16 07:40:33.353703 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81430) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 16 07:40:33.354009 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81430) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 07:40:33.354290 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81430) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 07:40:33.354572 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81430) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 07:40:33.354859 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81430) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 07:40:33.354939 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81431) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 16 07:40:33.355120 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81430) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 07:40:33.355229 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 07:40:33.355392 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81430) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 07:40:33.355538 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 07:40:33.355667 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81430) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 07:40:33.355827 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 07:40:33.355938 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81430) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 07:40:33.356112 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 07:40:33.356212 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81430) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 07:40:33.356376 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 07:40:33.356483 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81430) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 07:40:33.356650 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 07:40:33.356950 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 07:40:33.357227 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 07:40:33.357505 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 07:40:33.357799 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 07:40:33.380094 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81430) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 07:40:33.381564 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81430) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 16 07:40:33.381878 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81430) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 07:40:33.381989 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 07:40:33.383465 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81431) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 16 07:40:33.383750 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 07:40:33.386839 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81430) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 16 07:40:33.387128 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81430) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 07:40:33.387414 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81430) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 07:40:33.388611 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81431) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 16 07:40:33.388898 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 07:40:33.389182 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 07:40:33.394419 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81430) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 16 07:40:33.394707 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81430) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 07:40:33.396835 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81431) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 16 07:40:33.397143 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 07:40:33.400488 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81430) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 16 07:40:33.400786 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81430) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 07:40:33.401072 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81430) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 07:40:33.401353 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81431) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 16 07:40:33.401436 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81430) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 07:40:33.401626 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81430) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 07:40:33.401708 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 07:40:33.401928 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81430) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 07:40:33.402020 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 07:40:33.402200 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81430) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 07:40:33.402295 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 07:40:33.402471 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81430) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 07:40:33.402552 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 07:40:33.404483 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 07:40:33.404775 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 07:40:33.405056 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 07:40:33.418494 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81430) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 07:40:33.418770 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81430) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 07:40:33.421115 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 07:40:33.421405 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 07:40:33.422679 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81430) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 16 07:40:33.425596 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81431) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 16 07:40:33.425965 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81430) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 07:40:33.426265 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81430) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 07:40:33.428842 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 07:40:33.429141 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 07:40:33.430515 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81430) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 16 07:40:33.433612 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81431) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 16 07:40:33.433694 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81430) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 16 07:40:33.436846 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81431) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 16 07:40:33.436928 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81430) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 07:40:33.437167 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81430) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 07:40:33.437456 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81430) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 07:40:33.437759 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81430) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 07:40:33.438058 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81430) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 07:40:33.438354 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81430) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 07:40:33.440225 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 07:40:33.440529 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 07:40:33.441491 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 07:40:33.442030 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 07:40:33.442434 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 07:40:33.442730 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 07:40:33.455115 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81430) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 16 07:40:33.455404 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81430) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 07:40:33.455670 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81430) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 07:40:33.455931 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81430) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 07:40:33.461632 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81431) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 16 07:40:33.462165 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 07:40:33.462634 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 07:40:33.463098 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 07:40:33.463370 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81430) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 07:40:33.464929 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81430) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 07:40:33.466478 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81430) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 07:40:33.466757 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81430) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 07:40:33.469566 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81430) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 16 07:40:33.469891 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81430) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 07:40:33.470185 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81430) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 07:40:33.470468 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81430) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 07:40:33.470855 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81430) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 07:40:33.470937 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 07:40:33.472833 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 07:40:33.474459 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 07:40:33.474742 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 07:40:33.477505 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81431) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 16 07:40:33.477829 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 07:40:33.478122 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 07:40:33.478469 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 07:40:33.478775 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 07:40:33.482322 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81430) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 16 07:40:33.482609 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81430) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 07:40:33.482890 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81430) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 07:40:33.483173 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81430) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 07:40:33.483554 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81430) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 07:40:33.483852 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81430) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 07:40:33.484140 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81430) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 07:40:33.490688 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81431) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 16 07:40:33.490975 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 07:40:33.491279 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 07:40:33.491568 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 07:40:33.491850 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 07:40:33.492139 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 07:40:33.492434 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 07:40:33.499656 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81430) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 16 07:40:33.502613 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81430) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 16 07:40:33.506282 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81430) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 07:40:33.507825 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81430) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 07:40:33.509301 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81430) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 16 07:40:33.509868 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81430) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 07:40:33.510270 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81430) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 07:40:33.510472 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81431) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 16 07:40:33.513965 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81431) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 16 07:40:33.516685 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81430) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 07:40:33.516919 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 07:40:33.518179 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81430) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 16 07:40:33.518415 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 07:40:33.521567 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81431) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 16 07:40:33.521890 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 07:40:33.522030 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81430) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 07:40:33.522180 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 07:40:33.522412 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81430) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 07:40:33.522701 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81430) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 07:40:33.522981 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81430) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 07:40:33.528879 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 07:40:33.530412 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81431) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 16 07:40:33.530847 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81430) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 16 07:40:33.531140 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81430) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 07:40:33.531422 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81430) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 07:40:33.533355 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 07:40:33.533648 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 07:40:33.533962 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 07:40:33.534242 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 07:40:33.538420 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81430) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 16 07:40:33.538707 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81430) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 07:40:33.538988 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81430) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 07:40:33.539264 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81430) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 07:40:33.539537 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81430) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 07:40:33.539810 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81430) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 07:40:33.540084 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81430) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 07:40:33.540383 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81430) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 07:40:33.540655 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81430) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 07:40:33.540924 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81430) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 07:40:33.541205 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81430) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 07:40:33.541475 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81430) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 07:40:33.541760 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81430) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 07:40:33.542049 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81430) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 07:40:33.542582 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81431) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 16 07:40:33.542889 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 07:40:33.543178 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 07:40:33.550772 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81431) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 16 07:40:33.551242 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 07:40:33.551532 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 07:40:33.551814 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 07:40:33.552109 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 07:40:33.552408 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 07:40:33.552690 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 07:40:33.552973 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 07:40:33.553273 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 07:40:33.553549 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 07:40:33.553860 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 07:40:33.554134 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 07:40:33.554400 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 07:40:33.554662 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 07:40:33.577671 dv-cinder-740146-20-smb devstack@keystone.service[81430]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5558a696b9c0 pid: 81430 (default app) Sep 16 07:40:33.580944 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e498cbd6-281b-49e2-b19b-fa10e21f296d None None] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:40:33.581252 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e498cbd6-281b-49e2-b19b-fa10e21f296d None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:40:33.581526 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e498cbd6-281b-49e2-b19b-fa10e21f296d None None] PATH_INFO: `/v3` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:40:33.585671 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1/1] 10.222.0.57 () {50 vars in 791 bytes} [Fri Sep 16 07:40:33 2022] GET /identity/v3/ => generated 255 bytes in 7 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:40:33.590723 dv-cinder-740146-20-smb devstack@keystone.service[81431]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5558a696b9c0 pid: 81431 (default app) Sep 16 07:40:40.358668 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5335fc2e-e3af-499c-89d8-423de81c0cce None None] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:40:40.359148 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5335fc2e-e3af-499c-89d8-423de81c0cce None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:40:40.359148 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5335fc2e-e3af-499c-89d8-423de81c0cce None None] PATH_INFO: `/` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:40:40.360434 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 2/2] 10.222.0.57 () {54 vars in 927 bytes} [Fri Sep 16 07:40:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 16 07:40:40.368101 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e82bece-1ec3-4d8b-9861-d991c6006fa2 None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:40:40.368555 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e82bece-1ec3-4d8b-9861-d991c6006fa2 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:40:40.368702 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e82bece-1ec3-4d8b-9861-d991c6006fa2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:40:40.438283 dv-cinder-740146-20-smb devstack@keystone.service[81431]: INFO dbcounter [None req-1e82bece-1ec3-4d8b-9861-d991c6006fa2 None None] Registered counter for database keystone Sep 16 07:40:40.457414 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG oslo_db.sqlalchemy.engines [None req-1e82bece-1ec3-4d8b-9861-d991c6006fa2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81431) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 16 07:40:40.463498 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writer thread running {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 16 07:40:40.638922 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG passlib.handlers.bcrypt [None req-1e82bece-1ec3-4d8b-9861-d991c6006fa2 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81431) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Sep 16 07:40:40.639224 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG passlib.handlers.bcrypt [None req-1e82bece-1ec3-4d8b-9861-d991c6006fa2 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81431) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Sep 16 07:40:40.698318 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-1e82bece-1ec3-4d8b-9861-d991c6006fa2 None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:40:40.699941 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-1e82bece-1ec3-4d8b-9861-d991c6006fa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:40:40.828465 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1/3] 10.222.0.57 () {58 vars in 1024 bytes} [Fri Sep 16 07:40:40 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 464 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Sep 16 07:40:41.286324 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5335fc2e-e3af-499c-89d8-423de81c0cce None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:40:41.355044 dv-cinder-740146-20-smb devstack@keystone.service[81430]: INFO dbcounter [None req-5335fc2e-e3af-499c-89d8-423de81c0cce None None] Registered counter for database keystone Sep 16 07:40:41.376203 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG oslo_db.sqlalchemy.engines [None req-5335fc2e-e3af-499c-89d8-423de81c0cce None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81430) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 16 07:40:41.382960 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writer thread running {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 16 07:40:41.499524 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5335fc2e-e3af-499c-89d8-423de81c0cce None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:40:41.504076 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad368886-c35f-4d2e-ac23-0ef64daece3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:40:41.504689 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad368886-c35f-4d2e-ac23-0ef64daece3d admin admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:40:41.504966 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad368886-c35f-4d2e-ac23-0ef64daece3d admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:40:41.505235 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad368886-c35f-4d2e-ac23-0ef64daece3d admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:40:41.513538 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad368886-c35f-4d2e-ac23-0ef64daece3d admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:40:41.565957 dv-cinder-740146-20-smb devstack@keystone.service[81430]: WARNING keystone.common.rbac_enforcer.enforcer [None req-ad368886-c35f-4d2e-ac23-0ef64daece3d admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Sep 16 07:40:41.566295 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad368886-c35f-4d2e-ac23-0ef64daece3d admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:40:41.575525 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 3/4] 10.222.0.57 () {58 vars in 1324 bytes} [Fri Sep 16 07:40:41 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 16 07:40:41.581559 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e82bece-1ec3-4d8b-9861-d991c6006fa2 None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:40:41.596329 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e82bece-1ec3-4d8b-9861-d991c6006fa2 None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:40:41.601287 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61f98bf-36d5-4010-8226-ec9b1ce9382d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:40:41.602443 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61f98bf-36d5-4010-8226-ec9b1ce9382d admin admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:40:41.602723 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61f98bf-36d5-4010-8226-ec9b1ce9382d admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:40:41.602997 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61f98bf-36d5-4010-8226-ec9b1ce9382d admin admin] PATH_INFO: `/v3/projects/ca665dd48e60491fbe57a7dec14fd437` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:40:41.604425 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61f98bf-36d5-4010-8226-ec9b1ce9382d admin admin] RBAC: Authorizing `identity:get_project(project_id=ca665dd48e60491fbe57a7dec14fd437)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:40:41.657780 dv-cinder-740146-20-smb devstack@keystone.service[81431]: WARNING keystone.common.rbac_enforcer.enforcer [None req-d61f98bf-36d5-4010-8226-ec9b1ce9382d admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Sep 16 07:40:41.658072 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61f98bf-36d5-4010-8226-ec9b1ce9382d admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:40:41.663150 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 2/5] 10.222.0.57 () {56 vars in 1207 bytes} [Fri Sep 16 07:40:41 2022] GET /identity/v3/projects/ca665dd48e60491fbe57a7dec14fd437 => generated 344 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 07:40:43.784364 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d260f2-f87e-4cc9-8429-303f502e2bfd None None] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:40:43.784959 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d260f2-f87e-4cc9-8429-303f502e2bfd None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:40:43.784959 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d260f2-f87e-4cc9-8429-303f502e2bfd None None] PATH_INFO: `/` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:40:43.788970 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 4/6] 10.222.0.57 () {54 vars in 927 bytes} [Fri Sep 16 07:40:43 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 07:40:43.794465 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049f58b6-4e45-41c3-9114-c8c925d7e9e9 None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:40:43.794878 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049f58b6-4e45-41c3-9114-c8c925d7e9e9 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:40:43.795014 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049f58b6-4e45-41c3-9114-c8c925d7e9e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:40:43.815049 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-049f58b6-4e45-41c3-9114-c8c925d7e9e9 None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:40:43.816564 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-049f58b6-4e45-41c3-9114-c8c925d7e9e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:40:43.824262 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 3/7] 10.222.0.57 () {58 vars in 1024 bytes} [Fri Sep 16 07:40:43 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Sep 16 07:40:44.089425 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d260f2-f87e-4cc9-8429-303f502e2bfd None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:40:44.103322 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d260f2-f87e-4cc9-8429-303f502e2bfd None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:40:44.105704 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcfdf96-2559-4993-b022-e32827be6412 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:40:44.106319 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcfdf96-2559-4993-b022-e32827be6412 admin admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:40:44.106594 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcfdf96-2559-4993-b022-e32827be6412 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:40:44.106862 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcfdf96-2559-4993-b022-e32827be6412 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:40:44.115122 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fcfdf96-2559-4993-b022-e32827be6412 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:40:44.116861 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fcfdf96-2559-4993-b022-e32827be6412 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:40:44.125463 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 5/8] 10.222.0.57 () {58 vars in 1324 bytes} [Fri Sep 16 07:40:44 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 16 07:40:44.131566 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049f58b6-4e45-41c3-9114-c8c925d7e9e9 None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:40:44.140827 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049f58b6-4e45-41c3-9114-c8c925d7e9e9 None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:40:44.145206 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e4d2b0-14cc-448e-a456-1844106ac88d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:40:44.145856 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e4d2b0-14cc-448e-a456-1844106ac88d admin admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:40:44.146134 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e4d2b0-14cc-448e-a456-1844106ac88d admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:40:44.146401 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e4d2b0-14cc-448e-a456-1844106ac88d admin admin] PATH_INFO: `/v3/users/a76c683889e54d429dbaa09123371861` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:40:44.147694 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e4d2b0-14cc-448e-a456-1844106ac88d admin admin] RBAC: Authorizing `identity:get_user(user_id=a76c683889e54d429dbaa09123371861)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:40:44.149489 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e4d2b0-14cc-448e-a456-1844106ac88d admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:40:44.151019 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 4/9] 10.222.0.57 () {56 vars in 1198 bytes} [Fri Sep 16 07:40:44 2022] GET /identity/v3/users/a76c683889e54d429dbaa09123371861 => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:40:46.362699 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5184878-b38b-4206-ab09-7335659c0a94 None None] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:40:46.363213 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5184878-b38b-4206-ab09-7335659c0a94 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:40:46.363213 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5184878-b38b-4206-ab09-7335659c0a94 None None] PATH_INFO: `/` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:40:46.364465 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 6/10] 10.222.0.57 () {54 vars in 927 bytes} [Fri Sep 16 07:40:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 07:40:46.369649 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08f3b72-55e0-416b-ae97-03bae3c8954b None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:40:46.370073 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08f3b72-55e0-416b-ae97-03bae3c8954b None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:40:46.370243 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08f3b72-55e0-416b-ae97-03bae3c8954b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:40:46.388945 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-d08f3b72-55e0-416b-ae97-03bae3c8954b None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:40:46.390168 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-d08f3b72-55e0-416b-ae97-03bae3c8954b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:40:46.400887 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1793da-125b-4e19-a61a-3b434d3460f2 None None] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:40:46.401232 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1793da-125b-4e19-a61a-3b434d3460f2 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:40:46.401509 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1793da-125b-4e19-a61a-3b434d3460f2 None None] PATH_INFO: `/` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:40:46.402843 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 7/11] 10.222.0.57 () {54 vars in 927 bytes} [Fri Sep 16 07:40:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 16 07:40:46.407719 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3819499b-796a-4ba8-a55f-31ac73ef9dd3 None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:40:46.408000 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3819499b-796a-4ba8-a55f-31ac73ef9dd3 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:40:46.408443 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3819499b-796a-4ba8-a55f-31ac73ef9dd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:40:46.452768 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG passlib.handlers.bcrypt [None req-3819499b-796a-4ba8-a55f-31ac73ef9dd3 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81430) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Sep 16 07:40:46.453159 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG passlib.handlers.bcrypt [None req-3819499b-796a-4ba8-a55f-31ac73ef9dd3 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81430) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Sep 16 07:40:46.471313 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 5/12] 10.222.0.57 () {58 vars in 1024 bytes} [Fri Sep 16 07:40:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 07:40:46.502931 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-3819499b-796a-4ba8-a55f-31ac73ef9dd3 None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:40:46.504730 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-3819499b-796a-4ba8-a55f-31ac73ef9dd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:40:46.601336 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 8/13] 10.222.0.57 () {58 vars in 1024 bytes} [Fri Sep 16 07:40:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 16 07:40:46.738763 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08f3b72-55e0-416b-ae97-03bae3c8954b None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:40:46.763525 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:40:46.841606 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08f3b72-55e0-416b-ae97-03bae3c8954b None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:40:46.867986 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3819499b-796a-4ba8-a55f-31ac73ef9dd3 None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:40:46.874697 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9e249e-ecac-4283-84dd-3b2c2cfd48ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:40:46.875324 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9e249e-ecac-4283-84dd-3b2c2cfd48ce None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:40:46.875602 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9e249e-ecac-4283-84dd-3b2c2cfd48ce None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:40:46.875869 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9e249e-ecac-4283-84dd-3b2c2cfd48ce None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:40:46.888525 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9e249e-ecac-4283-84dd-3b2c2cfd48ce None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 07:40:46.897423 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application [None req-6b9e249e-ecac-4283-84dd-3b2c2cfd48ce None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 16 07:40:46.897423 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 07:40:46.897423 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 07:40:46.897423 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 07:40:46.897423 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 07:40:46.897423 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 07:40:46.897423 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 07:40:46.897423 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 07:40:46.897423 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 07:40:46.897423 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 07:40:46.897423 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 07:40:46.897423 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 07:40:46.897423 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 07:40:46.897423 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 07:40:46.897423 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 07:40:46.897423 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 07:40:46.898377 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 07:40:46.898377 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 07:40:46.898377 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 07:40:46.898377 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 07:40:46.898377 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 07:40:46.898377 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 07:40:46.898377 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 07:40:46.898377 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 07:40:46.898377 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 07:40:46.898377 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 07:40:46.898377 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 07:40:46.898377 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application with Lock( Sep 16 07:40:46.898377 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 07:40:46.898377 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._enter() Sep 16 07:40:46.898377 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 07:40:46.898377 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 07:40:46.899498 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 07:40:46.899498 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.creator() Sep 16 07:40:46.899498 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 07:40:46.899498 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application created_value = creator( Sep 16 07:40:46.899498 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 07:40:46.899498 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 07:40:46.899498 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 07:40:46.899498 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 07:40:46.899498 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 07:40:46.899498 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 07:40:46.899498 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 16 07:40:46.899498 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Sep 16 07:40:46.899498 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 6/14] 10.222.0.57 () {56 vars in 1096 bytes} [Fri Sep 16 07:40:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 07:40:46.904331 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9e249e-ecac-4283-84dd-3b2c2cfd48ce None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:40:46.970446 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3819499b-796a-4ba8-a55f-31ac73ef9dd3 None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:40:46.973196 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:40:46.985013 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:40:47.004089 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9e249e-ecac-4283-84dd-3b2c2cfd48ce None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:40:47.008512 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f052e5-0bca-4d32-9050-741f3b4a6aae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:40:47.009621 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f052e5-0bca-4d32-9050-741f3b4a6aae None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:40:47.009940 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f052e5-0bca-4d32-9050-741f3b4a6aae None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:40:47.010211 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f052e5-0bca-4d32-9050-741f3b4a6aae None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:40:47.037474 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79fe2d0-0622-4fd9-941b-89d860978a0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:40:47.038103 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79fe2d0-0622-4fd9-941b-89d860978a0b None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:40:47.038380 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79fe2d0-0622-4fd9-941b-89d860978a0b None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:40:47.038648 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79fe2d0-0622-4fd9-941b-89d860978a0b None admin] PATH_INFO: `/v3/roles` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:40:47.039296 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79fe2d0-0622-4fd9-941b-89d860978a0b None admin] RBAC: Adding query filter params (name=admin) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:40:47.039616 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79fe2d0-0622-4fd9-941b-89d860978a0b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:40:47.040993 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79fe2d0-0622-4fd9-941b-89d860978a0b None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:40:47.053395 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 7/15] 10.222.0.57 () {56 vars in 1099 bytes} [Fri Sep 16 07:40:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 07:40:47.059175 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79fe2d0-0622-4fd9-941b-89d860978a0b None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:40:47.076573 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f052e5-0bca-4d32-9050-741f3b4a6aae None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:40:47.078118 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f052e5-0bca-4d32-9050-741f3b4a6aae None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:40:47.159569 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79fe2d0-0622-4fd9-941b-89d860978a0b None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:40:47.179102 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 9/16] 10.222.0.57 () {58 vars in 1282 bytes} [Fri Sep 16 07:40:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 16 07:40:47.184699 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f052e5-0bca-4d32-9050-741f3b4a6aae None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:40:47.187355 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:40:47.194194 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960f3e51-8fe3-489b-8d9b-96765c263077 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:40:47.194821 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960f3e51-8fe3-489b-8d9b-96765c263077 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:40:47.195096 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960f3e51-8fe3-489b-8d9b-96765c263077 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:40:47.195371 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960f3e51-8fe3-489b-8d9b-96765c263077 None admin] PATH_INFO: `/v3/users/a76c683889e54d429dbaa09123371861` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:40:47.196505 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960f3e51-8fe3-489b-8d9b-96765c263077 None admin] RBAC: Authorizing `identity:get_user(user_id=a76c683889e54d429dbaa09123371861)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:40:47.197990 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960f3e51-8fe3-489b-8d9b-96765c263077 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:40:47.199534 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 8/17] 10.222.0.57 () {56 vars in 1177 bytes} [Fri Sep 16 07:40:47 2022] GET /identity/v3/users/a76c683889e54d429dbaa09123371861 => generated 247 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 07:40:47.204913 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960f3e51-8fe3-489b-8d9b-96765c263077 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:40:47.220430 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:40:47.280968 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f052e5-0bca-4d32-9050-741f3b4a6aae None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:40:47.303746 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960f3e51-8fe3-489b-8d9b-96765c263077 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:40:47.313818 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaab518d-73f8-4300-a86f-75dfb17fef58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:40:47.314661 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaab518d-73f8-4300-a86f-75dfb17fef58 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:40:47.315509 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaab518d-73f8-4300-a86f-75dfb17fef58 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:40:47.315776 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaab518d-73f8-4300-a86f-75dfb17fef58 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:40:47.333487 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaab518d-73f8-4300-a86f-75dfb17fef58 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:40:47.334967 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaab518d-73f8-4300-a86f-75dfb17fef58 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:40:47.337376 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5bd584-2eba-4323-b687-66cc30588292 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:40:47.338029 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5bd584-2eba-4323-b687-66cc30588292 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:40:47.338300 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5bd584-2eba-4323-b687-66cc30588292 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:40:47.338565 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5bd584-2eba-4323-b687-66cc30588292 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:40:47.339664 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5bd584-2eba-4323-b687-66cc30588292 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:40:47.341134 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5bd584-2eba-4323-b687-66cc30588292 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:40:47.342860 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 9/18] 10.222.0.57 () {56 vars in 1108 bytes} [Fri Sep 16 07:40:47 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 07:40:47.348484 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5bd584-2eba-4323-b687-66cc30588292 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:40:47.352548 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application [None req-eaab518d-73f8-4300-a86f-75dfb17fef58 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 07:40:47.352548 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 07:40:47.352548 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 07:40:47.352548 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 07:40:47.352548 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 07:40:47.352548 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 07:40:47.352548 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 07:40:47.352548 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 07:40:47.352548 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 07:40:47.352548 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 07:40:47.352548 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 07:40:47.352548 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 07:40:47.352548 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 07:40:47.352548 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 07:40:47.352548 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 07:40:47.352548 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 07:40:47.353414 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 07:40:47.353414 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 07:40:47.353414 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 07:40:47.353414 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 07:40:47.353414 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 07:40:47.353414 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 07:40:47.353414 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 07:40:47.353414 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application with Lock( Sep 16 07:40:47.353414 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 07:40:47.353414 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._enter() Sep 16 07:40:47.353414 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 07:40:47.353414 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 07:40:47.353414 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 07:40:47.353414 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.creator() Sep 16 07:40:47.353414 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 07:40:47.353414 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application created_value = creator( Sep 16 07:40:47.353414 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 07:40:47.354269 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 07:40:47.354269 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 07:40:47.354269 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Sep 16 07:40:47.354269 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 10/19] 10.222.0.57 () {56 vars in 1108 bytes} [Fri Sep 16 07:40:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 16 07:40:47.359224 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaab518d-73f8-4300-a86f-75dfb17fef58 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:40:47.414843 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:40:47.431871 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:40:47.451364 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5bd584-2eba-4323-b687-66cc30588292 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:40:47.462914 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaab518d-73f8-4300-a86f-75dfb17fef58 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:40:47.484779 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f48f923-6cdd-4a4d-aee6-92a998619d73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:40:47.485384 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f48f923-6cdd-4a4d-aee6-92a998619d73 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:40:47.485663 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f48f923-6cdd-4a4d-aee6-92a998619d73 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:40:47.485963 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f48f923-6cdd-4a4d-aee6-92a998619d73 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:40:47.487252 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f48f923-6cdd-4a4d-aee6-92a998619d73 None admin] RBAC: Adding query filter params (role.id=567db03c91854ad9af1e9a87ec1bd275, scope.domain.id=default, user.id=a76c683889e54d429dbaa09123371861) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:40:47.487567 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f48f923-6cdd-4a4d-aee6-92a998619d73 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:40:47.488977 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f48f923-6cdd-4a4d-aee6-92a998619d73 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:40:47.495493 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 10/20] 10.222.0.57 () {56 vars in 1322 bytes} [Fri Sep 16 07:40:47 2022] GET /identity/v3/role_assignments?user.id=a76c683889e54d429dbaa09123371861&scope.domain.id=default&role.id=567db03c91854ad9af1e9a87ec1bd275 => generated 233 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 07:40:47.497591 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1a94b4-ff73-4e40-bd5d-562d9598b111 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:40:47.498244 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1a94b4-ff73-4e40-bd5d-562d9598b111 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:40:47.498525 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1a94b4-ff73-4e40-bd5d-562d9598b111 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:40:47.498799 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1a94b4-ff73-4e40-bd5d-562d9598b111 None admin] PATH_INFO: `/v3/domains` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:40:47.499454 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1a94b4-ff73-4e40-bd5d-562d9598b111 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:40:47.499759 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1a94b4-ff73-4e40-bd5d-562d9598b111 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:40:47.501171 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1a94b4-ff73-4e40-bd5d-562d9598b111 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:40:47.521226 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 11/21] 10.222.0.57 () {56 vars in 1109 bytes} [Fri Sep 16 07:40:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 07:40:50.250166 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc2932e-2eec-4e38-b026-03d1124ae0b0 None None] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:40:50.250663 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc2932e-2eec-4e38-b026-03d1124ae0b0 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:40:50.250733 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc2932e-2eec-4e38-b026-03d1124ae0b0 None None] PATH_INFO: `/` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:40:50.252787 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 11/22] 10.222.0.57 () {54 vars in 927 bytes} [Fri Sep 16 07:40:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 07:40:50.263520 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960a607a-49ca-4a44-ae03-2bfa5283fab6 None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:40:50.264001 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960a607a-49ca-4a44-ae03-2bfa5283fab6 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:40:50.264081 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960a607a-49ca-4a44-ae03-2bfa5283fab6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:40:50.291032 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-960a607a-49ca-4a44-ae03-2bfa5283fab6 None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:40:50.292325 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-960a607a-49ca-4a44-ae03-2bfa5283fab6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:40:50.390686 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 12/23] 10.222.0.57 () {58 vars in 1024 bytes} [Fri Sep 16 07:40:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 07:40:50.440792 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e48ccb-acdb-43a4-9d25-e23cc4ce8bb0 None None] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:40:50.441428 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e48ccb-acdb-43a4-9d25-e23cc4ce8bb0 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:40:50.441942 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e48ccb-acdb-43a4-9d25-e23cc4ce8bb0 None None] PATH_INFO: `/` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:40:50.443445 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 12/24] 10.222.0.57 () {54 vars in 927 bytes} [Fri Sep 16 07:40:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 07:40:50.455461 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f976ab-69b3-4010-8f7b-ac4f3fba8920 None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:40:50.455752 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f976ab-69b3-4010-8f7b-ac4f3fba8920 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:40:50.456031 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f976ab-69b3-4010-8f7b-ac4f3fba8920 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:40:50.465157 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a060ce6a-21b4-4f5b-a607-e95b393afae8 None None] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:40:50.465620 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a060ce6a-21b4-4f5b-a607-e95b393afae8 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:40:50.466053 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a060ce6a-21b4-4f5b-a607-e95b393afae8 None None] PATH_INFO: `/` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:40:50.467540 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 13/25] 10.222.0.57 () {54 vars in 927 bytes} [Fri Sep 16 07:40:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 16 07:40:50.474956 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf03909-a00e-46f7-9acf-19fa7c042281 None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:40:50.475435 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf03909-a00e-46f7-9acf-19fa7c042281 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:40:50.475854 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf03909-a00e-46f7-9acf-19fa7c042281 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:40:50.481953 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-89f976ab-69b3-4010-8f7b-ac4f3fba8920 None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:40:50.483145 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-89f976ab-69b3-4010-8f7b-ac4f3fba8920 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:40:50.508269 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-9bf03909-a00e-46f7-9acf-19fa7c042281 None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:40:50.509966 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-9bf03909-a00e-46f7-9acf-19fa7c042281 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:40:50.578800 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:40:50.613427 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 13/26] 10.222.0.57 () {58 vars in 1024 bytes} [Fri Sep 16 07:40:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 07:40:50.620844 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61ac284-b22c-4201-996d-d0c1cacff0c1 None None] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:40:50.621133 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61ac284-b22c-4201-996d-d0c1cacff0c1 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:40:50.621407 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61ac284-b22c-4201-996d-d0c1cacff0c1 None None] PATH_INFO: `/` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:40:50.623009 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 14/27] 10.222.0.57 () {54 vars in 927 bytes} [Fri Sep 16 07:40:50 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 16 07:40:50.628694 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fb2593-ce20-4e8a-98f8-9a3c96e28070 None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:40:50.628968 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fb2593-ce20-4e8a-98f8-9a3c96e28070 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:40:50.629247 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fb2593-ce20-4e8a-98f8-9a3c96e28070 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:40:50.663104 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-b0fb2593-ce20-4e8a-98f8-9a3c96e28070 None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:40:50.671305 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-b0fb2593-ce20-4e8a-98f8-9a3c96e28070 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:40:50.676137 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 14/28] 10.222.0.57 () {58 vars in 1024 bytes} [Fri Sep 16 07:40:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 16 07:40:50.781219 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf03909-a00e-46f7-9acf-19fa7c042281 None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:40:50.793051 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 15/29] 10.222.0.57 () {58 vars in 1024 bytes} [Fri Sep 16 07:40:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 16 07:40:50.889486 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:40:50.920545 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf03909-a00e-46f7-9acf-19fa7c042281 None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:40:50.964618 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc786c9-378e-4c27-a036-70bb183558a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:40:50.965255 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc786c9-378e-4c27-a036-70bb183558a7 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:40:50.965531 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc786c9-378e-4c27-a036-70bb183558a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:40:50.965821 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc786c9-378e-4c27-a036-70bb183558a7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:40:50.980414 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc786c9-378e-4c27-a036-70bb183558a7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 07:40:50.985481 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application [None req-1cc786c9-378e-4c27-a036-70bb183558a7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 16 07:40:50.985481 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 07:40:50.985481 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 07:40:50.985481 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 07:40:50.985481 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 07:40:50.985481 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 07:40:50.985481 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 07:40:50.985481 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 07:40:50.985481 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 07:40:50.985481 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 07:40:50.985481 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 07:40:50.985481 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 07:40:50.985481 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 07:40:50.985481 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 07:40:50.985481 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 07:40:50.985481 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 07:40:50.986314 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 07:40:50.986314 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 07:40:50.986314 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 07:40:50.986314 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 07:40:50.986314 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 07:40:50.986314 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 07:40:50.986314 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 07:40:50.986314 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 07:40:50.986314 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 07:40:50.986314 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 07:40:50.986314 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 07:40:50.986314 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application with Lock( Sep 16 07:40:50.986314 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 07:40:50.986314 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._enter() Sep 16 07:40:50.986314 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 07:40:50.986314 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 07:40:50.987575 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 07:40:50.987575 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.creator() Sep 16 07:40:50.987575 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 07:40:50.987575 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application created_value = creator( Sep 16 07:40:50.987575 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 07:40:50.987575 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 07:40:50.987575 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 07:40:50.987575 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 07:40:50.987575 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 07:40:50.987575 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 07:40:50.987575 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 16 07:40:50.987575 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Sep 16 07:40:50.987575 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 15/30] 10.222.0.57 () {56 vars in 1096 bytes} [Fri Sep 16 07:40:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 07:40:50.992546 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fb2593-ce20-4e8a-98f8-9a3c96e28070 None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:40:51.068455 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc786c9-378e-4c27-a036-70bb183558a7 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:40:51.118031 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fb2593-ce20-4e8a-98f8-9a3c96e28070 None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:40:51.126224 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:40:51.161523 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51af3cf-2134-49e1-bbc7-4514e1517e1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:40:51.162420 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51af3cf-2134-49e1-bbc7-4514e1517e1a None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:40:51.162844 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51af3cf-2134-49e1-bbc7-4514e1517e1a None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:40:51.163278 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51af3cf-2134-49e1-bbc7-4514e1517e1a None admin] PATH_INFO: `/v3/roles` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:40:51.164166 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51af3cf-2134-49e1-bbc7-4514e1517e1a None admin] RBAC: Adding query filter params (name=admin) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:40:51.164621 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51af3cf-2134-49e1-bbc7-4514e1517e1a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:40:51.166256 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51af3cf-2134-49e1-bbc7-4514e1517e1a None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:40:51.192687 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 16/31] 10.222.0.57 () {56 vars in 1099 bytes} [Fri Sep 16 07:40:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:40:51.193867 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51af3cf-2134-49e1-bbc7-4514e1517e1a None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:40:51.242291 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc786c9-378e-4c27-a036-70bb183558a7 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:40:51.280293 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcee0d4-9909-47f1-8846-46548fe6d2bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:40:51.280968 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcee0d4-9909-47f1-8846-46548fe6d2bd None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:40:51.281326 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcee0d4-9909-47f1-8846-46548fe6d2bd None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:40:51.281600 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcee0d4-9909-47f1-8846-46548fe6d2bd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:40:51.292989 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dcee0d4-9909-47f1-8846-46548fe6d2bd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:40:51.294646 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dcee0d4-9909-47f1-8846-46548fe6d2bd None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:40:51.311557 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application [None req-6dcee0d4-9909-47f1-8846-46548fe6d2bd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 07:40:51.311557 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 07:40:51.311557 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 07:40:51.311557 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 07:40:51.311557 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 07:40:51.311557 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 07:40:51.311557 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 07:40:51.311557 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 07:40:51.311557 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 07:40:51.311557 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 07:40:51.311557 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 07:40:51.311557 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 07:40:51.311557 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 07:40:51.311557 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 07:40:51.311557 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 07:40:51.311557 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 07:40:51.312457 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 07:40:51.312457 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 07:40:51.312457 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 07:40:51.312457 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 07:40:51.312457 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 07:40:51.312457 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 07:40:51.312457 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 07:40:51.312457 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application with Lock( Sep 16 07:40:51.312457 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 07:40:51.312457 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._enter() Sep 16 07:40:51.312457 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 07:40:51.312457 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 07:40:51.312457 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 07:40:51.312457 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.creator() Sep 16 07:40:51.312457 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 07:40:51.312457 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application created_value = creator( Sep 16 07:40:51.312457 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 07:40:51.313245 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 07:40:51.313245 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 07:40:51.313245 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Sep 16 07:40:51.313245 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 16/32] 10.222.0.57 () {56 vars in 1108 bytes} [Fri Sep 16 07:40:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 16 07:40:51.313462 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcee0d4-9909-47f1-8846-46548fe6d2bd None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:40:51.324651 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51af3cf-2134-49e1-bbc7-4514e1517e1a None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:40:51.346091 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:40:51.360892 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8272c5-bced-44c5-9a4a-1a09ceb554a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:40:51.362000 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8272c5-bced-44c5-9a4a-1a09ceb554a9 None admin] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:40:51.362180 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8272c5-bced-44c5-9a4a-1a09ceb554a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:40:51.362447 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8272c5-bced-44c5-9a4a-1a09ceb554a9 None admin] PATH_INFO: `/v3/roles` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:40:51.363166 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8272c5-bced-44c5-9a4a-1a09ceb554a9 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:40:51.364537 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8272c5-bced-44c5-9a4a-1a09ceb554a9 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:40:51.429248 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcee0d4-9909-47f1-8846-46548fe6d2bd None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:40:51.466910 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de45bff3-5eae-4e92-930f-e28be35b0ff7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:40:51.467881 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de45bff3-5eae-4e92-930f-e28be35b0ff7 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:40:51.468412 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de45bff3-5eae-4e92-930f-e28be35b0ff7 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:40:51.468880 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de45bff3-5eae-4e92-930f-e28be35b0ff7 None admin] PATH_INFO: `/v3/users/a76c683889e54d429dbaa09123371861` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:40:51.470278 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de45bff3-5eae-4e92-930f-e28be35b0ff7 None admin] RBAC: Authorizing `identity:get_user(user_id=a76c683889e54d429dbaa09123371861)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:40:51.472162 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de45bff3-5eae-4e92-930f-e28be35b0ff7 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:40:51.474013 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 17/33] 10.222.0.57 () {56 vars in 1177 bytes} [Fri Sep 16 07:40:51 2022] GET /identity/v3/users/a76c683889e54d429dbaa09123371861 => generated 247 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:40:51.474942 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de45bff3-5eae-4e92-930f-e28be35b0ff7 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:40:51.494531 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 17/34] 10.222.0.57 () {60 vars in 1131 bytes} [Fri Sep 16 07:40:51 2022] POST /identity/v3/roles => generated 219 bytes in 301 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 07:40:51.495774 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8272c5-bced-44c5-9a4a-1a09ceb554a9 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:40:51.528904 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:40:51.575041 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:40:51.624496 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8272c5-bced-44c5-9a4a-1a09ceb554a9 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:40:51.648666 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de45bff3-5eae-4e92-930f-e28be35b0ff7 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:40:51.664453 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47d03ef-3a0b-4dce-9eed-6aaedadb2379 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:40:51.665125 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47d03ef-3a0b-4dce-9eed-6aaedadb2379 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:40:51.665411 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47d03ef-3a0b-4dce-9eed-6aaedadb2379 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:40:51.665686 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47d03ef-3a0b-4dce-9eed-6aaedadb2379 None admin] PATH_INFO: `/v3/domains` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:40:51.666498 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47d03ef-3a0b-4dce-9eed-6aaedadb2379 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:40:51.666803 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47d03ef-3a0b-4dce-9eed-6aaedadb2379 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:40:51.668460 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47d03ef-3a0b-4dce-9eed-6aaedadb2379 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:40:51.682861 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 18/35] 10.222.0.57 () {56 vars in 1109 bytes} [Fri Sep 16 07:40:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:40:51.683855 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47d03ef-3a0b-4dce-9eed-6aaedadb2379 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:40:51.700834 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd989fb-a78d-4cfe-b4b8-9418706ec8eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:40:51.702035 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd989fb-a78d-4cfe-b4b8-9418706ec8eb None admin] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:40:51.702717 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd989fb-a78d-4cfe-b4b8-9418706ec8eb None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:40:51.703206 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd989fb-a78d-4cfe-b4b8-9418706ec8eb None admin] PATH_INFO: `/v3/roles` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:40:51.704085 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd989fb-a78d-4cfe-b4b8-9418706ec8eb None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:40:51.706125 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd989fb-a78d-4cfe-b4b8-9418706ec8eb None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:40:51.789694 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:40:51.804308 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47d03ef-3a0b-4dce-9eed-6aaedadb2379 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:40:51.834363 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 18/36] 10.222.0.57 () {60 vars in 1131 bytes} [Fri Sep 16 07:40:51 2022] POST /identity/v3/roles => generated 225 bytes in 360 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 07:40:51.835331 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd989fb-a78d-4cfe-b4b8-9418706ec8eb None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:40:51.843593 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3202ff15-4e25-42bb-9eab-e19b782e5dad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:40:51.844612 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3202ff15-4e25-42bb-9eab-e19b782e5dad None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:40:51.845126 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3202ff15-4e25-42bb-9eab-e19b782e5dad None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:40:51.845596 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3202ff15-4e25-42bb-9eab-e19b782e5dad None admin] PATH_INFO: `/v3/domains/default` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:40:51.847624 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3202ff15-4e25-42bb-9eab-e19b782e5dad None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:40:51.849399 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3202ff15-4e25-42bb-9eab-e19b782e5dad None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:40:51.851501 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 19/37] 10.222.0.57 () {56 vars in 1108 bytes} [Fri Sep 16 07:40:51 2022] GET /identity/v3/domains/default => generated 199 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:40:51.853187 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa98e49e-c2b1-416e-82cb-f43b3382cda9 None None] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:40:51.853680 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa98e49e-c2b1-416e-82cb-f43b3382cda9 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:40:51.854480 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa98e49e-c2b1-416e-82cb-f43b3382cda9 None None] PATH_INFO: `/` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:40:51.860057 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 20/38] 10.222.0.57 () {54 vars in 927 bytes} [Fri Sep 16 07:40:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 07:40:51.860057 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0069e809-3f2d-4cb1-9f76-591ebcc8843a None None] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:40:51.860057 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0069e809-3f2d-4cb1-9f76-591ebcc8843a None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:40:51.860057 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0069e809-3f2d-4cb1-9f76-591ebcc8843a None None] PATH_INFO: `/` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:40:51.860057 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 21/39] 10.222.0.57 () {54 vars in 927 bytes} [Fri Sep 16 07:40:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 07:40:51.860057 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0069e809-3f2d-4cb1-9f76-591ebcc8843a None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:40:51.962689 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd989fb-a78d-4cfe-b4b8-9418706ec8eb None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:40:51.979872 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:40:51.991332 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0069e809-3f2d-4cb1-9f76-591ebcc8843a None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:40:52.005281 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f874f25b-27ac-493b-9219-1ee5dd80fe96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:40:52.005281 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f874f25b-27ac-493b-9219-1ee5dd80fe96 None admin] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:40:52.005564 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f874f25b-27ac-493b-9219-1ee5dd80fe96 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:40:52.005848 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f874f25b-27ac-493b-9219-1ee5dd80fe96 None admin] PATH_INFO: `/v3/projects` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:40:52.006466 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f874f25b-27ac-493b-9219-1ee5dd80fe96 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:40:52.008050 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f874f25b-27ac-493b-9219-1ee5dd80fe96 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:40:52.032110 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46faebf-a572-4110-a0ae-c3e3592ff76c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:40:52.032866 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46faebf-a572-4110-a0ae-c3e3592ff76c None admin] REQUEST_METHOD: `PUT` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:40:52.033681 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46faebf-a572-4110-a0ae-c3e3592ff76c None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:40:52.034119 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46faebf-a572-4110-a0ae-c3e3592ff76c None admin] PATH_INFO: `/v3/domains/default/users/a76c683889e54d429dbaa09123371861/roles/567db03c91854ad9af1e9a87ec1bd275` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:40:52.038788 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46faebf-a572-4110-a0ae-c3e3592ff76c None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=a76c683889e54d429dbaa09123371861, role_id=567db03c91854ad9af1e9a87ec1bd275)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:40:52.039621 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46faebf-a572-4110-a0ae-c3e3592ff76c None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:40:52.047290 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 19/40] 10.222.0.57 () {60 vars in 1141 bytes} [Fri Sep 16 07:40:51 2022] POST /identity/v3/projects => generated 301 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 07:40:52.048367 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80c12f5-1ae2-4aa8-9873-9571edf7c4fd None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:40:52.048658 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80c12f5-1ae2-4aa8-9873-9571edf7c4fd None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:40:52.049549 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80c12f5-1ae2-4aa8-9873-9571edf7c4fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:40:52.066989 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 22/41] 10.222.0.57 () {58 vars in 1361 bytes} [Fri Sep 16 07:40:51 2022] PUT /identity/v3/domains/default/users/a76c683889e54d429dbaa09123371861/roles/567db03c91854ad9af1e9a87ec1bd275 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 07:40:52.066989 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9407ade-ede5-4618-8579-d3ca44e57c84 None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:40:52.066989 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9407ade-ede5-4618-8579-d3ca44e57c84 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:40:52.066989 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9407ade-ede5-4618-8579-d3ca44e57c84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:40:52.071842 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-d80c12f5-1ae2-4aa8-9873-9571edf7c4fd None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:40:52.073520 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-d80c12f5-1ae2-4aa8-9873-9571edf7c4fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:40:52.086429 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-f9407ade-ede5-4618-8579-d3ca44e57c84 None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:40:52.088243 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-f9407ade-ede5-4618-8579-d3ca44e57c84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:40:52.102718 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:40:52.198732 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 23/42] 10.222.0.57 () {58 vars in 1024 bytes} [Fri Sep 16 07:40:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 07:40:52.201940 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 20/43] 10.222.0.57 () {58 vars in 1024 bytes} [Fri Sep 16 07:40:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 07:40:52.470314 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9407ade-ede5-4618-8579-d3ca44e57c84 None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:40:52.475112 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80c12f5-1ae2-4aa8-9873-9571edf7c4fd None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:40:52.583606 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9407ade-ede5-4618-8579-d3ca44e57c84 None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:40:52.620801 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962c5fb2-58d4-4cce-ba60-d68c401610a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:40:52.621429 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962c5fb2-58d4-4cce-ba60-d68c401610a5 None admin] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:40:52.621714 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962c5fb2-58d4-4cce-ba60-d68c401610a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:40:52.622015 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962c5fb2-58d4-4cce-ba60-d68c401610a5 None admin] PATH_INFO: `/v3/roles` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:40:52.622703 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962c5fb2-58d4-4cce-ba60-d68c401610a5 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:40:52.624128 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962c5fb2-58d4-4cce-ba60-d68c401610a5 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:40:52.643482 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 24/44] 10.222.0.57 () {60 vars in 1131 bytes} [Fri Sep 16 07:40:52 2022] POST /identity/v3/roles => generated 223 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 07:40:52.691699 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:40:52.700039 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80c12f5-1ae2-4aa8-9873-9571edf7c4fd None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:40:52.740456 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16bd8ae-9cb1-4e1c-b6f1-571a5f0e415f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:40:52.741026 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16bd8ae-9cb1-4e1c-b6f1-571a5f0e415f None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:40:52.741321 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16bd8ae-9cb1-4e1c-b6f1-571a5f0e415f None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:40:52.741586 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16bd8ae-9cb1-4e1c-b6f1-571a5f0e415f None admin] PATH_INFO: `/v3/domains/default` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:40:52.742950 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16bd8ae-9cb1-4e1c-b6f1-571a5f0e415f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:40:52.744500 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16bd8ae-9cb1-4e1c-b6f1-571a5f0e415f None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:40:52.746354 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 21/45] 10.222.0.57 () {56 vars in 1108 bytes} [Fri Sep 16 07:40:52 2022] GET /identity/v3/domains/default => generated 199 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 07:40:52.752464 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962c5fb2-58d4-4cce-ba60-d68c401610a5 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:40:52.762115 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:40:52.867339 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962c5fb2-58d4-4cce-ba60-d68c401610a5 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:40:52.905594 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c861fb82-8e99-4d70-8c8e-bd7a815fa31f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:40:52.906298 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c861fb82-8e99-4d70-8c8e-bd7a815fa31f None admin] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:40:52.906583 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c861fb82-8e99-4d70-8c8e-bd7a815fa31f None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:40:52.906862 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c861fb82-8e99-4d70-8c8e-bd7a815fa31f None admin] PATH_INFO: `/v3/projects` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:40:52.907518 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c861fb82-8e99-4d70-8c8e-bd7a815fa31f None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:40:52.909206 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c861fb82-8e99-4d70-8c8e-bd7a815fa31f None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:40:52.936630 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 25/46] 10.222.0.57 () {60 vars in 1141 bytes} [Fri Sep 16 07:40:52 2022] POST /identity/v3/projects => generated 312 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 07:40:54.270453 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9423992-92d7-42fe-9f5f-2f76199e7236 None None] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:40:54.270991 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9423992-92d7-42fe-9f5f-2f76199e7236 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:40:54.270991 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9423992-92d7-42fe-9f5f-2f76199e7236 None None] PATH_INFO: `/` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:40:54.272480 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 22/47] 10.222.0.57 () {54 vars in 927 bytes} [Fri Sep 16 07:40:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 16 07:40:54.277578 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0d3fd2-4bf2-4f1b-9c91-b5b76be34fc6 None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:40:54.278004 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0d3fd2-4bf2-4f1b-9c91-b5b76be34fc6 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:40:54.278191 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0d3fd2-4bf2-4f1b-9c91-b5b76be34fc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:40:54.296415 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-7e0d3fd2-4bf2-4f1b-9c91-b5b76be34fc6 None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:40:54.297599 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-7e0d3fd2-4bf2-4f1b-9c91-b5b76be34fc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:40:54.349345 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:40:54.364668 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 26/48] 10.222.0.57 () {58 vars in 1024 bytes} [Fri Sep 16 07:40:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 07:40:54.659695 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9423992-92d7-42fe-9f5f-2f76199e7236 None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:40:54.762084 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9423992-92d7-42fe-9f5f-2f76199e7236 None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:40:54.796375 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964b029d-af50-4507-9bd2-c73262cd48aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:40:54.797008 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964b029d-af50-4507-9bd2-c73262cd48aa None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:40:54.797291 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964b029d-af50-4507-9bd2-c73262cd48aa None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:40:54.797563 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964b029d-af50-4507-9bd2-c73262cd48aa None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:40:54.808038 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964b029d-af50-4507-9bd2-c73262cd48aa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 07:40:54.812998 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application [None req-964b029d-af50-4507-9bd2-c73262cd48aa None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 16 07:40:54.812998 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 07:40:54.812998 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 07:40:54.812998 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 07:40:54.812998 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 07:40:54.812998 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 07:40:54.812998 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 07:40:54.812998 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 07:40:54.812998 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 07:40:54.812998 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 07:40:54.812998 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 07:40:54.812998 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 07:40:54.812998 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 07:40:54.812998 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 07:40:54.812998 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 07:40:54.812998 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 07:40:54.813873 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 07:40:54.813873 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 07:40:54.813873 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 07:40:54.813873 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 07:40:54.813873 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 07:40:54.813873 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 07:40:54.813873 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 07:40:54.813873 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 07:40:54.813873 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 07:40:54.813873 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 07:40:54.813873 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 07:40:54.813873 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application with Lock( Sep 16 07:40:54.813873 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 07:40:54.813873 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._enter() Sep 16 07:40:54.813873 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 07:40:54.813873 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 07:40:54.814791 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 07:40:54.814791 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.creator() Sep 16 07:40:54.814791 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 07:40:54.814791 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application created_value = creator( Sep 16 07:40:54.814791 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 07:40:54.814791 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 07:40:54.814791 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 07:40:54.814791 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 07:40:54.814791 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 07:40:54.814791 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 07:40:54.814791 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 16 07:40:54.814791 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Sep 16 07:40:54.814791 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 23/49] 10.222.0.57 () {56 vars in 1096 bytes} [Fri Sep 16 07:40:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 07:40:54.820398 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0d3fd2-4bf2-4f1b-9c91-b5b76be34fc6 None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:40:54.919712 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0d3fd2-4bf2-4f1b-9c91-b5b76be34fc6 None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:40:55.061686 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82ad511-acce-4405-b560-feb5407d683b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:40:55.062326 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82ad511-acce-4405-b560-feb5407d683b None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:40:55.062618 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82ad511-acce-4405-b560-feb5407d683b None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:40:55.062891 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82ad511-acce-4405-b560-feb5407d683b None admin] PATH_INFO: `/v3/roles` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:40:55.063558 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82ad511-acce-4405-b560-feb5407d683b None admin] RBAC: Adding query filter params (name=admin) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:40:55.063864 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82ad511-acce-4405-b560-feb5407d683b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:40:55.065950 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82ad511-acce-4405-b560-feb5407d683b None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:40:55.074460 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 27/50] 10.222.0.57 () {56 vars in 1099 bytes} [Fri Sep 16 07:40:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:40:55.082376 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964b029d-af50-4507-9bd2-c73262cd48aa None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:40:55.110123 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:40:55.133093 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d0767c-d93e-4fb7-969a-89e2ae7a9da3 None None] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:40:55.133378 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d0767c-d93e-4fb7-969a-89e2ae7a9da3 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:40:55.133656 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d0767c-d93e-4fb7-969a-89e2ae7a9da3 None None] PATH_INFO: `/` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:40:55.135423 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 28/51] 10.222.0.57 () {54 vars in 927 bytes} [Fri Sep 16 07:40:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 16 07:40:55.140190 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50a771e-6306-40f9-aeb7-a8c18731a821 None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:40:55.140476 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50a771e-6306-40f9-aeb7-a8c18731a821 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:40:55.140756 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50a771e-6306-40f9-aeb7-a8c18731a821 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:40:55.159832 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-f50a771e-6306-40f9-aeb7-a8c18731a821 None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:40:55.161060 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-f50a771e-6306-40f9-aeb7-a8c18731a821 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:40:55.193563 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964b029d-af50-4507-9bd2-c73262cd48aa None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:40:55.214776 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:40:55.233991 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc534a7-ec7c-46bc-8532-75bc7a183b79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:40:55.234635 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc534a7-ec7c-46bc-8532-75bc7a183b79 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:40:55.234916 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc534a7-ec7c-46bc-8532-75bc7a183b79 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:40:55.235195 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc534a7-ec7c-46bc-8532-75bc7a183b79 None admin] PATH_INFO: `/v3/users/a76c683889e54d429dbaa09123371861` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:40:55.236554 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc534a7-ec7c-46bc-8532-75bc7a183b79 None admin] RBAC: Authorizing `identity:get_user(user_id=a76c683889e54d429dbaa09123371861)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:40:55.237009 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 29/52] 10.222.0.57 () {58 vars in 1024 bytes} [Fri Sep 16 07:40:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 16 07:40:55.238369 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc534a7-ec7c-46bc-8532-75bc7a183b79 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:40:55.239986 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 24/53] 10.222.0.57 () {56 vars in 1177 bytes} [Fri Sep 16 07:40:55 2022] GET /identity/v3/users/a76c683889e54d429dbaa09123371861 => generated 247 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:40:55.245534 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50a771e-6306-40f9-aeb7-a8c18731a821 None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:40:55.356159 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50a771e-6306-40f9-aeb7-a8c18731a821 None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:40:55.396831 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273a0f76-dcc8-4fed-9c10-f63bc1f1bf7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:40:55.397469 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273a0f76-dcc8-4fed-9c10-f63bc1f1bf7a None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:40:55.397780 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273a0f76-dcc8-4fed-9c10-f63bc1f1bf7a None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:40:55.398057 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273a0f76-dcc8-4fed-9c10-f63bc1f1bf7a None admin] PATH_INFO: `/v3/domains/default` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:40:55.399701 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273a0f76-dcc8-4fed-9c10-f63bc1f1bf7a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:40:55.401138 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273a0f76-dcc8-4fed-9c10-f63bc1f1bf7a None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:40:55.402865 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 30/54] 10.222.0.57 () {56 vars in 1108 bytes} [Fri Sep 16 07:40:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:40:55.409269 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc534a7-ec7c-46bc-8532-75bc7a183b79 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:40:55.505002 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:40:55.514168 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc534a7-ec7c-46bc-8532-75bc7a183b79 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:40:55.532620 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273a0f76-dcc8-4fed-9c10-f63bc1f1bf7a None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:40:55.549323 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c117626e-99cf-47d8-92bd-97f56fa87fb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:40:55.550070 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c117626e-99cf-47d8-92bd-97f56fa87fb1 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:40:55.550352 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c117626e-99cf-47d8-92bd-97f56fa87fb1 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:40:55.550628 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c117626e-99cf-47d8-92bd-97f56fa87fb1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:40:55.551368 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c117626e-99cf-47d8-92bd-97f56fa87fb1 None admin] RBAC: Adding query filter params (role.id=567db03c91854ad9af1e9a87ec1bd275, scope.domain.id=default, user.id=a76c683889e54d429dbaa09123371861) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:40:55.551674 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c117626e-99cf-47d8-92bd-97f56fa87fb1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:40:55.553140 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c117626e-99cf-47d8-92bd-97f56fa87fb1 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:40:55.559222 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 25/55] 10.222.0.57 () {56 vars in 1322 bytes} [Fri Sep 16 07:40:55 2022] GET /identity/v3/role_assignments?user.id=a76c683889e54d429dbaa09123371861&scope.domain.id=default&role.id=567db03c91854ad9af1e9a87ec1bd275 => generated 530 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:40:55.593569 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:40:55.656110 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273a0f76-dcc8-4fed-9c10-f63bc1f1bf7a None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:40:55.698559 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9e83cf-81cc-470a-bdee-94c3ec34d706 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:40:55.699208 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9e83cf-81cc-470a-bdee-94c3ec34d706 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:40:55.699714 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9e83cf-81cc-470a-bdee-94c3ec34d706 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:40:55.699996 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9e83cf-81cc-470a-bdee-94c3ec34d706 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:40:55.701194 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9e83cf-81cc-470a-bdee-94c3ec34d706 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:40:55.702793 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9e83cf-81cc-470a-bdee-94c3ec34d706 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:40:55.704889 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 31/56] 10.222.0.57 () {56 vars in 1108 bytes} [Fri Sep 16 07:40:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 07:40:55.712719 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c117626e-99cf-47d8-92bd-97f56fa87fb1 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:40:55.831703 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c117626e-99cf-47d8-92bd-97f56fa87fb1 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:40:55.868231 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55601089-6d5b-4ec3-b462-1dfd8b3aa3df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:40:55.869115 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55601089-6d5b-4ec3-b462-1dfd8b3aa3df None admin] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:40:55.869534 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55601089-6d5b-4ec3-b462-1dfd8b3aa3df None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:40:55.869979 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55601089-6d5b-4ec3-b462-1dfd8b3aa3df None admin] PATH_INFO: `/v3/projects` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:40:55.870971 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55601089-6d5b-4ec3-b462-1dfd8b3aa3df None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:40:55.873236 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55601089-6d5b-4ec3-b462-1dfd8b3aa3df None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:40:55.910212 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 26/57] 10.222.0.57 () {60 vars in 1140 bytes} [Fri Sep 16 07:40:55 2022] POST /identity/v3/projects => generated 298 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 07:40:58.062561 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece1727a-1284-4815-b70e-c5644d57c777 None None] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:40:58.063076 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece1727a-1284-4815-b70e-c5644d57c777 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:40:58.063159 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece1727a-1284-4815-b70e-c5644d57c777 None None] PATH_INFO: `/` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:40:58.064969 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 32/58] 10.222.0.57 () {54 vars in 927 bytes} [Fri Sep 16 07:40:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 07:40:58.070428 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a12e551-42dc-4660-80f2-9644e5018a9d None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:40:58.070848 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a12e551-42dc-4660-80f2-9644e5018a9d None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:40:58.070988 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a12e551-42dc-4660-80f2-9644e5018a9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:40:58.089484 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-8a12e551-42dc-4660-80f2-9644e5018a9d None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:40:58.090718 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-8a12e551-42dc-4660-80f2-9644e5018a9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:40:58.092671 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:40:58.157707 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 27/59] 10.222.0.57 () {58 vars in 1024 bytes} [Fri Sep 16 07:40:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 07:40:58.434986 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece1727a-1284-4815-b70e-c5644d57c777 None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:40:58.532644 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece1727a-1284-4815-b70e-c5644d57c777 None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:40:58.548969 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:40:58.566115 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49843ef7-0540-4a8d-9983-c47f0db8ee89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:40:58.566731 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49843ef7-0540-4a8d-9983-c47f0db8ee89 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:40:58.567009 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49843ef7-0540-4a8d-9983-c47f0db8ee89 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:40:58.567281 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49843ef7-0540-4a8d-9983-c47f0db8ee89 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:40:58.568377 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49843ef7-0540-4a8d-9983-c47f0db8ee89 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:40:58.569829 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49843ef7-0540-4a8d-9983-c47f0db8ee89 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:40:58.571353 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 33/60] 10.222.0.57 () {56 vars in 1108 bytes} [Fri Sep 16 07:40:58 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:40:58.576758 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a12e551-42dc-4660-80f2-9644e5018a9d None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:40:58.674264 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a12e551-42dc-4660-80f2-9644e5018a9d None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:40:58.708119 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cfa7d3-cebe-4b1a-afdd-068ba79bf92e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:40:58.708670 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cfa7d3-cebe-4b1a-afdd-068ba79bf92e None admin] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:40:58.708951 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cfa7d3-cebe-4b1a-afdd-068ba79bf92e None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:40:58.709228 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cfa7d3-cebe-4b1a-afdd-068ba79bf92e None admin] PATH_INFO: `/v3/users` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:40:58.709914 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86cfa7d3-cebe-4b1a-afdd-068ba79bf92e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:40:58.711357 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86cfa7d3-cebe-4b1a-afdd-068ba79bf92e None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:40:58.726097 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:40:58.739255 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 28/61] 10.222.0.57 () {60 vars in 1132 bytes} [Fri Sep 16 07:40:58 2022] POST /identity/v3/users => generated 275 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 16 07:41:02.152901 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14579150-5506-4dff-be85-300db38ff050 None None] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:41:02.153942 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14579150-5506-4dff-be85-300db38ff050 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:41:02.154414 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14579150-5506-4dff-be85-300db38ff050 None None] PATH_INFO: `/` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:41:02.156048 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 34/62] 10.222.0.57 () {54 vars in 927 bytes} [Fri Sep 16 07:41:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 07:41:02.162393 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3b3781-08cc-4237-9fcd-9884ab6e1bc5 None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:41:02.163273 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3b3781-08cc-4237-9fcd-9884ab6e1bc5 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:41:02.163738 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3b3781-08cc-4237-9fcd-9884ab6e1bc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:41:02.168343 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70eb8849-28fe-4bd4-8200-42f4920a84d1 None None] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:41:02.168901 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70eb8849-28fe-4bd4-8200-42f4920a84d1 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:41:02.169377 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70eb8849-28fe-4bd4-8200-42f4920a84d1 None None] PATH_INFO: `/` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:41:02.171516 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 35/63] 10.222.0.57 () {54 vars in 927 bytes} [Fri Sep 16 07:41:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 07:41:02.177664 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d995c970-01b2-43a2-8757-306cd52c50f0 None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:41:02.178388 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d995c970-01b2-43a2-8757-306cd52c50f0 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:41:02.178872 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d995c970-01b2-43a2-8757-306cd52c50f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:41:02.207311 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-7e3b3781-08cc-4237-9fcd-9884ab6e1bc5 None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:41:02.211988 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-d995c970-01b2-43a2-8757-306cd52c50f0 None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:41:02.213422 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-7e3b3781-08cc-4237-9fcd-9884ab6e1bc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:41:02.214806 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-d995c970-01b2-43a2-8757-306cd52c50f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:41:02.313281 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 36/64] 10.222.0.57 () {58 vars in 1024 bytes} [Fri Sep 16 07:41:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 16 07:41:02.316357 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce08ba0-5ae0-42e1-95c8-7a017a5bbcb6 None None] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:41:02.317126 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce08ba0-5ae0-42e1-95c8-7a017a5bbcb6 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:41:02.317600 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce08ba0-5ae0-42e1-95c8-7a017a5bbcb6 None None] PATH_INFO: `/` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:41:02.320105 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 37/65] 10.222.0.57 () {54 vars in 927 bytes} [Fri Sep 16 07:41:02 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 07:41:02.325435 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160e7fff-02bd-4dba-8595-d0722737b949 None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:41:02.325917 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160e7fff-02bd-4dba-8595-d0722737b949 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:41:02.326376 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160e7fff-02bd-4dba-8595-d0722737b949 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:41:02.337907 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 29/66] 10.222.0.57 () {58 vars in 1024 bytes} [Fri Sep 16 07:41:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 07:41:02.345056 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-160e7fff-02bd-4dba-8595-d0722737b949 None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:41:02.346651 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-160e7fff-02bd-4dba-8595-d0722737b949 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:41:02.420878 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 38/67] 10.222.0.57 () {58 vars in 1024 bytes} [Fri Sep 16 07:41:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 16 07:41:02.608436 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3b3781-08cc-4237-9fcd-9884ab6e1bc5 None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:41:02.628177 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b16dece-f484-435c-a83e-96c601f022df None None] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:41:02.628791 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b16dece-f484-435c-a83e-96c601f022df None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:41:02.629279 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b16dece-f484-435c-a83e-96c601f022df None None] PATH_INFO: `/` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:41:02.631119 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 39/68] 10.222.0.57 () {54 vars in 927 bytes} [Fri Sep 16 07:41:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 07:41:02.636154 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a26831f-039d-45a2-8fbb-e359684bc354 None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:41:02.636659 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a26831f-039d-45a2-8fbb-e359684bc354 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:41:02.637128 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a26831f-039d-45a2-8fbb-e359684bc354 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:41:02.657267 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-0a26831f-039d-45a2-8fbb-e359684bc354 None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:41:02.659449 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-0a26831f-039d-45a2-8fbb-e359684bc354 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:41:02.712048 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:41:02.727390 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3b3781-08cc-4237-9fcd-9884ab6e1bc5 None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:41:02.749453 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 40/69] 10.222.0.57 () {58 vars in 1024 bytes} [Fri Sep 16 07:41:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 16 07:41:02.751129 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a26831f-039d-45a2-8fbb-e359684bc354 None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:41:02.756256 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:41:02.773342 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5adb023-d475-4eb4-b6e4-24e6bac6b8d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:41:02.774448 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5adb023-d475-4eb4-b6e4-24e6bac6b8d7 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:41:02.774957 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5adb023-d475-4eb4-b6e4-24e6bac6b8d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:41:02.775457 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5adb023-d475-4eb4-b6e4-24e6bac6b8d7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:41:02.792149 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5adb023-d475-4eb4-b6e4-24e6bac6b8d7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 07:41:02.797411 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application [None req-b5adb023-d475-4eb4-b6e4-24e6bac6b8d7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 16 07:41:02.797411 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 07:41:02.797411 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 07:41:02.797411 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 07:41:02.797411 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 07:41:02.797411 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 07:41:02.797411 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 07:41:02.797411 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 07:41:02.797411 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 07:41:02.797411 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 07:41:02.797411 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 07:41:02.797411 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 07:41:02.797411 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 07:41:02.797411 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 07:41:02.797411 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 07:41:02.797411 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 07:41:02.798905 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 07:41:02.798905 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 07:41:02.798905 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 07:41:02.798905 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 07:41:02.798905 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 07:41:02.798905 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 07:41:02.798905 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 07:41:02.798905 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 07:41:02.798905 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 07:41:02.798905 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 07:41:02.798905 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 07:41:02.798905 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application with Lock( Sep 16 07:41:02.798905 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 07:41:02.798905 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._enter() Sep 16 07:41:02.798905 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 07:41:02.798905 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 07:41:02.799674 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 07:41:02.799674 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.creator() Sep 16 07:41:02.799674 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 07:41:02.799674 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application created_value = creator( Sep 16 07:41:02.799674 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 07:41:02.799674 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 07:41:02.799674 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 07:41:02.799674 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 07:41:02.799674 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 07:41:02.799674 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 07:41:02.799674 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 16 07:41:02.799674 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Sep 16 07:41:02.801981 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 30/70] 10.222.0.57 () {56 vars in 1099 bytes} [Fri Sep 16 07:41:02 2022] GET /identity/v3/roles/member => generated 84 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 07:41:02.812677 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5adb023-d475-4eb4-b6e4-24e6bac6b8d7 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:41:02.873038 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a26831f-039d-45a2-8fbb-e359684bc354 None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:41:02.910720 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1120236e-c584-4184-91d7-0f3c4ab0b9d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:41:02.911346 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1120236e-c584-4184-91d7-0f3c4ab0b9d9 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:41:02.911624 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1120236e-c584-4184-91d7-0f3c4ab0b9d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:41:02.911923 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1120236e-c584-4184-91d7-0f3c4ab0b9d9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:41:02.923409 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1120236e-c584-4184-91d7-0f3c4ab0b9d9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 07:41:02.929991 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application [None req-1120236e-c584-4184-91d7-0f3c4ab0b9d9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 16 07:41:02.929991 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 07:41:02.929991 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 07:41:02.929991 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 07:41:02.929991 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 07:41:02.929991 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 07:41:02.929991 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 07:41:02.929991 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 07:41:02.929991 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 07:41:02.929991 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 07:41:02.929991 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 07:41:02.929991 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 07:41:02.929991 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 07:41:02.929991 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 07:41:02.929991 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 07:41:02.929991 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 07:41:02.930897 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 07:41:02.930897 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 07:41:02.930897 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 07:41:02.930897 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 07:41:02.930897 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 07:41:02.930897 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 07:41:02.930897 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 07:41:02.930897 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 07:41:02.930897 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 07:41:02.930897 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 07:41:02.930897 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 07:41:02.930897 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application with Lock( Sep 16 07:41:02.930897 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 07:41:02.930897 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._enter() Sep 16 07:41:02.930897 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 07:41:02.930897 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 07:41:02.931823 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 07:41:02.931823 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.creator() Sep 16 07:41:02.931823 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 07:41:02.931823 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application created_value = creator( Sep 16 07:41:02.931823 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 07:41:02.931823 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 07:41:02.931823 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 07:41:02.931823 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 07:41:02.931823 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 07:41:02.931823 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 07:41:02.931823 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 16 07:41:02.931823 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Sep 16 07:41:02.935983 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 41/71] 10.222.0.57 () {56 vars in 1096 bytes} [Fri Sep 16 07:41:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 07:41:02.936823 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1120236e-c584-4184-91d7-0f3c4ab0b9d9 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:41:02.960865 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5adb023-d475-4eb4-b6e4-24e6bac6b8d7 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:41:02.973965 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:41:02.996929 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511192c9-0d99-448a-ad29-e32c6b95539e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:41:02.997536 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511192c9-0d99-448a-ad29-e32c6b95539e None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:41:02.997847 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511192c9-0d99-448a-ad29-e32c6b95539e None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:41:02.998128 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511192c9-0d99-448a-ad29-e32c6b95539e None admin] PATH_INFO: `/v3/roles` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:41:02.998769 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511192c9-0d99-448a-ad29-e32c6b95539e None admin] RBAC: Adding query filter params (name=member) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:41:02.999078 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511192c9-0d99-448a-ad29-e32c6b95539e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:41:03.000460 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511192c9-0d99-448a-ad29-e32c6b95539e None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:41:03.008843 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 31/72] 10.222.0.57 () {56 vars in 1101 bytes} [Fri Sep 16 07:41:02 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:41:03.010024 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ad6d9f-9326-4977-91f0-bdd641ebbfc4 None None] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:41:03.010304 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ad6d9f-9326-4977-91f0-bdd641ebbfc4 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:41:03.010566 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ad6d9f-9326-4977-91f0-bdd641ebbfc4 None None] PATH_INFO: `/` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:41:03.011904 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 32/73] 10.222.0.57 () {54 vars in 927 bytes} [Fri Sep 16 07:41:03 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 07:41:03.012461 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ad6d9f-9326-4977-91f0-bdd641ebbfc4 None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:41:03.054036 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1120236e-c584-4184-91d7-0f3c4ab0b9d9 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:41:03.065510 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:41:03.088476 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3757203-d9b0-4220-af25-3e9f62fa4f6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:41:03.089116 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3757203-d9b0-4220-af25-3e9f62fa4f6d None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:41:03.089400 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3757203-d9b0-4220-af25-3e9f62fa4f6d None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:41:03.089676 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3757203-d9b0-4220-af25-3e9f62fa4f6d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:41:03.101297 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3757203-d9b0-4220-af25-3e9f62fa4f6d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 07:41:03.106309 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application [None req-f3757203-d9b0-4220-af25-3e9f62fa4f6d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 16 07:41:03.106309 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 07:41:03.106309 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 07:41:03.106309 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 07:41:03.106309 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 07:41:03.106309 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 07:41:03.106309 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 07:41:03.106309 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 07:41:03.106309 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 07:41:03.106309 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 07:41:03.106309 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 07:41:03.106309 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 07:41:03.106309 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 07:41:03.106309 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 07:41:03.106309 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 07:41:03.106309 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 07:41:03.107219 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 07:41:03.107219 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 07:41:03.107219 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 07:41:03.107219 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 07:41:03.107219 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 07:41:03.107219 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 07:41:03.107219 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 07:41:03.107219 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 07:41:03.107219 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 07:41:03.107219 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 07:41:03.107219 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 07:41:03.107219 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application with Lock( Sep 16 07:41:03.107219 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 07:41:03.107219 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._enter() Sep 16 07:41:03.107219 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 07:41:03.107219 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 07:41:03.108145 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 07:41:03.108145 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.creator() Sep 16 07:41:03.108145 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 07:41:03.108145 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application created_value = creator( Sep 16 07:41:03.108145 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 07:41:03.108145 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 07:41:03.108145 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 07:41:03.108145 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 07:41:03.108145 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 07:41:03.108145 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 07:41:03.108145 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 16 07:41:03.108145 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Sep 16 07:41:03.108145 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 42/74] 10.222.0.57 () {56 vars in 1114 bytes} [Fri Sep 16 07:41:02 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 07:41:03.108916 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3757203-d9b0-4220-af25-3e9f62fa4f6d None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:41:03.122439 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ad6d9f-9326-4977-91f0-bdd641ebbfc4 None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:41:03.157581 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cea4d94-681c-40be-a276-d9dfcf960f3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:41:03.158798 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cea4d94-681c-40be-a276-d9dfcf960f3a None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:41:03.159080 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cea4d94-681c-40be-a276-d9dfcf960f3a None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:41:03.159350 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cea4d94-681c-40be-a276-d9dfcf960f3a None admin] PATH_INFO: `/v3/roles` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:41:03.159996 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cea4d94-681c-40be-a276-d9dfcf960f3a None admin] RBAC: Adding query filter params (name=admin) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:41:03.160295 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cea4d94-681c-40be-a276-d9dfcf960f3a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:41:03.161675 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cea4d94-681c-40be-a276-d9dfcf960f3a None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:41:03.169912 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 33/75] 10.222.0.57 () {56 vars in 1099 bytes} [Fri Sep 16 07:41:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:41:03.171034 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df323ba-da3e-414b-b32b-1b337667cc3d None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:41:03.171309 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df323ba-da3e-414b-b32b-1b337667cc3d None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:41:03.171627 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df323ba-da3e-414b-b32b-1b337667cc3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:41:03.189582 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-1df323ba-da3e-414b-b32b-1b337667cc3d None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:41:03.190828 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-1df323ba-da3e-414b-b32b-1b337667cc3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:41:03.203882 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:41:03.211494 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3757203-d9b0-4220-af25-3e9f62fa4f6d None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:41:03.250212 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7483dc9d-d6a4-4dd2-b223-0ac326a6c849 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:41:03.250764 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7483dc9d-d6a4-4dd2-b223-0ac326a6c849 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:41:03.251044 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7483dc9d-d6a4-4dd2-b223-0ac326a6c849 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:41:03.252018 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7483dc9d-d6a4-4dd2-b223-0ac326a6c849 None admin] PATH_INFO: `/v3/users/0b68433814c44561931bfd7051cd6b7d` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:41:03.265643 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 34/76] 10.222.0.57 () {58 vars in 1024 bytes} [Fri Sep 16 07:41:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 07:41:03.266576 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df323ba-da3e-414b-b32b-1b337667cc3d None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:41:03.268335 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7483dc9d-d6a4-4dd2-b223-0ac326a6c849 None admin] RBAC: Authorizing `identity:get_user(user_id=0b68433814c44561931bfd7051cd6b7d)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:41:03.269842 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7483dc9d-d6a4-4dd2-b223-0ac326a6c849 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:41:03.271508 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 43/77] 10.222.0.57 () {56 vars in 1177 bytes} [Fri Sep 16 07:41:03 2022] GET /identity/v3/users/0b68433814c44561931bfd7051cd6b7d => generated 275 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:41:03.275888 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7483dc9d-d6a4-4dd2-b223-0ac326a6c849 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:41:03.319539 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:41:03.384876 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7483dc9d-d6a4-4dd2-b223-0ac326a6c849 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:41:03.393739 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df323ba-da3e-414b-b32b-1b337667cc3d None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:41:03.419649 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5c747e-1322-421c-8639-040b5ebca740 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:41:03.420260 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5c747e-1322-421c-8639-040b5ebca740 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:41:03.420548 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5c747e-1322-421c-8639-040b5ebca740 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:41:03.420828 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5c747e-1322-421c-8639-040b5ebca740 None admin] PATH_INFO: `/v3/roles` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:41:03.421492 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5c747e-1322-421c-8639-040b5ebca740 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:41:03.421830 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5c747e-1322-421c-8639-040b5ebca740 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:41:03.423293 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5c747e-1322-421c-8639-040b5ebca740 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:41:03.431704 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 44/78] 10.222.0.57 () {56 vars in 1111 bytes} [Fri Sep 16 07:41:03 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:41:03.432431 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5c747e-1322-421c-8639-040b5ebca740 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:41:03.438516 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b366671d-9fb0-4073-b0c0-8a0c0494e53d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:41:03.439924 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b366671d-9fb0-4073-b0c0-8a0c0494e53d None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:41:03.440200 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b366671d-9fb0-4073-b0c0-8a0c0494e53d None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:41:03.440470 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b366671d-9fb0-4073-b0c0-8a0c0494e53d None admin] PATH_INFO: `/v3/roles/member` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:41:03.448719 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:41:03.453326 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b366671d-9fb0-4073-b0c0-8a0c0494e53d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 07:41:03.459339 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application [None req-b366671d-9fb0-4073-b0c0-8a0c0494e53d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 16 07:41:03.459339 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 07:41:03.459339 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 07:41:03.459339 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 07:41:03.459339 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 07:41:03.459339 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 07:41:03.459339 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 07:41:03.459339 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 07:41:03.459339 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 07:41:03.459339 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 07:41:03.459339 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 07:41:03.459339 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 07:41:03.459339 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 07:41:03.459339 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 07:41:03.459339 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 07:41:03.459339 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 07:41:03.460212 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 07:41:03.460212 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 07:41:03.460212 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 07:41:03.460212 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 07:41:03.460212 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 07:41:03.460212 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 07:41:03.460212 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 07:41:03.460212 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 07:41:03.460212 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 07:41:03.460212 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 07:41:03.460212 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 07:41:03.460212 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application with Lock( Sep 16 07:41:03.460212 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 07:41:03.460212 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._enter() Sep 16 07:41:03.460212 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 07:41:03.460212 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 07:41:03.460978 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 07:41:03.460978 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.creator() Sep 16 07:41:03.460978 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 07:41:03.460978 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application created_value = creator( Sep 16 07:41:03.460978 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 07:41:03.460978 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 07:41:03.460978 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 07:41:03.460978 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 07:41:03.460978 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 07:41:03.460978 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 07:41:03.460978 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 16 07:41:03.460978 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Sep 16 07:41:03.460978 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 35/79] 10.222.0.57 () {56 vars in 1099 bytes} [Fri Sep 16 07:41:03 2022] GET /identity/v3/roles/member => generated 84 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 07:41:03.461604 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b366671d-9fb0-4073-b0c0-8a0c0494e53d None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:41:03.540007 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5c747e-1322-421c-8639-040b5ebca740 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:41:03.564430 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:41:03.568365 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b366671d-9fb0-4073-b0c0-8a0c0494e53d None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:41:03.577436 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994bbc74-8267-45b2-b32c-e2f3132965fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:41:03.578121 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994bbc74-8267-45b2-b32c-e2f3132965fb None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:41:03.578407 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994bbc74-8267-45b2-b32c-e2f3132965fb None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:41:03.578685 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994bbc74-8267-45b2-b32c-e2f3132965fb None admin] PATH_INFO: `/v3/users/a76c683889e54d429dbaa09123371861` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:41:03.580367 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994bbc74-8267-45b2-b32c-e2f3132965fb None admin] RBAC: Authorizing `identity:get_user(user_id=a76c683889e54d429dbaa09123371861)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:41:03.581865 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994bbc74-8267-45b2-b32c-e2f3132965fb None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:41:03.583506 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 45/80] 10.222.0.57 () {56 vars in 1177 bytes} [Fri Sep 16 07:41:03 2022] GET /identity/v3/users/a76c683889e54d429dbaa09123371861 => generated 247 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:41:03.584289 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994bbc74-8267-45b2-b32c-e2f3132965fb None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:41:03.608768 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f1e102-76e3-4bdb-bfa9-d51326f6ba52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:41:03.609385 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f1e102-76e3-4bdb-bfa9-d51326f6ba52 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:41:03.609661 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f1e102-76e3-4bdb-bfa9-d51326f6ba52 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:41:03.609964 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f1e102-76e3-4bdb-bfa9-d51326f6ba52 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:41:03.669866 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:41:03.678568 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f1e102-76e3-4bdb-bfa9-d51326f6ba52 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:41:03.680106 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f1e102-76e3-4bdb-bfa9-d51326f6ba52 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:41:03.689449 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994bbc74-8267-45b2-b32c-e2f3132965fb None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:41:03.724052 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693056d8-7a58-47a6-9336-41298b84c1c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:41:03.724710 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693056d8-7a58-47a6-9336-41298b84c1c0 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:41:03.724991 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693056d8-7a58-47a6-9336-41298b84c1c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:41:03.725266 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693056d8-7a58-47a6-9336-41298b84c1c0 None admin] PATH_INFO: `/v3/users/0b68433814c44561931bfd7051cd6b7d` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:41:03.726393 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693056d8-7a58-47a6-9336-41298b84c1c0 None admin] RBAC: Authorizing `identity:get_user(user_id=0b68433814c44561931bfd7051cd6b7d)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:41:03.727834 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693056d8-7a58-47a6-9336-41298b84c1c0 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:41:03.729402 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 46/81] 10.222.0.57 () {56 vars in 1177 bytes} [Fri Sep 16 07:41:03 2022] GET /identity/v3/users/0b68433814c44561931bfd7051cd6b7d => generated 275 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:41:03.730181 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693056d8-7a58-47a6-9336-41298b84c1c0 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:41:03.779551 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:41:03.784150 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 36/82] 10.222.0.57 () {58 vars in 1282 bytes} [Fri Sep 16 07:41:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 16 07:41:03.784989 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f1e102-76e3-4bdb-bfa9-d51326f6ba52 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:41:03.831206 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693056d8-7a58-47a6-9336-41298b84c1c0 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:41:03.864590 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023e8137-cfe9-41b8-8b70-0d22bc4bcf7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:41:03.865197 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023e8137-cfe9-41b8-8b70-0d22bc4bcf7b None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:41:03.865478 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023e8137-cfe9-41b8-8b70-0d22bc4bcf7b None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:41:03.865781 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023e8137-cfe9-41b8-8b70-0d22bc4bcf7b None admin] PATH_INFO: `/v3/roles` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:41:03.866447 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023e8137-cfe9-41b8-8b70-0d22bc4bcf7b None admin] RBAC: Adding query filter params (name=member) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:41:03.866750 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023e8137-cfe9-41b8-8b70-0d22bc4bcf7b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:41:03.868131 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023e8137-cfe9-41b8-8b70-0d22bc4bcf7b None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:41:03.876034 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 47/83] 10.222.0.57 () {56 vars in 1101 bytes} [Fri Sep 16 07:41:03 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:41:03.876034 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023e8137-cfe9-41b8-8b70-0d22bc4bcf7b None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:41:03.889849 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f1e102-76e3-4bdb-bfa9-d51326f6ba52 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:41:03.891747 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:41:03.929611 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbf9c46-d04d-456a-8ec1-05184239acc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:41:03.930290 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbf9c46-d04d-456a-8ec1-05184239acc3 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:41:03.930571 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbf9c46-d04d-456a-8ec1-05184239acc3 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:41:03.930845 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbf9c46-d04d-456a-8ec1-05184239acc3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:41:03.931994 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbf9c46-d04d-456a-8ec1-05184239acc3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:41:03.933451 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbf9c46-d04d-456a-8ec1-05184239acc3 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:41:03.935051 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 37/84] 10.222.0.57 () {56 vars in 1108 bytes} [Fri Sep 16 07:41:03 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:41:03.935815 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbf9c46-d04d-456a-8ec1-05184239acc3 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:41:03.977976 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023e8137-cfe9-41b8-8b70-0d22bc4bcf7b None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:41:04.000356 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:41:04.011815 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd1b78e-89ff-4956-b6a8-66917ffa1935 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:41:04.012420 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd1b78e-89ff-4956-b6a8-66917ffa1935 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:41:04.012701 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd1b78e-89ff-4956-b6a8-66917ffa1935 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:41:04.013001 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd1b78e-89ff-4956-b6a8-66917ffa1935 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:41:04.034770 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbf9c46-d04d-456a-8ec1-05184239acc3 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:41:04.068049 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9872dc14-5381-412a-ae12-34e51846996b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:41:04.068647 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9872dc14-5381-412a-ae12-34e51846996b None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:41:04.068924 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9872dc14-5381-412a-ae12-34e51846996b None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:41:04.069195 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9872dc14-5381-412a-ae12-34e51846996b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:41:04.078975 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd1b78e-89ff-4956-b6a8-66917ffa1935 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:41:04.081123 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd1b78e-89ff-4956-b6a8-66917ffa1935 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:41:04.094551 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:41:04.137882 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9872dc14-5381-412a-ae12-34e51846996b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:41:04.139364 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9872dc14-5381-412a-ae12-34e51846996b None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:41:04.180947 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 48/85] 10.222.0.57 () {58 vars in 1282 bytes} [Fri Sep 16 07:41:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 16 07:41:04.181826 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd1b78e-89ff-4956-b6a8-66917ffa1935 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:41:04.201909 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:41:04.236694 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 38/86] 10.222.0.57 () {58 vars in 1282 bytes} [Fri Sep 16 07:41:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 16 07:41:04.237522 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9872dc14-5381-412a-ae12-34e51846996b None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:41:04.280509 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd1b78e-89ff-4956-b6a8-66917ffa1935 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:41:04.293576 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:41:04.315123 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2697dd15-d68f-4bfc-b9f5-03d14b509e36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:41:04.315745 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2697dd15-d68f-4bfc-b9f5-03d14b509e36 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:41:04.316024 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2697dd15-d68f-4bfc-b9f5-03d14b509e36 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:41:04.316299 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2697dd15-d68f-4bfc-b9f5-03d14b509e36 None admin] PATH_INFO: `/v3/projects/5324c5a353924497b2d5372a26cbe6fc` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:41:04.317404 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2697dd15-d68f-4bfc-b9f5-03d14b509e36 None admin] RBAC: Authorizing `identity:get_project(project_id=5324c5a353924497b2d5372a26cbe6fc)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:41:04.318884 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2697dd15-d68f-4bfc-b9f5-03d14b509e36 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:41:04.320492 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 49/87] 10.222.0.57 () {56 vars in 1186 bytes} [Fri Sep 16 07:41:04 2022] GET /identity/v3/projects/5324c5a353924497b2d5372a26cbe6fc => generated 298 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:41:04.321225 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2697dd15-d68f-4bfc-b9f5-03d14b509e36 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:41:04.335165 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9872dc14-5381-412a-ae12-34e51846996b None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:41:04.369544 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ef35be-503d-4a86-ba04-8941c8710741 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:41:04.370300 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ef35be-503d-4a86-ba04-8941c8710741 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:41:04.370589 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ef35be-503d-4a86-ba04-8941c8710741 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:41:04.370866 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ef35be-503d-4a86-ba04-8941c8710741 None admin] PATH_INFO: `/v3/users/0b68433814c44561931bfd7051cd6b7d` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:41:04.371985 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ef35be-503d-4a86-ba04-8941c8710741 None admin] RBAC: Authorizing `identity:get_user(user_id=0b68433814c44561931bfd7051cd6b7d)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:41:04.373429 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ef35be-503d-4a86-ba04-8941c8710741 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:41:04.375032 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 39/88] 10.222.0.57 () {56 vars in 1177 bytes} [Fri Sep 16 07:41:04 2022] GET /identity/v3/users/0b68433814c44561931bfd7051cd6b7d => generated 275 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:41:04.375787 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ef35be-503d-4a86-ba04-8941c8710741 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:41:04.409880 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:41:04.424721 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2697dd15-d68f-4bfc-b9f5-03d14b509e36 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:41:04.458170 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785889ab-7e18-4e34-8cdb-e3bb6a5de49e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:41:04.458781 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785889ab-7e18-4e34-8cdb-e3bb6a5de49e None admin] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:41:04.459061 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785889ab-7e18-4e34-8cdb-e3bb6a5de49e None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:41:04.459336 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785889ab-7e18-4e34-8cdb-e3bb6a5de49e None admin] PATH_INFO: `/v3/users` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:41:04.459981 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785889ab-7e18-4e34-8cdb-e3bb6a5de49e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:41:04.461417 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785889ab-7e18-4e34-8cdb-e3bb6a5de49e None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:41:04.476474 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ef35be-503d-4a86-ba04-8941c8710741 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:41:04.488145 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 50/89] 10.222.0.57 () {60 vars in 1132 bytes} [Fri Sep 16 07:41:04 2022] POST /identity/v3/users => generated 289 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 07:41:04.488955 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785889ab-7e18-4e34-8cdb-e3bb6a5de49e None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:41:04.513271 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cb15a9-fc4f-486e-a2c1-fc600bb13bfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:41:04.513954 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cb15a9-fc4f-486e-a2c1-fc600bb13bfb None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:41:04.514234 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cb15a9-fc4f-486e-a2c1-fc600bb13bfb None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:41:04.514508 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cb15a9-fc4f-486e-a2c1-fc600bb13bfb None admin] PATH_INFO: `/v3/projects/5324c5a353924497b2d5372a26cbe6fc` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:41:04.515716 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74cb15a9-fc4f-486e-a2c1-fc600bb13bfb None admin] RBAC: Authorizing `identity:get_project(project_id=5324c5a353924497b2d5372a26cbe6fc)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:41:04.517849 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74cb15a9-fc4f-486e-a2c1-fc600bb13bfb None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:41:04.519661 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 40/90] 10.222.0.57 () {56 vars in 1186 bytes} [Fri Sep 16 07:41:04 2022] GET /identity/v3/projects/5324c5a353924497b2d5372a26cbe6fc => generated 298 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:41:04.524970 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cb15a9-fc4f-486e-a2c1-fc600bb13bfb None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:41:04.542845 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:41:04.622968 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785889ab-7e18-4e34-8cdb-e3bb6a5de49e None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:41:04.637520 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cb15a9-fc4f-486e-a2c1-fc600bb13bfb None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:41:04.639224 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:41:04.666449 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0882a27-3a67-405c-9f6e-c6a365fcd808 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:41:04.667229 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0882a27-3a67-405c-9f6e-c6a365fcd808 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:41:04.667514 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0882a27-3a67-405c-9f6e-c6a365fcd808 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:41:04.667951 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0882a27-3a67-405c-9f6e-c6a365fcd808 None admin] PATH_INFO: `/v3/projects/5324c5a353924497b2d5372a26cbe6fc` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:41:04.669413 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0882a27-3a67-405c-9f6e-c6a365fcd808 None admin] RBAC: Authorizing `identity:get_project(project_id=5324c5a353924497b2d5372a26cbe6fc)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:41:04.670992 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0882a27-3a67-405c-9f6e-c6a365fcd808 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:41:04.672635 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 51/91] 10.222.0.57 () {56 vars in 1186 bytes} [Fri Sep 16 07:41:04 2022] GET /identity/v3/projects/5324c5a353924497b2d5372a26cbe6fc => generated 298 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:41:04.674884 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0882a27-3a67-405c-9f6e-c6a365fcd808 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:41:04.679825 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86820801-0b0b-4a2a-a83e-04a5e93dc425 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:41:04.681762 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86820801-0b0b-4a2a-a83e-04a5e93dc425 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:41:04.681762 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86820801-0b0b-4a2a-a83e-04a5e93dc425 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:41:04.681762 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86820801-0b0b-4a2a-a83e-04a5e93dc425 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:41:04.681762 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86820801-0b0b-4a2a-a83e-04a5e93dc425 None admin] RBAC: Adding query filter params (role.id=4818d38cf2564825b312e66c9eb24762, scope.project.id=5324c5a353924497b2d5372a26cbe6fc, user.id=0b68433814c44561931bfd7051cd6b7d) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:41:04.681762 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86820801-0b0b-4a2a-a83e-04a5e93dc425 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:41:04.683290 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86820801-0b0b-4a2a-a83e-04a5e93dc425 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:41:04.690047 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 41/92] 10.222.0.57 () {56 vars in 1374 bytes} [Fri Sep 16 07:41:04 2022] GET /identity/v3/role_assignments?user.id=0b68433814c44561931bfd7051cd6b7d&scope.project.id=5324c5a353924497b2d5372a26cbe6fc&role.id=4818d38cf2564825b312e66c9eb24762 => generated 259 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:41:04.690927 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86820801-0b0b-4a2a-a83e-04a5e93dc425 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:41:04.800300 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0882a27-3a67-405c-9f6e-c6a365fcd808 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:41:04.806284 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:41:04.832430 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86820801-0b0b-4a2a-a83e-04a5e93dc425 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:41:04.854791 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db252662-c87b-4405-bf03-acd82b08f1b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:41:04.855430 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db252662-c87b-4405-bf03-acd82b08f1b7 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:41:04.855884 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db252662-c87b-4405-bf03-acd82b08f1b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:41:04.856174 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db252662-c87b-4405-bf03-acd82b08f1b7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:41:04.879406 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c359e0b-7cee-4247-9eba-3c15cda0ba84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:41:04.879929 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c359e0b-7cee-4247-9eba-3c15cda0ba84 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:41:04.880211 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c359e0b-7cee-4247-9eba-3c15cda0ba84 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:41:04.880484 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c359e0b-7cee-4247-9eba-3c15cda0ba84 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:41:04.881208 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c359e0b-7cee-4247-9eba-3c15cda0ba84 None admin] RBAC: Adding query filter params (role.id=567db03c91854ad9af1e9a87ec1bd275, scope.project.id=5324c5a353924497b2d5372a26cbe6fc, user.id=a76c683889e54d429dbaa09123371861) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:41:04.881515 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c359e0b-7cee-4247-9eba-3c15cda0ba84 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:41:04.882979 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c359e0b-7cee-4247-9eba-3c15cda0ba84 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:41:04.895841 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 42/93] 10.222.0.57 () {56 vars in 1374 bytes} [Fri Sep 16 07:41:04 2022] GET /identity/v3/role_assignments?user.id=a76c683889e54d429dbaa09123371861&scope.project.id=5324c5a353924497b2d5372a26cbe6fc&role.id=567db03c91854ad9af1e9a87ec1bd275 => generated 259 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:41:04.896709 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c359e0b-7cee-4247-9eba-3c15cda0ba84 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:41:04.944424 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:41:04.953549 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db252662-c87b-4405-bf03-acd82b08f1b7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:41:04.955510 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db252662-c87b-4405-bf03-acd82b08f1b7 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:41:05.082649 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c359e0b-7cee-4247-9eba-3c15cda0ba84 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:41:05.090959 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 52/94] 10.222.0.57 () {58 vars in 1282 bytes} [Fri Sep 16 07:41:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 16 07:41:05.097285 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db252662-c87b-4405-bf03-acd82b08f1b7 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:41:05.100587 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:41:05.194533 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e96599-8fe0-475c-af73-f0d65f97acec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:41:05.195072 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e96599-8fe0-475c-af73-f0d65f97acec None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:41:05.195352 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e96599-8fe0-475c-af73-f0d65f97acec None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:41:05.195625 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e96599-8fe0-475c-af73-f0d65f97acec None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:41:05.196355 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e96599-8fe0-475c-af73-f0d65f97acec None admin] RBAC: Adding query filter params (role.id=e92664bc677b40769b7a05d102541bf0, scope.project.id=5324c5a353924497b2d5372a26cbe6fc, user.id=0b68433814c44561931bfd7051cd6b7d) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:41:05.196661 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e96599-8fe0-475c-af73-f0d65f97acec None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:41:05.198145 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e96599-8fe0-475c-af73-f0d65f97acec None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:41:05.215607 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 43/95] 10.222.0.57 () {56 vars in 1374 bytes} [Fri Sep 16 07:41:04 2022] GET /identity/v3/role_assignments?user.id=0b68433814c44561931bfd7051cd6b7d&scope.project.id=5324c5a353924497b2d5372a26cbe6fc&role.id=e92664bc677b40769b7a05d102541bf0 => generated 259 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:41:05.219132 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db252662-c87b-4405-bf03-acd82b08f1b7 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:41:05.265494 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ce5db3-99b5-4b70-89a7-678a81c3a0c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:41:05.266178 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ce5db3-99b5-4b70-89a7-678a81c3a0c7 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:41:05.266465 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ce5db3-99b5-4b70-89a7-678a81c3a0c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:41:05.267238 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ce5db3-99b5-4b70-89a7-678a81c3a0c7 None admin] PATH_INFO: `/v3/projects/a64a86f16350436bbcdb4f188dec9608` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:41:05.274771 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ce5db3-99b5-4b70-89a7-678a81c3a0c7 None admin] RBAC: Authorizing `identity:get_project(project_id=a64a86f16350436bbcdb4f188dec9608)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:41:05.276261 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ce5db3-99b5-4b70-89a7-678a81c3a0c7 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:41:05.278057 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 53/96] 10.222.0.57 () {56 vars in 1186 bytes} [Fri Sep 16 07:41:05 2022] GET /identity/v3/projects/a64a86f16350436bbcdb4f188dec9608 => generated 312 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 07:41:05.285305 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e96599-8fe0-475c-af73-f0d65f97acec None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:41:05.443715 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:41:05.453635 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e96599-8fe0-475c-af73-f0d65f97acec None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:41:05.497471 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceef55f4-8071-4338-a047-e1a80096e09a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:41:05.498133 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceef55f4-8071-4338-a047-e1a80096e09a None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:41:05.498414 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceef55f4-8071-4338-a047-e1a80096e09a None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:41:05.498690 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceef55f4-8071-4338-a047-e1a80096e09a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:41:05.499421 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceef55f4-8071-4338-a047-e1a80096e09a None admin] RBAC: Adding query filter params (role.id=4818d38cf2564825b312e66c9eb24762, scope.project.id=a64a86f16350436bbcdb4f188dec9608, user.id=0b68433814c44561931bfd7051cd6b7d) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:41:05.499729 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceef55f4-8071-4338-a047-e1a80096e09a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:41:05.501930 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceef55f4-8071-4338-a047-e1a80096e09a None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:41:05.513948 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 44/97] 10.222.0.57 () {56 vars in 1374 bytes} [Fri Sep 16 07:41:05 2022] GET /identity/v3/role_assignments?user.id=0b68433814c44561931bfd7051cd6b7d&scope.project.id=a64a86f16350436bbcdb4f188dec9608&role.id=4818d38cf2564825b312e66c9eb24762 => generated 259 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:41:07.686838 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc158792-e032-4680-9eb4-bbf3bb626789 None None] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:41:07.687374 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc158792-e032-4680-9eb4-bbf3bb626789 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:41:07.687374 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc158792-e032-4680-9eb4-bbf3bb626789 None None] PATH_INFO: `/` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:41:07.689242 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 54/98] 10.222.0.57 () {54 vars in 927 bytes} [Fri Sep 16 07:41:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 07:41:07.694684 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa426ab-c1c4-40ca-886c-cfc879c3cf3f None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:41:07.695077 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa426ab-c1c4-40ca-886c-cfc879c3cf3f None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:41:07.695259 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa426ab-c1c4-40ca-886c-cfc879c3cf3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:41:07.722036 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-baa426ab-c1c4-40ca-886c-cfc879c3cf3f None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:41:07.723250 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-baa426ab-c1c4-40ca-886c-cfc879c3cf3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:41:07.822443 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 45/99] 10.222.0.57 () {58 vars in 1024 bytes} [Fri Sep 16 07:41:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 07:41:08.106173 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d73a0d-5faf-4c42-a7c2-662e195d1518 None None] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:41:08.106546 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d010af23-1480-4a76-aee3-aa2fc36e2e26 None None] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:41:08.106836 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d010af23-1480-4a76-aee3-aa2fc36e2e26 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:41:08.107114 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d010af23-1480-4a76-aee3-aa2fc36e2e26 None None] PATH_INFO: `/` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:41:08.107419 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d73a0d-5faf-4c42-a7c2-662e195d1518 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:41:08.107897 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d73a0d-5faf-4c42-a7c2-662e195d1518 None None] PATH_INFO: `/` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:41:08.108471 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 46/100] 10.222.0.57 () {54 vars in 927 bytes} [Fri Sep 16 07:41:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 16 07:41:08.109875 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 55/101] 10.222.0.57 () {54 vars in 927 bytes} [Fri Sep 16 07:41:08 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 07:41:08.114646 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623d452e-6c4d-4897-bdff-411d0e6fb23c None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:41:08.114931 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623d452e-6c4d-4897-bdff-411d0e6fb23c None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:41:08.115207 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623d452e-6c4d-4897-bdff-411d0e6fb23c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:41:08.127355 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d88894d-4e01-4ca1-b5ec-ebc3d5752b3c None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:41:08.127994 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d88894d-4e01-4ca1-b5ec-ebc3d5752b3c None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:41:08.128467 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d88894d-4e01-4ca1-b5ec-ebc3d5752b3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:41:08.146743 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-623d452e-6c4d-4897-bdff-411d0e6fb23c None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:41:08.147947 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-623d452e-6c4d-4897-bdff-411d0e6fb23c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:41:08.154761 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-0d88894d-4e01-4ca1-b5ec-ebc3d5752b3c None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:41:08.156216 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-0d88894d-4e01-4ca1-b5ec-ebc3d5752b3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:41:08.260205 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 56/102] 10.222.0.57 () {58 vars in 1024 bytes} [Fri Sep 16 07:41:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 16 07:41:08.278785 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d88894d-4e01-4ca1-b5ec-ebc3d5752b3c None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:41:08.291769 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:41:08.318339 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 47/103] 10.222.0.57 () {58 vars in 1024 bytes} [Fri Sep 16 07:41:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 16 07:41:08.405958 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d88894d-4e01-4ca1-b5ec-ebc3d5752b3c None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:41:08.459387 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8399e172-6777-4323-b2e2-a9bddcdc79f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:41:08.460062 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8399e172-6777-4323-b2e2-a9bddcdc79f8 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:41:08.460349 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8399e172-6777-4323-b2e2-a9bddcdc79f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:41:08.460707 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8399e172-6777-4323-b2e2-a9bddcdc79f8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:41:08.477365 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8399e172-6777-4323-b2e2-a9bddcdc79f8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 07:41:08.482458 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application [None req-8399e172-6777-4323-b2e2-a9bddcdc79f8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 16 07:41:08.482458 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 07:41:08.482458 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 07:41:08.482458 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 07:41:08.482458 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 07:41:08.482458 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 07:41:08.482458 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 07:41:08.482458 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 07:41:08.482458 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 07:41:08.482458 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 07:41:08.482458 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 07:41:08.482458 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 07:41:08.482458 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 07:41:08.482458 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 07:41:08.482458 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 07:41:08.482458 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 07:41:08.483300 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 07:41:08.483300 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 07:41:08.483300 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 07:41:08.483300 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 07:41:08.483300 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 07:41:08.483300 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 07:41:08.483300 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 07:41:08.483300 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 07:41:08.483300 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 07:41:08.483300 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 07:41:08.483300 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 07:41:08.483300 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application with Lock( Sep 16 07:41:08.483300 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 07:41:08.483300 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._enter() Sep 16 07:41:08.483300 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 07:41:08.483300 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 07:41:08.484044 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 07:41:08.484044 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.creator() Sep 16 07:41:08.484044 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 07:41:08.484044 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application created_value = creator( Sep 16 07:41:08.484044 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 07:41:08.484044 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 07:41:08.484044 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 07:41:08.484044 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 07:41:08.484044 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 07:41:08.484044 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 07:41:08.484044 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 16 07:41:08.484044 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Sep 16 07:41:08.484044 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 57/104] 10.222.0.57 () {56 vars in 1099 bytes} [Fri Sep 16 07:41:08 2022] GET /identity/v3/roles/member => generated 84 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 07:41:08.490322 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623d452e-6c4d-4897-bdff-411d0e6fb23c None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:41:08.526775 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:41:08.600322 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5922cfd-f603-4acc-972d-159b7f21b1f0 None None] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:41:08.600628 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5922cfd-f603-4acc-972d-159b7f21b1f0 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:41:08.601759 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5922cfd-f603-4acc-972d-159b7f21b1f0 None None] PATH_INFO: `/` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:41:08.603411 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 58/105] 10.222.0.57 () {54 vars in 927 bytes} [Fri Sep 16 07:41:08 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 07:41:08.608074 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3116fcf7-a27b-438c-a550-db2e24cf0333 None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:41:08.608611 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3116fcf7-a27b-438c-a550-db2e24cf0333 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:41:08.609088 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3116fcf7-a27b-438c-a550-db2e24cf0333 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:41:08.635295 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-3116fcf7-a27b-438c-a550-db2e24cf0333 None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:41:08.637339 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-3116fcf7-a27b-438c-a550-db2e24cf0333 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:41:08.657672 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623d452e-6c4d-4897-bdff-411d0e6fb23c None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:41:08.704081 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5075b68c-f5f8-4879-b9f4-b505ff0b9d71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:41:08.705638 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5075b68c-f5f8-4879-b9f4-b505ff0b9d71 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:41:08.706166 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5075b68c-f5f8-4879-b9f4-b505ff0b9d71 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:41:08.706719 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5075b68c-f5f8-4879-b9f4-b505ff0b9d71 None admin] PATH_INFO: `/v3/roles` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:41:08.707597 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5075b68c-f5f8-4879-b9f4-b505ff0b9d71 None admin] RBAC: Adding query filter params (name=member) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:41:08.708144 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5075b68c-f5f8-4879-b9f4-b505ff0b9d71 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:41:08.709704 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5075b68c-f5f8-4879-b9f4-b505ff0b9d71 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:41:08.718573 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 48/106] 10.222.0.57 () {56 vars in 1101 bytes} [Fri Sep 16 07:41:08 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:41:08.720670 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b44dea-55c4-44dd-b0fd-a125f4b2d8dc None None] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:41:08.721101 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b44dea-55c4-44dd-b0fd-a125f4b2d8dc None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:41:08.721480 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b44dea-55c4-44dd-b0fd-a125f4b2d8dc None None] PATH_INFO: `/` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:41:08.722878 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 49/107] 10.222.0.57 () {54 vars in 927 bytes} [Fri Sep 16 07:41:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 07:41:08.727686 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b44dea-55c4-44dd-b0fd-a125f4b2d8dc None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:41:08.729448 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:41:08.744586 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 59/108] 10.222.0.57 () {58 vars in 1024 bytes} [Fri Sep 16 07:41:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 16 07:41:08.745759 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3116fcf7-a27b-438c-a550-db2e24cf0333 None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:41:08.823800 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:41:08.845476 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b44dea-55c4-44dd-b0fd-a125f4b2d8dc None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:41:08.879778 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3116fcf7-a27b-438c-a550-db2e24cf0333 None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:41:08.882335 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e578afe2-f415-44dc-8060-b2f740567e0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:41:08.882964 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e578afe2-f415-44dc-8060-b2f740567e0c None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:41:08.883245 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e578afe2-f415-44dc-8060-b2f740567e0c None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:41:08.883773 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e578afe2-f415-44dc-8060-b2f740567e0c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:41:08.896880 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e578afe2-f415-44dc-8060-b2f740567e0c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 07:41:08.902337 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application [None req-e578afe2-f415-44dc-8060-b2f740567e0c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 16 07:41:08.902337 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 07:41:08.902337 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 07:41:08.902337 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 07:41:08.902337 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 07:41:08.902337 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 07:41:08.902337 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 07:41:08.902337 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 07:41:08.902337 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 07:41:08.902337 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 07:41:08.902337 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 07:41:08.902337 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 07:41:08.902337 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 07:41:08.902337 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 07:41:08.902337 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 07:41:08.902337 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 07:41:08.903329 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 07:41:08.903329 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 07:41:08.903329 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 07:41:08.903329 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 07:41:08.903329 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 07:41:08.903329 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 07:41:08.903329 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 07:41:08.903329 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 07:41:08.903329 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 07:41:08.903329 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 07:41:08.903329 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 07:41:08.903329 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application with Lock( Sep 16 07:41:08.903329 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 07:41:08.903329 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._enter() Sep 16 07:41:08.903329 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 07:41:08.903329 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 07:41:08.904261 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 07:41:08.904261 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.creator() Sep 16 07:41:08.904261 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 07:41:08.904261 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application created_value = creator( Sep 16 07:41:08.904261 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 07:41:08.904261 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 07:41:08.904261 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 07:41:08.904261 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 07:41:08.904261 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 07:41:08.904261 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 07:41:08.904261 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 16 07:41:08.904261 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Sep 16 07:41:08.906431 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 50/109] 10.222.0.57 () {56 vars in 1099 bytes} [Fri Sep 16 07:41:08 2022] GET /identity/v3/roles/reader => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 07:41:08.908039 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13d429e-fad1-4099-a8fb-63c49163f8b9 None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:41:08.908506 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13d429e-fad1-4099-a8fb-63c49163f8b9 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:41:08.908975 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13d429e-fad1-4099-a8fb-63c49163f8b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:41:08.925150 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672ede1c-f89f-45e7-ae95-a377c6bde93a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:41:08.925821 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672ede1c-f89f-45e7-ae95-a377c6bde93a None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:41:08.926108 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672ede1c-f89f-45e7-ae95-a377c6bde93a None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:41:08.926383 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672ede1c-f89f-45e7-ae95-a377c6bde93a None admin] PATH_INFO: `/v3/users/0b68433814c44561931bfd7051cd6b7d` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:41:08.927516 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672ede1c-f89f-45e7-ae95-a377c6bde93a None admin] RBAC: Authorizing `identity:get_user(user_id=0b68433814c44561931bfd7051cd6b7d)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:41:08.928982 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672ede1c-f89f-45e7-ae95-a377c6bde93a None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:41:08.929658 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-f13d429e-fad1-4099-a8fb-63c49163f8b9 None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:41:08.930598 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 60/110] 10.222.0.57 () {56 vars in 1177 bytes} [Fri Sep 16 07:41:08 2022] GET /identity/v3/users/0b68433814c44561931bfd7051cd6b7d => generated 275 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:41:08.931264 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-f13d429e-fad1-4099-a8fb-63c49163f8b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:41:08.931775 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5ae748-abcc-4abd-ad22-ce649a427908 None None] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:41:08.932063 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5ae748-abcc-4abd-ad22-ce649a427908 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:41:08.932337 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5ae748-abcc-4abd-ad22-ce649a427908 None None] PATH_INFO: `/` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:41:08.933698 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 61/111] 10.222.0.57 () {54 vars in 927 bytes} [Fri Sep 16 07:41:08 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 07:41:08.934308 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5ae748-abcc-4abd-ad22-ce649a427908 None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:41:08.996251 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:41:09.021748 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 51/112] 10.222.0.57 () {58 vars in 1024 bytes} [Fri Sep 16 07:41:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 07:41:09.021748 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13d429e-fad1-4099-a8fb-63c49163f8b9 None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:41:09.042003 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5ae748-abcc-4abd-ad22-ce649a427908 None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:41:09.078411 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0122a0-1d39-46e5-88b6-52627f34a52c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:41:09.079068 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0122a0-1d39-46e5-88b6-52627f34a52c None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:41:09.079357 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0122a0-1d39-46e5-88b6-52627f34a52c None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:41:09.079633 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0122a0-1d39-46e5-88b6-52627f34a52c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:41:09.089266 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:41:09.097448 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0122a0-1d39-46e5-88b6-52627f34a52c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 07:41:09.104755 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application [None req-9c0122a0-1d39-46e5-88b6-52627f34a52c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 16 07:41:09.104755 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 07:41:09.104755 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 07:41:09.104755 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 07:41:09.104755 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 07:41:09.104755 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 07:41:09.104755 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 07:41:09.104755 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 07:41:09.104755 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 07:41:09.104755 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 07:41:09.104755 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 07:41:09.104755 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 07:41:09.104755 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 07:41:09.104755 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 07:41:09.104755 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 07:41:09.104755 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 07:41:09.105823 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 07:41:09.105823 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 07:41:09.105823 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 07:41:09.105823 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 07:41:09.105823 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 07:41:09.105823 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 07:41:09.105823 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 07:41:09.105823 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 07:41:09.105823 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 07:41:09.105823 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 07:41:09.105823 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 07:41:09.105823 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application with Lock( Sep 16 07:41:09.105823 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 07:41:09.105823 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._enter() Sep 16 07:41:09.105823 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 07:41:09.105823 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 07:41:09.106603 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 07:41:09.106603 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.creator() Sep 16 07:41:09.106603 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 07:41:09.106603 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application created_value = creator( Sep 16 07:41:09.106603 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 07:41:09.106603 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 07:41:09.106603 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 07:41:09.106603 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 07:41:09.106603 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 07:41:09.106603 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 07:41:09.106603 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 16 07:41:09.106603 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Sep 16 07:41:09.106603 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 62/113] 10.222.0.57 () {56 vars in 1114 bytes} [Fri Sep 16 07:41:08 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 07:41:09.107229 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb565e0-e6de-4af9-a487-9878d98f7e70 None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:41:09.107353 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb565e0-e6de-4af9-a487-9878d98f7e70 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:41:09.107625 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb565e0-e6de-4af9-a487-9878d98f7e70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:41:09.126857 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-1bb565e0-e6de-4af9-a487-9878d98f7e70 None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:41:09.128238 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-1bb565e0-e6de-4af9-a487-9878d98f7e70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:41:09.129712 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13d429e-fad1-4099-a8fb-63c49163f8b9 None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:41:09.165749 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d3e767-b544-4909-bc1e-85aec9c1738c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:41:09.166289 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d3e767-b544-4909-bc1e-85aec9c1738c None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:41:09.166722 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d3e767-b544-4909-bc1e-85aec9c1738c None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:41:09.167132 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d3e767-b544-4909-bc1e-85aec9c1738c None admin] PATH_INFO: `/v3/roles` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:41:09.167940 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d3e767-b544-4909-bc1e-85aec9c1738c None admin] RBAC: Adding query filter params (name=reader) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:41:09.168377 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d3e767-b544-4909-bc1e-85aec9c1738c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:41:09.169928 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d3e767-b544-4909-bc1e-85aec9c1738c None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:41:09.179728 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 52/114] 10.222.0.57 () {56 vars in 1101 bytes} [Fri Sep 16 07:41:09 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:41:09.180802 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d3e767-b544-4909-bc1e-85aec9c1738c None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:41:09.204080 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 63/115] 10.222.0.57 () {58 vars in 1024 bytes} [Fri Sep 16 07:41:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 07:41:09.204080 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb565e0-e6de-4af9-a487-9878d98f7e70 None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:41:09.278323 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:41:09.300619 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d3e767-b544-4909-bc1e-85aec9c1738c None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:41:09.330201 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:41:09.335663 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ec99f6-625d-47a3-9cae-5c77e6918193 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:41:09.336293 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ec99f6-625d-47a3-9cae-5c77e6918193 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:41:09.336573 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ec99f6-625d-47a3-9cae-5c77e6918193 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:41:09.336846 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ec99f6-625d-47a3-9cae-5c77e6918193 None admin] PATH_INFO: `/v3/projects/5324c5a353924497b2d5372a26cbe6fc` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:41:09.337992 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ec99f6-625d-47a3-9cae-5c77e6918193 None admin] RBAC: Authorizing `identity:get_project(project_id=5324c5a353924497b2d5372a26cbe6fc)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:41:09.339447 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ec99f6-625d-47a3-9cae-5c77e6918193 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:41:09.341230 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 53/116] 10.222.0.57 () {56 vars in 1186 bytes} [Fri Sep 16 07:41:09 2022] GET /identity/v3/projects/5324c5a353924497b2d5372a26cbe6fc => generated 298 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:41:09.341968 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ec99f6-625d-47a3-9cae-5c77e6918193 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:41:09.350558 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb565e0-e6de-4af9-a487-9878d98f7e70 None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:41:09.384114 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fd1319-450d-48e2-baaa-390a3dbcea18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:41:09.384750 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fd1319-450d-48e2-baaa-390a3dbcea18 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:41:09.385034 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fd1319-450d-48e2-baaa-390a3dbcea18 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:41:09.385315 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fd1319-450d-48e2-baaa-390a3dbcea18 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:41:09.395544 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fd1319-450d-48e2-baaa-390a3dbcea18 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 07:41:09.400811 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application [None req-45fd1319-450d-48e2-baaa-390a3dbcea18 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 16 07:41:09.400811 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 07:41:09.400811 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 07:41:09.400811 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 07:41:09.400811 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 07:41:09.400811 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 07:41:09.400811 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 07:41:09.400811 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 07:41:09.400811 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 07:41:09.400811 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 07:41:09.400811 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 07:41:09.400811 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 07:41:09.400811 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 07:41:09.400811 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 07:41:09.400811 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 07:41:09.400811 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 07:41:09.401651 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 07:41:09.401651 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 07:41:09.401651 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 07:41:09.401651 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 07:41:09.401651 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 07:41:09.401651 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 07:41:09.401651 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 07:41:09.401651 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 07:41:09.401651 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 07:41:09.401651 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 07:41:09.401651 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 07:41:09.401651 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application with Lock( Sep 16 07:41:09.401651 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 07:41:09.401651 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._enter() Sep 16 07:41:09.401651 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 07:41:09.401651 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 07:41:09.402475 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 07:41:09.402475 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.creator() Sep 16 07:41:09.402475 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 07:41:09.402475 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application created_value = creator( Sep 16 07:41:09.402475 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 07:41:09.402475 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 07:41:09.402475 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 07:41:09.402475 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 07:41:09.402475 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 07:41:09.402475 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 07:41:09.402475 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 16 07:41:09.402475 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Sep 16 07:41:09.402475 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 64/117] 10.222.0.57 () {56 vars in 1099 bytes} [Fri Sep 16 07:41:09 2022] GET /identity/v3/roles/member => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 07:41:09.403098 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fd1319-450d-48e2-baaa-390a3dbcea18 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:41:09.460174 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ec99f6-625d-47a3-9cae-5c77e6918193 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:41:09.497203 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8b8489-6d03-4c71-834b-1c4a670a3649 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:41:09.497834 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8b8489-6d03-4c71-834b-1c4a670a3649 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:41:09.498122 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8b8489-6d03-4c71-834b-1c4a670a3649 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:41:09.498395 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8b8489-6d03-4c71-834b-1c4a670a3649 None admin] PATH_INFO: `/v3/roles` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:41:09.499051 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8b8489-6d03-4c71-834b-1c4a670a3649 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:41:09.499350 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8b8489-6d03-4c71-834b-1c4a670a3649 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:41:09.500724 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8b8489-6d03-4c71-834b-1c4a670a3649 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:41:09.507303 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fd1319-450d-48e2-baaa-390a3dbcea18 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:41:09.509162 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 54/118] 10.222.0.57 () {56 vars in 1111 bytes} [Fri Sep 16 07:41:09 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:41:09.509985 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8b8489-6d03-4c71-834b-1c4a670a3649 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:41:09.518511 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:41:09.542347 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8685a28-8e2f-4762-a7ce-c39fd0c9d447 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:41:09.542977 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8685a28-8e2f-4762-a7ce-c39fd0c9d447 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:41:09.543258 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8685a28-8e2f-4762-a7ce-c39fd0c9d447 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:41:09.543533 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8685a28-8e2f-4762-a7ce-c39fd0c9d447 None admin] PATH_INFO: `/v3/users/3a2f1a60395144368e2832ffe4c8afe2` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:41:09.557247 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8685a28-8e2f-4762-a7ce-c39fd0c9d447 None admin] RBAC: Authorizing `identity:get_user(user_id=3a2f1a60395144368e2832ffe4c8afe2)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:41:09.558753 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8685a28-8e2f-4762-a7ce-c39fd0c9d447 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:41:09.560365 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 65/119] 10.222.0.57 () {56 vars in 1177 bytes} [Fri Sep 16 07:41:09 2022] GET /identity/v3/users/3a2f1a60395144368e2832ffe4c8afe2 => generated 289 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:41:09.562331 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8685a28-8e2f-4762-a7ce-c39fd0c9d447 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:41:09.571148 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:41:09.611038 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8b8489-6d03-4c71-834b-1c4a670a3649 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:41:09.645933 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8986492-476c-4af6-a80e-b44dbb362bfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:41:09.646567 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8986492-476c-4af6-a80e-b44dbb362bfd None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:41:09.646849 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8986492-476c-4af6-a80e-b44dbb362bfd None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:41:09.647130 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8986492-476c-4af6-a80e-b44dbb362bfd None admin] PATH_INFO: `/v3/domains/default` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:41:09.648254 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8986492-476c-4af6-a80e-b44dbb362bfd None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:41:09.649710 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8986492-476c-4af6-a80e-b44dbb362bfd None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:41:09.651305 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 55/120] 10.222.0.57 () {56 vars in 1108 bytes} [Fri Sep 16 07:41:09 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:41:09.652070 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8986492-476c-4af6-a80e-b44dbb362bfd None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:41:09.661879 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8685a28-8e2f-4762-a7ce-c39fd0c9d447 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:41:09.694673 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c00625-c7d1-4426-85cc-c10756ec3231 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:41:09.695325 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c00625-c7d1-4426-85cc-c10756ec3231 None admin] REQUEST_METHOD: `PUT` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:41:09.695603 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c00625-c7d1-4426-85cc-c10756ec3231 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:41:09.695875 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c00625-c7d1-4426-85cc-c10756ec3231 None admin] PATH_INFO: `/v3/projects/5324c5a353924497b2d5372a26cbe6fc/users/0b68433814c44561931bfd7051cd6b7d/roles/4818d38cf2564825b312e66c9eb24762` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:41:09.697795 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c00625-c7d1-4426-85cc-c10756ec3231 None admin] RBAC: Authorizing `identity:create_grant(project_id=5324c5a353924497b2d5372a26cbe6fc, user_id=0b68433814c44561931bfd7051cd6b7d, role_id=4818d38cf2564825b312e66c9eb24762)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:41:09.699234 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c00625-c7d1-4426-85cc-c10756ec3231 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:41:09.711810 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 66/121] 10.222.0.57 () {58 vars in 1439 bytes} [Fri Sep 16 07:41:09 2022] PUT /identity/v3/projects/5324c5a353924497b2d5372a26cbe6fc/users/0b68433814c44561931bfd7051cd6b7d/roles/4818d38cf2564825b312e66c9eb24762 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 07:41:09.712522 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c00625-c7d1-4426-85cc-c10756ec3231 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:41:09.756069 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:41:09.764372 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8986492-476c-4af6-a80e-b44dbb362bfd None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:41:09.799165 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:41:09.807935 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5ac8cd-d5be-4dbd-a3ed-10998e380ece None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:41:09.808682 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5ac8cd-d5be-4dbd-a3ed-10998e380ece None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:41:09.809014 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5ac8cd-d5be-4dbd-a3ed-10998e380ece None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:41:09.809430 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5ac8cd-d5be-4dbd-a3ed-10998e380ece None admin] PATH_INFO: `/v3/roles` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:41:09.810232 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5ac8cd-d5be-4dbd-a3ed-10998e380ece None admin] RBAC: Adding query filter params (name=member) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:41:09.810650 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5ac8cd-d5be-4dbd-a3ed-10998e380ece None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:41:09.812064 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5ac8cd-d5be-4dbd-a3ed-10998e380ece None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:41:09.822179 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 56/122] 10.222.0.57 () {56 vars in 1101 bytes} [Fri Sep 16 07:41:09 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:41:09.822874 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5ac8cd-d5be-4dbd-a3ed-10998e380ece None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:41:09.851357 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c00625-c7d1-4426-85cc-c10756ec3231 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:41:09.895968 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222dfc8c-a6b5-42d2-a36e-787cf2584b3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:41:09.897021 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222dfc8c-a6b5-42d2-a36e-787cf2584b3e None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:41:09.897300 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222dfc8c-a6b5-42d2-a36e-787cf2584b3e None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:41:09.897776 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222dfc8c-a6b5-42d2-a36e-787cf2584b3e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:41:09.909611 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222dfc8c-a6b5-42d2-a36e-787cf2584b3e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 07:41:09.914633 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application [None req-222dfc8c-a6b5-42d2-a36e-787cf2584b3e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 16 07:41:09.914633 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 07:41:09.914633 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 07:41:09.914633 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 07:41:09.914633 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 07:41:09.914633 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 07:41:09.914633 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 07:41:09.914633 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 07:41:09.914633 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 07:41:09.914633 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 07:41:09.914633 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 07:41:09.914633 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 07:41:09.914633 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 07:41:09.914633 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 07:41:09.914633 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 07:41:09.914633 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 07:41:09.915497 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 07:41:09.915497 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 07:41:09.915497 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 07:41:09.915497 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 07:41:09.915497 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 07:41:09.915497 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 07:41:09.915497 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 07:41:09.915497 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 07:41:09.915497 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 07:41:09.915497 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 07:41:09.915497 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 07:41:09.915497 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application with Lock( Sep 16 07:41:09.915497 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 07:41:09.915497 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._enter() Sep 16 07:41:09.915497 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 07:41:09.915497 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 07:41:09.916257 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 07:41:09.916257 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.creator() Sep 16 07:41:09.916257 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 07:41:09.916257 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application created_value = creator( Sep 16 07:41:09.916257 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 07:41:09.916257 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 07:41:09.916257 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 07:41:09.916257 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 07:41:09.916257 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 07:41:09.916257 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 07:41:09.916257 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 16 07:41:09.916257 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Sep 16 07:41:09.916257 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 67/123] 10.222.0.57 () {56 vars in 1096 bytes} [Fri Sep 16 07:41:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 07:41:09.916882 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222dfc8c-a6b5-42d2-a36e-787cf2584b3e None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:41:09.945149 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5ac8cd-d5be-4dbd-a3ed-10998e380ece None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:41:09.980024 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b23e47-e5dd-4222-8843-e1776213363e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:41:09.980583 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b23e47-e5dd-4222-8843-e1776213363e None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:41:09.980866 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b23e47-e5dd-4222-8843-e1776213363e None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:41:09.981141 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b23e47-e5dd-4222-8843-e1776213363e None admin] PATH_INFO: `/v3/users/0b68433814c44561931bfd7051cd6b7d` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:41:09.982316 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b23e47-e5dd-4222-8843-e1776213363e None admin] RBAC: Authorizing `identity:get_user(user_id=0b68433814c44561931bfd7051cd6b7d)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:41:09.983791 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b23e47-e5dd-4222-8843-e1776213363e None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:41:09.986216 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 57/124] 10.222.0.57 () {56 vars in 1177 bytes} [Fri Sep 16 07:41:09 2022] GET /identity/v3/users/0b68433814c44561931bfd7051cd6b7d => generated 275 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:41:09.986928 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b23e47-e5dd-4222-8843-e1776213363e None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:41:10.017446 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:41:10.031131 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222dfc8c-a6b5-42d2-a36e-787cf2584b3e None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:41:10.053806 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:41:10.073946 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1102848d-067c-4dc6-9d64-7893dda68017 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:41:10.074565 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1102848d-067c-4dc6-9d64-7893dda68017 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:41:10.075109 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1102848d-067c-4dc6-9d64-7893dda68017 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:41:10.075109 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1102848d-067c-4dc6-9d64-7893dda68017 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:41:10.101769 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b23e47-e5dd-4222-8843-e1776213363e None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:41:10.141126 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b54a8c7-1df0-4801-b645-36d529b418fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:41:10.141781 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b54a8c7-1df0-4801-b645-36d529b418fd None admin] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:41:10.142244 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b54a8c7-1df0-4801-b645-36d529b418fd None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:41:10.142360 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b54a8c7-1df0-4801-b645-36d529b418fd None admin] PATH_INFO: `/v3/projects` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:41:10.142973 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b54a8c7-1df0-4801-b645-36d529b418fd None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:41:10.144422 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b54a8c7-1df0-4801-b645-36d529b418fd None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:41:10.152660 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1102848d-067c-4dc6-9d64-7893dda68017 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:41:10.154363 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1102848d-067c-4dc6-9d64-7893dda68017 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:41:10.174143 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 58/125] 10.222.0.57 () {60 vars in 1141 bytes} [Fri Sep 16 07:41:09 2022] POST /identity/v3/projects => generated 302 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 07:41:10.175160 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b54a8c7-1df0-4801-b645-36d529b418fd None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:41:10.298755 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:41:10.299436 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b54a8c7-1df0-4801-b645-36d529b418fd None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:41:10.316399 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:41:10.319822 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 68/126] 10.222.0.57 () {58 vars in 1282 bytes} [Fri Sep 16 07:41:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 16 07:41:10.321014 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1102848d-067c-4dc6-9d64-7893dda68017 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:41:10.352361 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba3cee2-0b16-489f-8ea6-ceee5cbf0ad7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:41:10.353623 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba3cee2-0b16-489f-8ea6-ceee5cbf0ad7 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:41:10.354127 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba3cee2-0b16-489f-8ea6-ceee5cbf0ad7 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:41:10.354834 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba3cee2-0b16-489f-8ea6-ceee5cbf0ad7 None admin] PATH_INFO: `/v3/users/0b68433814c44561931bfd7051cd6b7d` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:41:10.357111 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba3cee2-0b16-489f-8ea6-ceee5cbf0ad7 None admin] RBAC: Authorizing `identity:get_user(user_id=0b68433814c44561931bfd7051cd6b7d)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:41:10.359493 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba3cee2-0b16-489f-8ea6-ceee5cbf0ad7 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:41:10.362947 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 59/127] 10.222.0.57 () {56 vars in 1177 bytes} [Fri Sep 16 07:41:10 2022] GET /identity/v3/users/0b68433814c44561931bfd7051cd6b7d => generated 275 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:41:10.369074 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba3cee2-0b16-489f-8ea6-ceee5cbf0ad7 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:41:10.460652 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1102848d-067c-4dc6-9d64-7893dda68017 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:41:10.499874 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba3cee2-0b16-489f-8ea6-ceee5cbf0ad7 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:41:10.504314 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9929f17f-5dbf-4b7f-9a7a-1b4cb9edecd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:41:10.505014 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9929f17f-5dbf-4b7f-9a7a-1b4cb9edecd0 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:41:10.505371 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9929f17f-5dbf-4b7f-9a7a-1b4cb9edecd0 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:41:10.505743 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9929f17f-5dbf-4b7f-9a7a-1b4cb9edecd0 None admin] PATH_INFO: `/v3/roles` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:41:10.506495 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9929f17f-5dbf-4b7f-9a7a-1b4cb9edecd0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:41:10.506947 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9929f17f-5dbf-4b7f-9a7a-1b4cb9edecd0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:41:10.508680 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9929f17f-5dbf-4b7f-9a7a-1b4cb9edecd0 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:41:10.521888 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 69/128] 10.222.0.57 () {56 vars in 1099 bytes} [Fri Sep 16 07:41:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:41:10.523016 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9929f17f-5dbf-4b7f-9a7a-1b4cb9edecd0 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:41:10.551509 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fba59c-9bbb-4955-ad1d-9227a5a75afd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:41:10.552150 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fba59c-9bbb-4955-ad1d-9227a5a75afd None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:41:10.552497 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fba59c-9bbb-4955-ad1d-9227a5a75afd None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:41:10.552839 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fba59c-9bbb-4955-ad1d-9227a5a75afd None admin] PATH_INFO: `/v3/projects/5324c5a353924497b2d5372a26cbe6fc` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:41:10.554068 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fba59c-9bbb-4955-ad1d-9227a5a75afd None admin] RBAC: Authorizing `identity:get_project(project_id=5324c5a353924497b2d5372a26cbe6fc)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:41:10.555862 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fba59c-9bbb-4955-ad1d-9227a5a75afd None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:41:10.557922 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 60/129] 10.222.0.57 () {56 vars in 1186 bytes} [Fri Sep 16 07:41:10 2022] GET /identity/v3/projects/5324c5a353924497b2d5372a26cbe6fc => generated 298 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:41:10.563110 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fba59c-9bbb-4955-ad1d-9227a5a75afd None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:41:10.584295 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:41:10.617231 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:41:10.640444 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9929f17f-5dbf-4b7f-9a7a-1b4cb9edecd0 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:41:10.676028 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a084cc3-810e-400a-b927-6d133f3a25a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:41:10.676248 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fba59c-9bbb-4955-ad1d-9227a5a75afd None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:41:10.677121 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a084cc3-810e-400a-b927-6d133f3a25a9 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:41:10.677617 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a084cc3-810e-400a-b927-6d133f3a25a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:41:10.678113 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a084cc3-810e-400a-b927-6d133f3a25a9 None admin] PATH_INFO: `/v3/projects/5324c5a353924497b2d5372a26cbe6fc` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:41:10.679860 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a084cc3-810e-400a-b927-6d133f3a25a9 None admin] RBAC: Authorizing `identity:get_project(project_id=5324c5a353924497b2d5372a26cbe6fc)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:41:10.681540 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a084cc3-810e-400a-b927-6d133f3a25a9 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:41:10.683861 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 70/130] 10.222.0.57 () {56 vars in 1186 bytes} [Fri Sep 16 07:41:10 2022] GET /identity/v3/projects/5324c5a353924497b2d5372a26cbe6fc => generated 298 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:41:10.684849 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a084cc3-810e-400a-b927-6d133f3a25a9 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:41:10.728186 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2767c0b1-ed93-4cb9-ad5a-a833727c0ce5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:41:10.728648 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2767c0b1-ed93-4cb9-ad5a-a833727c0ce5 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:41:10.735764 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2767c0b1-ed93-4cb9-ad5a-a833727c0ce5 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:41:10.735764 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2767c0b1-ed93-4cb9-ad5a-a833727c0ce5 None admin] PATH_INFO: `/v3/projects/a64a86f16350436bbcdb4f188dec9608` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:41:10.735764 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2767c0b1-ed93-4cb9-ad5a-a833727c0ce5 None admin] RBAC: Authorizing `identity:get_project(project_id=a64a86f16350436bbcdb4f188dec9608)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:41:10.735764 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2767c0b1-ed93-4cb9-ad5a-a833727c0ce5 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:41:10.735764 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 61/131] 10.222.0.57 () {56 vars in 1186 bytes} [Fri Sep 16 07:41:10 2022] GET /identity/v3/projects/a64a86f16350436bbcdb4f188dec9608 => generated 312 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:41:10.735764 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2767c0b1-ed93-4cb9-ad5a-a833727c0ce5 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:41:10.821949 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a084cc3-810e-400a-b927-6d133f3a25a9 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:41:10.845234 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:41:10.863579 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2767c0b1-ed93-4cb9-ad5a-a833727c0ce5 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:41:10.867956 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5b8f71-8440-4244-b9ea-0c6ca18baf2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:41:10.868690 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5b8f71-8440-4244-b9ea-0c6ca18baf2f None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:41:10.869044 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5b8f71-8440-4244-b9ea-0c6ca18baf2f None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:41:10.869390 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5b8f71-8440-4244-b9ea-0c6ca18baf2f None admin] PATH_INFO: `/v3/users/a76c683889e54d429dbaa09123371861` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:41:10.870837 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5b8f71-8440-4244-b9ea-0c6ca18baf2f None admin] RBAC: Authorizing `identity:get_user(user_id=a76c683889e54d429dbaa09123371861)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:41:10.872915 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5b8f71-8440-4244-b9ea-0c6ca18baf2f None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:41:10.875300 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 71/132] 10.222.0.57 () {56 vars in 1177 bytes} [Fri Sep 16 07:41:10 2022] GET /identity/v3/users/a76c683889e54d429dbaa09123371861 => generated 247 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:41:10.876707 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5b8f71-8440-4244-b9ea-0c6ca18baf2f None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:41:10.885027 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:41:10.905183 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7d04da-e4c4-4bc9-9b9c-b13d4f5c61c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:41:10.906023 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7d04da-e4c4-4bc9-9b9c-b13d4f5c61c9 None admin] REQUEST_METHOD: `PUT` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:41:10.906371 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7d04da-e4c4-4bc9-9b9c-b13d4f5c61c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:41:10.906713 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7d04da-e4c4-4bc9-9b9c-b13d4f5c61c9 None admin] PATH_INFO: `/v3/projects/5324c5a353924497b2d5372a26cbe6fc/users/0b68433814c44561931bfd7051cd6b7d/roles/e92664bc677b40769b7a05d102541bf0` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:41:10.909117 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7d04da-e4c4-4bc9-9b9c-b13d4f5c61c9 None admin] RBAC: Authorizing `identity:create_grant(project_id=5324c5a353924497b2d5372a26cbe6fc, user_id=0b68433814c44561931bfd7051cd6b7d, role_id=e92664bc677b40769b7a05d102541bf0)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:41:10.910711 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7d04da-e4c4-4bc9-9b9c-b13d4f5c61c9 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:41:10.928203 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 62/133] 10.222.0.57 () {58 vars in 1439 bytes} [Fri Sep 16 07:41:10 2022] PUT /identity/v3/projects/5324c5a353924497b2d5372a26cbe6fc/users/0b68433814c44561931bfd7051cd6b7d/roles/e92664bc677b40769b7a05d102541bf0 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 07:41:10.929185 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7d04da-e4c4-4bc9-9b9c-b13d4f5c61c9 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:41:11.002468 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5b8f71-8440-4244-b9ea-0c6ca18baf2f None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:41:11.067136 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7d04da-e4c4-4bc9-9b9c-b13d4f5c61c9 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:41:11.101253 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdbfa28-91be-4a23-8694-92f9fdfac053 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:41:11.102246 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdbfa28-91be-4a23-8694-92f9fdfac053 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:41:11.102755 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdbfa28-91be-4a23-8694-92f9fdfac053 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:41:11.103226 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdbfa28-91be-4a23-8694-92f9fdfac053 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:41:11.104169 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cdbfa28-91be-4a23-8694-92f9fdfac053 None admin] RBAC: Adding query filter params (role.id=d4544aeb3a2940b08df3279eab1f529b, scope.project.id=5324c5a353924497b2d5372a26cbe6fc, user.id=3a2f1a60395144368e2832ffe4c8afe2) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:41:11.104676 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cdbfa28-91be-4a23-8694-92f9fdfac053 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:41:11.106919 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cdbfa28-91be-4a23-8694-92f9fdfac053 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:41:11.118527 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb93ce59-a70b-4a43-a958-d70b21c17d7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:41:11.119221 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb93ce59-a70b-4a43-a958-d70b21c17d7f None admin] REQUEST_METHOD: `PUT` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:41:11.119501 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb93ce59-a70b-4a43-a958-d70b21c17d7f None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:41:11.119776 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb93ce59-a70b-4a43-a958-d70b21c17d7f None admin] PATH_INFO: `/v3/projects/a64a86f16350436bbcdb4f188dec9608/users/0b68433814c44561931bfd7051cd6b7d/roles/4818d38cf2564825b312e66c9eb24762` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:41:11.122275 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 72/134] 10.222.0.57 () {56 vars in 1374 bytes} [Fri Sep 16 07:41:10 2022] GET /identity/v3/role_assignments?user.id=3a2f1a60395144368e2832ffe4c8afe2&scope.project.id=5324c5a353924497b2d5372a26cbe6fc&role.id=d4544aeb3a2940b08df3279eab1f529b => generated 259 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:41:11.123134 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdbfa28-91be-4a23-8694-92f9fdfac053 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:41:11.124777 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb93ce59-a70b-4a43-a958-d70b21c17d7f None admin] RBAC: Authorizing `identity:create_grant(project_id=a64a86f16350436bbcdb4f188dec9608, user_id=0b68433814c44561931bfd7051cd6b7d, role_id=4818d38cf2564825b312e66c9eb24762)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:41:11.127422 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb93ce59-a70b-4a43-a958-d70b21c17d7f None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:41:11.151371 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 63/135] 10.222.0.57 () {58 vars in 1439 bytes} [Fri Sep 16 07:41:10 2022] PUT /identity/v3/projects/a64a86f16350436bbcdb4f188dec9608/users/0b68433814c44561931bfd7051cd6b7d/roles/4818d38cf2564825b312e66c9eb24762 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 07:41:11.225938 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:41:11.297103 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdbfa28-91be-4a23-8694-92f9fdfac053 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:41:11.353949 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1ec60f-d897-4486-af58-5b34fd169e87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:41:11.354515 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1ec60f-d897-4486-af58-5b34fd169e87 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:41:11.354798 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1ec60f-d897-4486-af58-5b34fd169e87 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:41:11.355125 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1ec60f-d897-4486-af58-5b34fd169e87 None admin] PATH_INFO: `/v3/projects/5324c5a353924497b2d5372a26cbe6fc` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:41:11.356368 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1ec60f-d897-4486-af58-5b34fd169e87 None admin] RBAC: Authorizing `identity:get_project(project_id=5324c5a353924497b2d5372a26cbe6fc)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:41:11.357879 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1ec60f-d897-4486-af58-5b34fd169e87 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:41:11.359917 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 73/136] 10.222.0.57 () {56 vars in 1186 bytes} [Fri Sep 16 07:41:11 2022] GET /identity/v3/projects/5324c5a353924497b2d5372a26cbe6fc => generated 298 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:41:11.367014 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb93ce59-a70b-4a43-a958-d70b21c17d7f None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:41:11.426083 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:41:11.505240 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb93ce59-a70b-4a43-a958-d70b21c17d7f None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:41:11.541457 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4ca95d-273b-4d95-a29e-602e355f300e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:41:11.542202 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4ca95d-273b-4d95-a29e-602e355f300e None admin] REQUEST_METHOD: `PUT` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:41:11.542483 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4ca95d-273b-4d95-a29e-602e355f300e None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:41:11.542753 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4ca95d-273b-4d95-a29e-602e355f300e None admin] PATH_INFO: `/v3/projects/5324c5a353924497b2d5372a26cbe6fc/users/a76c683889e54d429dbaa09123371861/roles/567db03c91854ad9af1e9a87ec1bd275` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:41:11.544767 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4ca95d-273b-4d95-a29e-602e355f300e None admin] RBAC: Authorizing `identity:create_grant(project_id=5324c5a353924497b2d5372a26cbe6fc, user_id=a76c683889e54d429dbaa09123371861, role_id=567db03c91854ad9af1e9a87ec1bd275)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:41:11.546265 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4ca95d-273b-4d95-a29e-602e355f300e None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:41:11.560108 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 64/137] 10.222.0.57 () {58 vars in 1439 bytes} [Fri Sep 16 07:41:11 2022] PUT /identity/v3/projects/5324c5a353924497b2d5372a26cbe6fc/users/a76c683889e54d429dbaa09123371861/roles/567db03c91854ad9af1e9a87ec1bd275 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 07:41:12.188932 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d985410-f502-4ce9-90e5-7ec32ce86daf None None] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:41:12.189970 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d985410-f502-4ce9-90e5-7ec32ce86daf None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:41:12.190458 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d985410-f502-4ce9-90e5-7ec32ce86daf None None] PATH_INFO: `/` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:41:12.192013 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 74/138] 10.222.0.57 () {54 vars in 927 bytes} [Fri Sep 16 07:41:12 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 07:41:12.197426 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385eafe7-66f4-4910-97a7-7b614f592872 None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:41:12.197906 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385eafe7-66f4-4910-97a7-7b614f592872 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:41:12.197994 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385eafe7-66f4-4910-97a7-7b614f592872 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:41:12.226802 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-385eafe7-66f4-4910-97a7-7b614f592872 None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:41:12.228006 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-385eafe7-66f4-4910-97a7-7b614f592872 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:41:12.319955 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 65/139] 10.222.0.57 () {58 vars in 1024 bytes} [Fri Sep 16 07:41:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 07:41:12.863899 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d985410-f502-4ce9-90e5-7ec32ce86daf None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:41:12.935552 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb86966-5d07-45bc-b4f7-2664f714daf8 None None] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:41:12.936190 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb86966-5d07-45bc-b4f7-2664f714daf8 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:41:12.936658 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb86966-5d07-45bc-b4f7-2664f714daf8 None None] PATH_INFO: `/` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:41:12.938923 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 66/140] 10.222.0.57 () {54 vars in 927 bytes} [Fri Sep 16 07:41:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 07:41:12.946269 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396bdae6-9f27-444b-ae84-4a3267512e3c None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:41:12.946829 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396bdae6-9f27-444b-ae84-4a3267512e3c None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:41:12.947310 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396bdae6-9f27-444b-ae84-4a3267512e3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:41:12.982044 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-396bdae6-9f27-444b-ae84-4a3267512e3c None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:41:12.983228 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-396bdae6-9f27-444b-ae84-4a3267512e3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:41:12.993394 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d985410-f502-4ce9-90e5-7ec32ce86daf None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:41:13.021262 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:41:13.024202 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:41:13.062498 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e975e910-4003-4d3d-bdbd-149258ee7732 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:41:13.063673 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e975e910-4003-4d3d-bdbd-149258ee7732 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:41:13.063960 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e975e910-4003-4d3d-bdbd-149258ee7732 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:41:13.064238 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e975e910-4003-4d3d-bdbd-149258ee7732 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:41:13.095732 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e975e910-4003-4d3d-bdbd-149258ee7732 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 07:41:13.100680 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application [None req-e975e910-4003-4d3d-bdbd-149258ee7732 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 16 07:41:13.100680 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 07:41:13.100680 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 07:41:13.100680 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 07:41:13.100680 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 07:41:13.100680 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 07:41:13.100680 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 07:41:13.100680 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 07:41:13.100680 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 07:41:13.100680 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 07:41:13.100680 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 07:41:13.100680 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 07:41:13.100680 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 07:41:13.100680 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 07:41:13.100680 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 07:41:13.100680 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 07:41:13.101555 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 07:41:13.101555 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 07:41:13.101555 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 07:41:13.101555 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 07:41:13.101555 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 07:41:13.101555 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 07:41:13.101555 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 07:41:13.101555 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 07:41:13.101555 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 07:41:13.101555 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 07:41:13.101555 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 07:41:13.101555 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application with Lock( Sep 16 07:41:13.101555 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 07:41:13.101555 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._enter() Sep 16 07:41:13.101555 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 07:41:13.101555 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 07:41:13.102399 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 07:41:13.102399 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.creator() Sep 16 07:41:13.102399 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 07:41:13.102399 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application created_value = creator( Sep 16 07:41:13.102399 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 07:41:13.102399 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 07:41:13.102399 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 07:41:13.102399 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 07:41:13.102399 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 07:41:13.102399 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 07:41:13.102399 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 16 07:41:13.102399 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Sep 16 07:41:13.103446 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 75/141] 10.222.0.57 () {56 vars in 1099 bytes} [Fri Sep 16 07:41:12 2022] GET /identity/v3/roles/member => generated 84 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 07:41:13.113298 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e975e910-4003-4d3d-bdbd-149258ee7732 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:41:13.154683 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 67/142] 10.222.0.57 () {58 vars in 1024 bytes} [Fri Sep 16 07:41:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 16 07:41:13.249477 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e975e910-4003-4d3d-bdbd-149258ee7732 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:41:13.283788 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276d5450-75fe-4510-a77f-13e97e7f0039 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:41:13.284411 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276d5450-75fe-4510-a77f-13e97e7f0039 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:41:13.284691 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276d5450-75fe-4510-a77f-13e97e7f0039 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:41:13.284962 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276d5450-75fe-4510-a77f-13e97e7f0039 None admin] PATH_INFO: `/v3/roles` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:41:13.285619 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276d5450-75fe-4510-a77f-13e97e7f0039 None admin] RBAC: Adding query filter params (name=member) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:41:13.285948 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276d5450-75fe-4510-a77f-13e97e7f0039 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:41:13.287324 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276d5450-75fe-4510-a77f-13e97e7f0039 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:41:13.300882 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 76/143] 10.222.0.57 () {56 vars in 1101 bytes} [Fri Sep 16 07:41:13 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:41:13.306149 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396bdae6-9f27-444b-ae84-4a3267512e3c None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:41:13.439459 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396bdae6-9f27-444b-ae84-4a3267512e3c None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:41:13.483084 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b063383-13ba-462f-9762-9180945fe9fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:41:13.483720 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b063383-13ba-462f-9762-9180945fe9fd None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:41:13.484004 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b063383-13ba-462f-9762-9180945fe9fd None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:41:13.484286 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b063383-13ba-462f-9762-9180945fe9fd None admin] PATH_INFO: `/v3/users/0b68433814c44561931bfd7051cd6b7d` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:41:13.485464 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b063383-13ba-462f-9762-9180945fe9fd None admin] RBAC: Authorizing `identity:get_user(user_id=0b68433814c44561931bfd7051cd6b7d)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:41:13.486953 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b063383-13ba-462f-9762-9180945fe9fd None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:41:13.488534 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 68/144] 10.222.0.57 () {56 vars in 1177 bytes} [Fri Sep 16 07:41:13 2022] GET /identity/v3/users/0b68433814c44561931bfd7051cd6b7d => generated 275 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:41:13.494073 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276d5450-75fe-4510-a77f-13e97e7f0039 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:41:13.534520 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b063383-13ba-462f-9762-9180945fe9fd None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:41:13.566288 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:41:13.584212 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:41:13.716432 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b063383-13ba-462f-9762-9180945fe9fd None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:41:13.727033 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276d5450-75fe-4510-a77f-13e97e7f0039 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:41:13.807368 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ce84eb-00c7-4426-847b-747d11bb1fa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:41:13.808015 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ce84eb-00c7-4426-847b-747d11bb1fa9 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:41:13.808295 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ce84eb-00c7-4426-847b-747d11bb1fa9 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:41:13.808565 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ce84eb-00c7-4426-847b-747d11bb1fa9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:41:13.810451 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6357b666-15a7-4180-a8d2-8e9994390c42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:41:13.811077 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6357b666-15a7-4180-a8d2-8e9994390c42 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:41:13.811366 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6357b666-15a7-4180-a8d2-8e9994390c42 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:41:13.811643 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6357b666-15a7-4180-a8d2-8e9994390c42 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:41:13.814533 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ce84eb-00c7-4426-847b-747d11bb1fa9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:41:13.816013 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ce84eb-00c7-4426-847b-747d11bb1fa9 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:41:13.817795 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 69/145] 10.222.0.57 () {56 vars in 1108 bytes} [Fri Sep 16 07:41:13 2022] GET /identity/v3/domains/default => generated 199 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 07:41:13.824271 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ce84eb-00c7-4426-847b-747d11bb1fa9 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:41:13.905211 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6357b666-15a7-4180-a8d2-8e9994390c42 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:41:13.907261 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6357b666-15a7-4180-a8d2-8e9994390c42 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:41:13.951150 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:41:14.017354 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 77/146] 10.222.0.57 () {58 vars in 1282 bytes} [Fri Sep 16 07:41:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 523 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 16 07:41:14.024045 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6357b666-15a7-4180-a8d2-8e9994390c42 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:41:14.044752 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:41:14.064676 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ce84eb-00c7-4426-847b-747d11bb1fa9 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:41:14.127360 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc42d55-1157-4ae7-b4d3-c7b0077a4180 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:41:14.127975 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc42d55-1157-4ae7-b4d3-c7b0077a4180 None admin] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:41:14.128250 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc42d55-1157-4ae7-b4d3-c7b0077a4180 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:41:14.128518 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc42d55-1157-4ae7-b4d3-c7b0077a4180 None admin] PATH_INFO: `/v3/users` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:41:14.129173 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc42d55-1157-4ae7-b4d3-c7b0077a4180 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:41:14.130768 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc42d55-1157-4ae7-b4d3-c7b0077a4180 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:41:14.163959 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 70/147] 10.222.0.57 () {60 vars in 1132 bytes} [Fri Sep 16 07:41:13 2022] POST /identity/v3/users => generated 283 bytes in 339 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 16 07:41:14.207730 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6357b666-15a7-4180-a8d2-8e9994390c42 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:41:14.253910 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1e97c2-29f6-44b6-bbe1-0562a8b5f812 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:41:14.254545 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1e97c2-29f6-44b6-bbe1-0562a8b5f812 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:41:14.254814 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1e97c2-29f6-44b6-bbe1-0562a8b5f812 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:41:14.255087 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1e97c2-29f6-44b6-bbe1-0562a8b5f812 None admin] PATH_INFO: `/v3/projects/5324c5a353924497b2d5372a26cbe6fc` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:41:14.256213 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1e97c2-29f6-44b6-bbe1-0562a8b5f812 None admin] RBAC: Authorizing `identity:get_project(project_id=5324c5a353924497b2d5372a26cbe6fc)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:41:14.257652 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1e97c2-29f6-44b6-bbe1-0562a8b5f812 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:41:14.259552 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 78/148] 10.222.0.57 () {56 vars in 1186 bytes} [Fri Sep 16 07:41:14 2022] GET /identity/v3/projects/5324c5a353924497b2d5372a26cbe6fc => generated 298 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 07:41:14.265894 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc42d55-1157-4ae7-b4d3-c7b0077a4180 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:41:14.385274 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc42d55-1157-4ae7-b4d3-c7b0077a4180 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:41:14.432334 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c5fb77-93d2-44e7-8345-ddfe1a728f33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:41:14.432953 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c5fb77-93d2-44e7-8345-ddfe1a728f33 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:41:14.433227 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c5fb77-93d2-44e7-8345-ddfe1a728f33 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:41:14.433492 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c5fb77-93d2-44e7-8345-ddfe1a728f33 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:41:14.434316 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c5fb77-93d2-44e7-8345-ddfe1a728f33 None admin] RBAC: Adding query filter params (role.id=4818d38cf2564825b312e66c9eb24762, scope.project.id=5324c5a353924497b2d5372a26cbe6fc, user.id=0b68433814c44561931bfd7051cd6b7d) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:41:14.434672 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c5fb77-93d2-44e7-8345-ddfe1a728f33 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:41:14.436127 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c5fb77-93d2-44e7-8345-ddfe1a728f33 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:41:14.444206 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 71/149] 10.222.0.57 () {56 vars in 1374 bytes} [Fri Sep 16 07:41:14 2022] GET /identity/v3/role_assignments?user.id=0b68433814c44561931bfd7051cd6b7d&scope.project.id=5324c5a353924497b2d5372a26cbe6fc&role.id=4818d38cf2564825b312e66c9eb24762 => generated 608 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:41:14.553452 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c6b957-60f8-4202-9d67-6818db713b57 None None] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:41:14.553828 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c6b957-60f8-4202-9d67-6818db713b57 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:41:14.554082 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c6b957-60f8-4202-9d67-6818db713b57 None None] PATH_INFO: `/` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:41:14.555766 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 79/150] 10.222.0.57 () {54 vars in 927 bytes} [Fri Sep 16 07:41:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 07:41:14.561998 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13989b38-f312-4d47-8bda-4e10edc72600 None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:41:14.562346 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13989b38-f312-4d47-8bda-4e10edc72600 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:41:14.562627 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13989b38-f312-4d47-8bda-4e10edc72600 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:41:14.582815 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-13989b38-f312-4d47-8bda-4e10edc72600 None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:41:14.584027 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-13989b38-f312-4d47-8bda-4e10edc72600 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:41:14.592744 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:41:14.647718 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e08145-963f-4c87-a869-b9e995176486 None None] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:41:14.648009 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e08145-963f-4c87-a869-b9e995176486 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:41:14.648171 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e08145-963f-4c87-a869-b9e995176486 None None] PATH_INFO: `/` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:41:14.649806 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 80/151] 10.222.0.57 () {54 vars in 927 bytes} [Fri Sep 16 07:41:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 07:41:14.668263 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d57ad82-f6f7-42bd-8e16-8f18900ad4e9 None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:41:14.668564 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d57ad82-f6f7-42bd-8e16-8f18900ad4e9 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:41:14.668802 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d57ad82-f6f7-42bd-8e16-8f18900ad4e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:41:14.698947 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-7d57ad82-f6f7-42bd-8e16-8f18900ad4e9 None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:41:14.700183 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-7d57ad82-f6f7-42bd-8e16-8f18900ad4e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:41:14.708999 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 72/152] 10.222.0.57 () {58 vars in 1024 bytes} [Fri Sep 16 07:41:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 16 07:41:14.709385 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:41:14.746108 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a71af29-32f0-49d0-bd34-bfd39e922581 None None] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:41:14.746737 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a71af29-32f0-49d0-bd34-bfd39e922581 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:41:14.747208 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a71af29-32f0-49d0-bd34-bfd39e922581 None None] PATH_INFO: `/` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:41:14.749433 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 73/153] 10.222.0.57 () {54 vars in 927 bytes} [Fri Sep 16 07:41:14 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 16 07:41:14.756363 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c2b187-d41a-49a8-892b-4e9de660e578 None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:41:14.757017 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c2b187-d41a-49a8-892b-4e9de660e578 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:41:14.757644 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c2b187-d41a-49a8-892b-4e9de660e578 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:41:14.782818 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-63c2b187-d41a-49a8-892b-4e9de660e578 None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:41:14.784650 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-63c2b187-d41a-49a8-892b-4e9de660e578 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:41:14.811903 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 81/154] 10.222.0.57 () {58 vars in 1024 bytes} [Fri Sep 16 07:41:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 07:41:14.874219 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 74/155] 10.222.0.57 () {58 vars in 1024 bytes} [Fri Sep 16 07:41:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 07:41:15.045844 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1befdfb3-d32c-43f4-8905-1f98751a8923 None None] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:41:15.046193 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1befdfb3-d32c-43f4-8905-1f98751a8923 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:41:15.046362 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1befdfb3-d32c-43f4-8905-1f98751a8923 None None] PATH_INFO: `/` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:41:15.048379 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 82/156] 10.222.0.57 () {54 vars in 927 bytes} [Fri Sep 16 07:41:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 07:41:15.053763 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40367c6-e61d-4cc7-b49c-88db329aa910 None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:41:15.054319 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40367c6-e61d-4cc7-b49c-88db329aa910 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:41:15.054797 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40367c6-e61d-4cc7-b49c-88db329aa910 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:41:15.069686 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1befdfb3-d32c-43f4-8905-1f98751a8923 None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:41:15.078324 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-a40367c6-e61d-4cc7-b49c-88db329aa910 None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:41:15.080081 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-a40367c6-e61d-4cc7-b49c-88db329aa910 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:41:15.182817 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 75/157] 10.222.0.57 () {58 vars in 1024 bytes} [Fri Sep 16 07:41:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 07:41:15.184443 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40367c6-e61d-4cc7-b49c-88db329aa910 None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:41:15.187160 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:41:15.242679 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1befdfb3-d32c-43f4-8905-1f98751a8923 None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:41:15.281187 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ff5a5f-640e-4b89-8623-fae93272adc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:41:15.282653 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ff5a5f-640e-4b89-8623-fae93272adc9 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:41:15.283078 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ff5a5f-640e-4b89-8623-fae93272adc9 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:41:15.283507 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ff5a5f-640e-4b89-8623-fae93272adc9 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:41:15.292632 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:41:15.297997 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ff5a5f-640e-4b89-8623-fae93272adc9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 07:41:15.303312 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application [None req-e7ff5a5f-640e-4b89-8623-fae93272adc9 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 16 07:41:15.303312 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 07:41:15.303312 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 07:41:15.303312 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 07:41:15.303312 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 07:41:15.303312 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 07:41:15.303312 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 07:41:15.303312 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 07:41:15.303312 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 07:41:15.303312 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 07:41:15.303312 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 07:41:15.303312 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 07:41:15.303312 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 07:41:15.303312 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 07:41:15.303312 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 07:41:15.303312 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 07:41:15.304224 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 07:41:15.304224 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 07:41:15.304224 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 07:41:15.304224 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 07:41:15.304224 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 07:41:15.304224 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 07:41:15.304224 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 07:41:15.304224 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 07:41:15.304224 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 07:41:15.304224 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 07:41:15.304224 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 07:41:15.304224 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application with Lock( Sep 16 07:41:15.304224 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 07:41:15.304224 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._enter() Sep 16 07:41:15.304224 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 07:41:15.304224 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 07:41:15.304992 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 07:41:15.304992 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.creator() Sep 16 07:41:15.304992 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 07:41:15.304992 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application created_value = creator( Sep 16 07:41:15.304992 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 07:41:15.304992 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 07:41:15.304992 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 07:41:15.304992 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 07:41:15.304992 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 07:41:15.304992 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 07:41:15.304992 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 16 07:41:15.304992 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Sep 16 07:41:15.307270 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 83/158] 10.222.0.57 () {56 vars in 1114 bytes} [Fri Sep 16 07:41:15 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 16 07:41:15.308218 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ff5a5f-640e-4b89-8623-fae93272adc9 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:41:15.332673 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40367c6-e61d-4cc7-b49c-88db329aa910 None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:41:15.387670 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e385ac-9728-4a9e-8cf2-74a44e2ac76c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:41:15.388327 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e385ac-9728-4a9e-8cf2-74a44e2ac76c None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:41:15.389228 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e385ac-9728-4a9e-8cf2-74a44e2ac76c None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:41:15.390286 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e385ac-9728-4a9e-8cf2-74a44e2ac76c None admin] PATH_INFO: `/v3/roles/member` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:41:15.406151 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e385ac-9728-4a9e-8cf2-74a44e2ac76c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 07:41:15.413631 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application [None req-81e385ac-9728-4a9e-8cf2-74a44e2ac76c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 16 07:41:15.413631 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 07:41:15.413631 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 07:41:15.413631 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 07:41:15.413631 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 07:41:15.413631 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 07:41:15.413631 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 07:41:15.413631 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 07:41:15.413631 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 07:41:15.413631 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 07:41:15.413631 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 07:41:15.413631 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 07:41:15.413631 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 07:41:15.413631 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 07:41:15.413631 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 07:41:15.413631 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 07:41:15.414792 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 07:41:15.414792 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 07:41:15.414792 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 07:41:15.414792 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 07:41:15.414792 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 07:41:15.414792 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 07:41:15.414792 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 07:41:15.414792 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 07:41:15.414792 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 07:41:15.414792 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 07:41:15.414792 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 07:41:15.414792 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application with Lock( Sep 16 07:41:15.414792 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 07:41:15.414792 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._enter() Sep 16 07:41:15.414792 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 07:41:15.414792 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 07:41:15.415795 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 07:41:15.415795 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.creator() Sep 16 07:41:15.415795 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 07:41:15.415795 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application created_value = creator( Sep 16 07:41:15.415795 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 07:41:15.415795 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 07:41:15.415795 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 07:41:15.415795 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 07:41:15.415795 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 07:41:15.415795 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 07:41:15.415795 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 16 07:41:15.415795 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Sep 16 07:41:15.418387 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 76/159] 10.222.0.57 () {56 vars in 1099 bytes} [Fri Sep 16 07:41:15 2022] GET /identity/v3/roles/member => generated 84 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 16 07:41:15.419572 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e385ac-9728-4a9e-8cf2-74a44e2ac76c None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:41:15.451822 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ff5a5f-640e-4b89-8623-fae93272adc9 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:41:15.502838 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ff0696-3255-4a14-9ac7-4887212d03e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:41:15.503617 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ff0696-3255-4a14-9ac7-4887212d03e2 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:41:15.504110 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ff0696-3255-4a14-9ac7-4887212d03e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:41:15.504579 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ff0696-3255-4a14-9ac7-4887212d03e2 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:41:15.511385 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:41:15.519518 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ff0696-3255-4a14-9ac7-4887212d03e2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 07:41:15.526221 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application [None req-61ff0696-3255-4a14-9ac7-4887212d03e2 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 16 07:41:15.526221 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 07:41:15.526221 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 07:41:15.526221 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 07:41:15.526221 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 07:41:15.526221 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 07:41:15.526221 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 07:41:15.526221 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 07:41:15.526221 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 07:41:15.526221 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 07:41:15.526221 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 07:41:15.526221 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 07:41:15.526221 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 07:41:15.526221 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 07:41:15.526221 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 07:41:15.526221 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 07:41:15.527304 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 07:41:15.527304 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 07:41:15.527304 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 07:41:15.527304 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 07:41:15.527304 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 07:41:15.527304 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 07:41:15.527304 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 07:41:15.527304 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 07:41:15.527304 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 07:41:15.527304 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 07:41:15.527304 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 07:41:15.527304 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application with Lock( Sep 16 07:41:15.527304 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 07:41:15.527304 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._enter() Sep 16 07:41:15.527304 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 07:41:15.527304 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 07:41:15.528321 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 07:41:15.528321 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.creator() Sep 16 07:41:15.528321 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 07:41:15.528321 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application created_value = creator( Sep 16 07:41:15.528321 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 07:41:15.528321 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 07:41:15.528321 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 07:41:15.528321 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 07:41:15.528321 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 07:41:15.528321 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 07:41:15.528321 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 16 07:41:15.528321 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Sep 16 07:41:15.530333 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 84/160] 10.222.0.57 () {56 vars in 1099 bytes} [Fri Sep 16 07:41:15 2022] GET /identity/v3/roles/reader => generated 84 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 07:41:15.531282 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ff0696-3255-4a14-9ac7-4887212d03e2 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:41:15.568553 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e385ac-9728-4a9e-8cf2-74a44e2ac76c None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:41:15.615224 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:41:15.618754 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac49ff48-b3bb-4eab-a288-d8d1e7ebfea0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:41:15.618911 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac49ff48-b3bb-4eab-a288-d8d1e7ebfea0 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:41:15.619509 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac49ff48-b3bb-4eab-a288-d8d1e7ebfea0 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:41:15.619687 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac49ff48-b3bb-4eab-a288-d8d1e7ebfea0 None admin] PATH_INFO: `/v3/roles` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:41:15.621854 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac49ff48-b3bb-4eab-a288-d8d1e7ebfea0 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:41:15.622187 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac49ff48-b3bb-4eab-a288-d8d1e7ebfea0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:41:15.623604 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac49ff48-b3bb-4eab-a288-d8d1e7ebfea0 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:41:15.635391 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 77/161] 10.222.0.57 () {56 vars in 1111 bytes} [Fri Sep 16 07:41:15 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:41:15.641754 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac49ff48-b3bb-4eab-a288-d8d1e7ebfea0 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:41:15.672736 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ff0696-3255-4a14-9ac7-4887212d03e2 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:41:15.714370 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8e9b7e-4542-418e-bd32-1d7e8981136c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:41:15.715247 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8e9b7e-4542-418e-bd32-1d7e8981136c None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:41:15.715728 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8e9b7e-4542-418e-bd32-1d7e8981136c None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:41:15.716156 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8e9b7e-4542-418e-bd32-1d7e8981136c None admin] PATH_INFO: `/v3/roles` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:41:15.717176 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8e9b7e-4542-418e-bd32-1d7e8981136c None admin] RBAC: Adding query filter params (name=member) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:41:15.717754 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8e9b7e-4542-418e-bd32-1d7e8981136c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:41:15.719890 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8e9b7e-4542-418e-bd32-1d7e8981136c None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:41:15.729697 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 85/162] 10.222.0.57 () {56 vars in 1101 bytes} [Fri Sep 16 07:41:15 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:41:15.730985 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8e9b7e-4542-418e-bd32-1d7e8981136c None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:41:15.780749 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac49ff48-b3bb-4eab-a288-d8d1e7ebfea0 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:41:15.834878 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:41:15.848053 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8e9b7e-4542-418e-bd32-1d7e8981136c None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:41:15.870455 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3186ca-166d-4e64-8fca-143eb81c6eb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:41:15.870908 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:41:15.871109 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3186ca-166d-4e64-8fca-143eb81c6eb4 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:41:15.871391 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3186ca-166d-4e64-8fca-143eb81c6eb4 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:41:15.871700 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3186ca-166d-4e64-8fca-143eb81c6eb4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:41:15.888896 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b725c7fc-bf61-4c15-9547-45e49c90c485 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:41:15.889917 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b725c7fc-bf61-4c15-9547-45e49c90c485 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:41:15.890375 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b725c7fc-bf61-4c15-9547-45e49c90c485 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:41:15.890857 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b725c7fc-bf61-4c15-9547-45e49c90c485 None admin] PATH_INFO: `/v3/roles` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:41:15.892675 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b725c7fc-bf61-4c15-9547-45e49c90c485 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:41:15.893181 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b725c7fc-bf61-4c15-9547-45e49c90c485 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:41:15.894745 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b725c7fc-bf61-4c15-9547-45e49c90c485 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:41:15.898364 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3186ca-166d-4e64-8fca-143eb81c6eb4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 07:41:15.903819 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application [None req-6e3186ca-166d-4e64-8fca-143eb81c6eb4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 16 07:41:15.903819 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 07:41:15.903819 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 07:41:15.903819 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 07:41:15.903819 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 07:41:15.903819 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 07:41:15.903819 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 07:41:15.903819 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 07:41:15.903819 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 07:41:15.903819 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 07:41:15.903819 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 07:41:15.903819 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 07:41:15.903819 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 07:41:15.903819 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 07:41:15.903819 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 07:41:15.903819 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 07:41:15.905061 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 07:41:15.905061 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 07:41:15.905061 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 07:41:15.905061 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 07:41:15.905061 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 07:41:15.905061 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 07:41:15.905061 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 07:41:15.905061 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 07:41:15.905061 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 07:41:15.905061 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 07:41:15.905061 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 07:41:15.905061 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application with Lock( Sep 16 07:41:15.905061 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 07:41:15.905061 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._enter() Sep 16 07:41:15.905061 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 07:41:15.905061 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 07:41:15.906100 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 07:41:15.906100 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.creator() Sep 16 07:41:15.906100 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 07:41:15.906100 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application created_value = creator( Sep 16 07:41:15.906100 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 07:41:15.906100 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 07:41:15.906100 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 07:41:15.906100 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 07:41:15.906100 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 07:41:15.906100 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 07:41:15.906100 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 16 07:41:15.906100 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Sep 16 07:41:15.908660 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 86/163] 10.222.0.57 () {56 vars in 1101 bytes} [Fri Sep 16 07:41:15 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:41:15.909816 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b725c7fc-bf61-4c15-9547-45e49c90c485 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:41:15.913068 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 78/164] 10.222.0.57 () {56 vars in 1096 bytes} [Fri Sep 16 07:41:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 07:41:15.914878 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3186ca-166d-4e64-8fca-143eb81c6eb4 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:41:16.025446 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b725c7fc-bf61-4c15-9547-45e49c90c485 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:41:16.073783 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6b4220-51e7-45d2-a4e3-cd7a43e5598c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:41:16.074756 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6b4220-51e7-45d2-a4e3-cd7a43e5598c None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:41:16.075231 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6b4220-51e7-45d2-a4e3-cd7a43e5598c None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:41:16.075683 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6b4220-51e7-45d2-a4e3-cd7a43e5598c None admin] PATH_INFO: `/v3/users/0b68433814c44561931bfd7051cd6b7d` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:41:16.077274 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6b4220-51e7-45d2-a4e3-cd7a43e5598c None admin] RBAC: Authorizing `identity:get_user(user_id=0b68433814c44561931bfd7051cd6b7d)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:41:16.080072 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6b4220-51e7-45d2-a4e3-cd7a43e5598c None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:41:16.086192 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 87/165] 10.222.0.57 () {56 vars in 1177 bytes} [Fri Sep 16 07:41:15 2022] GET /identity/v3/users/0b68433814c44561931bfd7051cd6b7d => generated 275 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:41:16.089347 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6b4220-51e7-45d2-a4e3-cd7a43e5598c None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:41:16.120864 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3186ca-166d-4e64-8fca-143eb81c6eb4 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:41:16.150256 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:41:16.205850 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58550b6e-5bef-4723-a203-18773c1c10ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:41:16.206496 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58550b6e-5bef-4723-a203-18773c1c10ac None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:41:16.206775 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58550b6e-5bef-4723-a203-18773c1c10ac None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:41:16.207045 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58550b6e-5bef-4723-a203-18773c1c10ac None admin] PATH_INFO: `/v3/users/0b68433814c44561931bfd7051cd6b7d` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:41:16.207487 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6b4220-51e7-45d2-a4e3-cd7a43e5598c None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:41:16.208787 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58550b6e-5bef-4723-a203-18773c1c10ac None admin] RBAC: Authorizing `identity:get_user(user_id=0b68433814c44561931bfd7051cd6b7d)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:41:16.210914 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58550b6e-5bef-4723-a203-18773c1c10ac None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:41:16.211928 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 79/166] 10.222.0.57 () {56 vars in 1177 bytes} [Fri Sep 16 07:41:15 2022] GET /identity/v3/users/0b68433814c44561931bfd7051cd6b7d => generated 275 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:41:16.212686 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58550b6e-5bef-4723-a203-18773c1c10ac None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:41:16.244863 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c2f77e-116e-421c-b4cc-8107ad2bb770 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:41:16.245964 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c2f77e-116e-421c-b4cc-8107ad2bb770 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:41:16.246428 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c2f77e-116e-421c-b4cc-8107ad2bb770 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:41:16.246877 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c2f77e-116e-421c-b4cc-8107ad2bb770 None admin] PATH_INFO: `/v3/users/3a2f1a60395144368e2832ffe4c8afe2` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:41:16.248264 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c2f77e-116e-421c-b4cc-8107ad2bb770 None admin] RBAC: Authorizing `identity:get_user(user_id=3a2f1a60395144368e2832ffe4c8afe2)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:41:16.249984 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c2f77e-116e-421c-b4cc-8107ad2bb770 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:41:16.252758 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 88/167] 10.222.0.57 () {56 vars in 1177 bytes} [Fri Sep 16 07:41:16 2022] GET /identity/v3/users/3a2f1a60395144368e2832ffe4c8afe2 => generated 289 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:41:16.253952 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c2f77e-116e-421c-b4cc-8107ad2bb770 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:41:16.312452 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:41:16.388408 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c2f77e-116e-421c-b4cc-8107ad2bb770 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:41:16.418238 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:41:16.430163 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbb2959-7e79-4178-aa2d-261a096a66a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:41:16.431163 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbb2959-7e79-4178-aa2d-261a096a66a4 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:41:16.431629 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbb2959-7e79-4178-aa2d-261a096a66a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:41:16.432081 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbb2959-7e79-4178-aa2d-261a096a66a4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:41:16.439864 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58550b6e-5bef-4723-a203-18773c1c10ac None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:41:16.506792 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffbb2959-7e79-4178-aa2d-261a096a66a4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:41:16.508942 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffbb2959-7e79-4178-aa2d-261a096a66a4 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:41:16.518561 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e24782-d41d-4849-9e5e-9e88a5a89fc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:41:16.519213 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e24782-d41d-4849-9e5e-9e88a5a89fc5 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:41:16.519499 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e24782-d41d-4849-9e5e-9e88a5a89fc5 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:41:16.519773 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e24782-d41d-4849-9e5e-9e88a5a89fc5 None admin] PATH_INFO: `/v3/roles` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:41:16.520459 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e24782-d41d-4849-9e5e-9e88a5a89fc5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:41:16.520764 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e24782-d41d-4849-9e5e-9e88a5a89fc5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:41:16.522441 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e24782-d41d-4849-9e5e-9e88a5a89fc5 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:41:16.545554 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 80/168] 10.222.0.57 () {56 vars in 1099 bytes} [Fri Sep 16 07:41:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 333 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:41:16.546092 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e24782-d41d-4849-9e5e-9e88a5a89fc5 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:41:16.625244 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 89/169] 10.222.0.57 () {58 vars in 1282 bytes} [Fri Sep 16 07:41:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 16 07:41:16.630875 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbb2959-7e79-4178-aa2d-261a096a66a4 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:41:16.662190 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:41:16.739218 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbb2959-7e79-4178-aa2d-261a096a66a4 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:41:16.774636 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de84fee-bc4b-4354-82de-affbf59c93e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:41:16.775569 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de84fee-bc4b-4354-82de-affbf59c93e5 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:41:16.776071 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de84fee-bc4b-4354-82de-affbf59c93e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:41:16.776526 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de84fee-bc4b-4354-82de-affbf59c93e5 None admin] PATH_INFO: `/v3/projects/5324c5a353924497b2d5372a26cbe6fc` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:41:16.777893 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de84fee-bc4b-4354-82de-affbf59c93e5 None admin] RBAC: Authorizing `identity:get_project(project_id=5324c5a353924497b2d5372a26cbe6fc)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:41:16.779596 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de84fee-bc4b-4354-82de-affbf59c93e5 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:41:16.781408 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 90/170] 10.222.0.57 () {56 vars in 1186 bytes} [Fri Sep 16 07:41:16 2022] GET /identity/v3/projects/5324c5a353924497b2d5372a26cbe6fc => generated 298 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:41:16.783546 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de84fee-bc4b-4354-82de-affbf59c93e5 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:41:16.877485 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e24782-d41d-4849-9e5e-9e88a5a89fc5 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:41:16.894139 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:41:16.901821 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:41:16.923876 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704a791c-e0e2-4a13-9e67-fb5ccf20be4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:41:16.924408 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704a791c-e0e2-4a13-9e67-fb5ccf20be4b None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:41:16.924682 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704a791c-e0e2-4a13-9e67-fb5ccf20be4b None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:41:16.924946 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704a791c-e0e2-4a13-9e67-fb5ccf20be4b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:41:16.930214 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de84fee-bc4b-4354-82de-affbf59c93e5 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:41:16.996982 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4be5a6-3f95-4b91-b111-e331e6499134 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:41:16.997636 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4be5a6-3f95-4b91-b111-e331e6499134 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:41:16.997937 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4be5a6-3f95-4b91-b111-e331e6499134 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:41:16.998261 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4be5a6-3f95-4b91-b111-e331e6499134 None admin] PATH_INFO: `/v3/users/a76c683889e54d429dbaa09123371861` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:41:16.999477 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4be5a6-3f95-4b91-b111-e331e6499134 None admin] RBAC: Authorizing `identity:get_user(user_id=a76c683889e54d429dbaa09123371861)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:41:17.001753 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4be5a6-3f95-4b91-b111-e331e6499134 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:41:17.010118 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 91/171] 10.222.0.57 () {56 vars in 1177 bytes} [Fri Sep 16 07:41:16 2022] GET /identity/v3/users/a76c683889e54d429dbaa09123371861 => generated 247 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:41:17.011078 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4be5a6-3f95-4b91-b111-e331e6499134 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:41:17.060599 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704a791c-e0e2-4a13-9e67-fb5ccf20be4b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:41:17.063335 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704a791c-e0e2-4a13-9e67-fb5ccf20be4b None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:41:17.179496 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 81/172] 10.222.0.57 () {58 vars in 1282 bytes} [Fri Sep 16 07:41:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 633 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 16 07:41:17.180127 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704a791c-e0e2-4a13-9e67-fb5ccf20be4b None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:41:17.198130 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:41:17.212613 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4be5a6-3f95-4b91-b111-e331e6499134 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:41:17.283377 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c2b08d-f302-45a5-a18e-f1ba3f46b706 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:41:17.283996 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704a791c-e0e2-4a13-9e67-fb5ccf20be4b None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:41:17.284127 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c2b08d-f302-45a5-a18e-f1ba3f46b706 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:41:17.284293 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c2b08d-f302-45a5-a18e-f1ba3f46b706 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:41:17.284570 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c2b08d-f302-45a5-a18e-f1ba3f46b706 None admin] PATH_INFO: `/v3/projects/5324c5a353924497b2d5372a26cbe6fc` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:41:17.290416 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c2b08d-f302-45a5-a18e-f1ba3f46b706 None admin] RBAC: Authorizing `identity:get_project(project_id=5324c5a353924497b2d5372a26cbe6fc)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:41:17.291873 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c2b08d-f302-45a5-a18e-f1ba3f46b706 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:41:17.293521 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 92/173] 10.222.0.57 () {56 vars in 1186 bytes} [Fri Sep 16 07:41:17 2022] GET /identity/v3/projects/5324c5a353924497b2d5372a26cbe6fc => generated 298 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:41:17.294340 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c2b08d-f302-45a5-a18e-f1ba3f46b706 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:41:17.320352 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee40595-6db3-4fca-a15b-69692aa43016 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:41:17.321057 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee40595-6db3-4fca-a15b-69692aa43016 None admin] REQUEST_METHOD: `PUT` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:41:17.321330 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee40595-6db3-4fca-a15b-69692aa43016 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:41:17.321594 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee40595-6db3-4fca-a15b-69692aa43016 None admin] PATH_INFO: `/v3/projects/5324c5a353924497b2d5372a26cbe6fc/users/3a2f1a60395144368e2832ffe4c8afe2/roles/d4544aeb3a2940b08df3279eab1f529b` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:41:17.323595 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee40595-6db3-4fca-a15b-69692aa43016 None admin] RBAC: Authorizing `identity:create_grant(project_id=5324c5a353924497b2d5372a26cbe6fc, user_id=3a2f1a60395144368e2832ffe4c8afe2, role_id=d4544aeb3a2940b08df3279eab1f529b)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:41:17.325039 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee40595-6db3-4fca-a15b-69692aa43016 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:41:17.338470 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:41:17.351594 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 82/174] 10.222.0.57 () {58 vars in 1439 bytes} [Fri Sep 16 07:41:17 2022] PUT /identity/v3/projects/5324c5a353924497b2d5372a26cbe6fc/users/3a2f1a60395144368e2832ffe4c8afe2/roles/d4544aeb3a2940b08df3279eab1f529b => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 07:41:17.352499 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee40595-6db3-4fca-a15b-69692aa43016 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:41:17.424939 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c2b08d-f302-45a5-a18e-f1ba3f46b706 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:41:17.464262 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8099864-178e-40ae-b97a-8720b0695ae2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:41:17.464887 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8099864-178e-40ae-b97a-8720b0695ae2 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:41:17.465240 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8099864-178e-40ae-b97a-8720b0695ae2 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:41:17.465580 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8099864-178e-40ae-b97a-8720b0695ae2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:41:17.510085 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:41:17.543690 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8099864-178e-40ae-b97a-8720b0695ae2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:41:17.545277 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8099864-178e-40ae-b97a-8720b0695ae2 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:41:17.566477 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee40595-6db3-4fca-a15b-69692aa43016 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:41:17.574430 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:41:17.628345 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9b9e90-83c7-411b-9422-04c74436ad47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:41:17.629891 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9b9e90-83c7-411b-9422-04c74436ad47 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:41:17.630319 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9b9e90-83c7-411b-9422-04c74436ad47 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:41:17.630731 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9b9e90-83c7-411b-9422-04c74436ad47 None admin] PATH_INFO: `/v3/projects/a64a86f16350436bbcdb4f188dec9608` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:41:17.632596 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9b9e90-83c7-411b-9422-04c74436ad47 None admin] RBAC: Authorizing `identity:get_project(project_id=a64a86f16350436bbcdb4f188dec9608)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:41:17.635201 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9b9e90-83c7-411b-9422-04c74436ad47 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:41:17.638278 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 83/175] 10.222.0.57 () {56 vars in 1186 bytes} [Fri Sep 16 07:41:17 2022] GET /identity/v3/projects/a64a86f16350436bbcdb4f188dec9608 => generated 312 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:41:17.639329 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9b9e90-83c7-411b-9422-04c74436ad47 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:41:17.665195 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 93/176] 10.222.0.57 () {58 vars in 1282 bytes} [Fri Sep 16 07:41:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 16 07:41:17.666917 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0a612b-d0e9-412f-bf5e-25aab042a4c9 None None] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:41:17.667346 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0a612b-d0e9-412f-bf5e-25aab042a4c9 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:41:17.667764 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0a612b-d0e9-412f-bf5e-25aab042a4c9 None None] PATH_INFO: `/` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:41:17.669501 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 94/177] 10.222.0.57 () {54 vars in 927 bytes} [Fri Sep 16 07:41:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 07:41:17.674741 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0a612b-d0e9-412f-bf5e-25aab042a4c9 None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:41:17.779223 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9b9e90-83c7-411b-9422-04c74436ad47 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:41:17.792856 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0a612b-d0e9-412f-bf5e-25aab042a4c9 None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:41:17.817205 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81478f72-a29e-4784-ad68-1ac10ac993ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:41:17.817913 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81478f72-a29e-4784-ad68-1ac10ac993ed None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:41:17.818237 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81478f72-a29e-4784-ad68-1ac10ac993ed None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:41:17.818466 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81478f72-a29e-4784-ad68-1ac10ac993ed None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:41:17.819195 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81478f72-a29e-4784-ad68-1ac10ac993ed None admin] RBAC: Adding query filter params (role.id=e92664bc677b40769b7a05d102541bf0, scope.project.id=5324c5a353924497b2d5372a26cbe6fc, user.id=0b68433814c44561931bfd7051cd6b7d) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:41:17.819501 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81478f72-a29e-4784-ad68-1ac10ac993ed None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:41:17.820396 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:41:17.821867 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81478f72-a29e-4784-ad68-1ac10ac993ed None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:41:17.828266 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 84/178] 10.222.0.57 () {56 vars in 1374 bytes} [Fri Sep 16 07:41:17 2022] GET /identity/v3/role_assignments?user.id=0b68433814c44561931bfd7051cd6b7d&scope.project.id=5324c5a353924497b2d5372a26cbe6fc&role.id=e92664bc677b40769b7a05d102541bf0 => generated 608 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:41:17.834690 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81478f72-a29e-4784-ad68-1ac10ac993ed None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:41:17.841012 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b69da0-f6a0-4da9-927f-012437afe6d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:41:17.841950 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b69da0-f6a0-4da9-927f-012437afe6d0 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:41:17.842373 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b69da0-f6a0-4da9-927f-012437afe6d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:41:17.842918 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b69da0-f6a0-4da9-927f-012437afe6d0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:41:17.843818 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b69da0-f6a0-4da9-927f-012437afe6d0 None admin] RBAC: Adding query filter params (role.id=4818d38cf2564825b312e66c9eb24762, scope.project.id=a64a86f16350436bbcdb4f188dec9608, user.id=0b68433814c44561931bfd7051cd6b7d) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:41:17.844317 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b69da0-f6a0-4da9-927f-012437afe6d0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:41:17.846002 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b69da0-f6a0-4da9-927f-012437afe6d0 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:41:17.850911 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:41:17.855500 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 95/179] 10.222.0.57 () {56 vars in 1374 bytes} [Fri Sep 16 07:41:17 2022] GET /identity/v3/role_assignments?user.id=0b68433814c44561931bfd7051cd6b7d&scope.project.id=a64a86f16350436bbcdb4f188dec9608&role.id=4818d38cf2564825b312e66c9eb24762 => generated 608 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:41:17.857119 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66297e8-7b19-4c73-97df-21e3e32faf9f None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:41:17.857552 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66297e8-7b19-4c73-97df-21e3e32faf9f None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:41:17.857996 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66297e8-7b19-4c73-97df-21e3e32faf9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:41:17.879046 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-f66297e8-7b19-4c73-97df-21e3e32faf9f None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:41:17.880602 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-f66297e8-7b19-4c73-97df-21e3e32faf9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:41:17.960173 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 96/180] 10.222.0.57 () {58 vars in 1024 bytes} [Fri Sep 16 07:41:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 07:41:18.027605 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81478f72-a29e-4784-ad68-1ac10ac993ed None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:41:18.089849 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6feade72-6e50-4e4a-a2aa-4f5cad80d30a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:41:18.089849 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6feade72-6e50-4e4a-a2aa-4f5cad80d30a None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:41:18.089849 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6feade72-6e50-4e4a-a2aa-4f5cad80d30a None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:41:18.089849 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6feade72-6e50-4e4a-a2aa-4f5cad80d30a None admin] PATH_INFO: `/v3/projects/5324c5a353924497b2d5372a26cbe6fc` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:41:18.090281 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6feade72-6e50-4e4a-a2aa-4f5cad80d30a None admin] RBAC: Authorizing `identity:get_project(project_id=5324c5a353924497b2d5372a26cbe6fc)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:41:18.090281 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6feade72-6e50-4e4a-a2aa-4f5cad80d30a None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:41:18.090850 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 85/181] 10.222.0.57 () {56 vars in 1186 bytes} [Fri Sep 16 07:41:17 2022] GET /identity/v3/projects/5324c5a353924497b2d5372a26cbe6fc => generated 298 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:41:18.097745 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66297e8-7b19-4c73-97df-21e3e32faf9f None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:41:18.263538 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66297e8-7b19-4c73-97df-21e3e32faf9f None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:41:18.286514 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:41:18.306691 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82be838f-2199-4bcf-b7bb-4219cd3a94fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:41:18.307299 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82be838f-2199-4bcf-b7bb-4219cd3a94fd None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:41:18.307573 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82be838f-2199-4bcf-b7bb-4219cd3a94fd None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:41:18.307847 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82be838f-2199-4bcf-b7bb-4219cd3a94fd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:41:18.308578 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82be838f-2199-4bcf-b7bb-4219cd3a94fd None admin] RBAC: Adding query filter params (role.id=567db03c91854ad9af1e9a87ec1bd275, scope.project.id=5324c5a353924497b2d5372a26cbe6fc, user.id=a76c683889e54d429dbaa09123371861) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:41:18.308881 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82be838f-2199-4bcf-b7bb-4219cd3a94fd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:41:18.310347 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82be838f-2199-4bcf-b7bb-4219cd3a94fd None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:41:18.316778 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 97/182] 10.222.0.57 () {56 vars in 1374 bytes} [Fri Sep 16 07:41:18 2022] GET /identity/v3/role_assignments?user.id=a76c683889e54d429dbaa09123371861&scope.project.id=5324c5a353924497b2d5372a26cbe6fc&role.id=567db03c91854ad9af1e9a87ec1bd275 => generated 608 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:41:18.318328 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a38611-62a8-47d6-8781-388085e121fb None None] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:41:18.318618 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a38611-62a8-47d6-8781-388085e121fb None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:41:18.318900 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a38611-62a8-47d6-8781-388085e121fb None None] PATH_INFO: `/` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:41:18.320383 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 86/183] 10.222.0.57 () {54 vars in 927 bytes} [Fri Sep 16 07:41:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 07:41:18.326559 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d052184c-345f-4fcd-91b7-45b0ceff1344 None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:41:18.326845 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d052184c-345f-4fcd-91b7-45b0ceff1344 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:41:18.327121 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d052184c-345f-4fcd-91b7-45b0ceff1344 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:41:18.347153 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-d052184c-345f-4fcd-91b7-45b0ceff1344 None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:41:18.348298 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-d052184c-345f-4fcd-91b7-45b0ceff1344 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:41:18.400030 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a38611-62a8-47d6-8781-388085e121fb None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:41:18.444786 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 98/184] 10.222.0.57 () {58 vars in 1024 bytes} [Fri Sep 16 07:41:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 07:41:18.516533 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:41:18.549796 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a38611-62a8-47d6-8781-388085e121fb None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:41:18.589093 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bde083-2283-4501-bdf2-e05c668d3e1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:41:18.589748 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bde083-2283-4501-bdf2-e05c668d3e1c None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:41:18.590051 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bde083-2283-4501-bdf2-e05c668d3e1c None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:41:18.590317 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bde083-2283-4501-bdf2-e05c668d3e1c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:41:18.603071 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12bde083-2283-4501-bdf2-e05c668d3e1c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 07:41:18.608078 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application [None req-12bde083-2283-4501-bdf2-e05c668d3e1c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 16 07:41:18.608078 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 07:41:18.608078 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 07:41:18.608078 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 07:41:18.608078 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 07:41:18.608078 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 07:41:18.608078 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 07:41:18.608078 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 07:41:18.608078 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 07:41:18.608078 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 07:41:18.608078 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 07:41:18.608078 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 07:41:18.608078 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 07:41:18.608078 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 07:41:18.608078 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 07:41:18.608078 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 07:41:18.608963 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 07:41:18.608963 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 07:41:18.608963 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 07:41:18.608963 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 07:41:18.608963 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 07:41:18.608963 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 07:41:18.608963 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 07:41:18.608963 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 07:41:18.608963 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 07:41:18.608963 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 07:41:18.608963 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 07:41:18.608963 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application with Lock( Sep 16 07:41:18.608963 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 07:41:18.608963 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._enter() Sep 16 07:41:18.608963 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 07:41:18.608963 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 07:41:18.610544 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 07:41:18.610544 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.creator() Sep 16 07:41:18.610544 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 07:41:18.610544 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application created_value = creator( Sep 16 07:41:18.610544 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 07:41:18.610544 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 07:41:18.610544 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 07:41:18.610544 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 07:41:18.610544 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 07:41:18.610544 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 07:41:18.610544 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 16 07:41:18.610544 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Sep 16 07:41:18.610544 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 87/185] 10.222.0.57 () {56 vars in 1096 bytes} [Fri Sep 16 07:41:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 07:41:18.613893 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836ee284-5da7-481d-b22b-d1e66e3fc759 None None] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:41:18.614164 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836ee284-5da7-481d-b22b-d1e66e3fc759 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:41:18.614500 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836ee284-5da7-481d-b22b-d1e66e3fc759 None None] PATH_INFO: `/` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:41:18.615967 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 99/186] 10.222.0.57 () {54 vars in 927 bytes} [Fri Sep 16 07:41:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 07:41:18.619395 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bde083-2283-4501-bdf2-e05c668d3e1c None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:41:18.621422 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b032d8-e628-4760-9ecd-268c4b1cf948 None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:41:18.621709 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b032d8-e628-4760-9ecd-268c4b1cf948 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:41:18.622010 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b032d8-e628-4760-9ecd-268c4b1cf948 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:41:18.651925 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-91b032d8-e628-4760-9ecd-268c4b1cf948 None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:41:18.653107 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-91b032d8-e628-4760-9ecd-268c4b1cf948 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:41:18.746258 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 100/187] 10.222.0.57 () {58 vars in 1024 bytes} [Fri Sep 16 07:41:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 16 07:41:18.749012 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bde083-2283-4501-bdf2-e05c668d3e1c None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:41:18.785362 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2b2186-e620-44de-b2b5-9b3460cadab7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:41:18.785998 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2b2186-e620-44de-b2b5-9b3460cadab7 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:41:18.786278 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2b2186-e620-44de-b2b5-9b3460cadab7 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:41:18.786551 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2b2186-e620-44de-b2b5-9b3460cadab7 None admin] PATH_INFO: `/v3/roles` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:41:18.787207 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2b2186-e620-44de-b2b5-9b3460cadab7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:41:18.787508 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2b2186-e620-44de-b2b5-9b3460cadab7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:41:18.788892 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2b2186-e620-44de-b2b5-9b3460cadab7 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:41:18.790479 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:41:18.799114 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 88/188] 10.222.0.57 () {56 vars in 1099 bytes} [Fri Sep 16 07:41:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:41:18.805026 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b032d8-e628-4760-9ecd-268c4b1cf948 None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:41:18.826001 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2b2186-e620-44de-b2b5-9b3460cadab7 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:41:18.852082 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:41:18.918221 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b032d8-e628-4760-9ecd-268c4b1cf948 None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:41:18.945861 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2b2186-e620-44de-b2b5-9b3460cadab7 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:41:18.956913 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76c25bf-e285-4356-bd5b-3e494fa0ea26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:41:18.957648 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76c25bf-e285-4356-bd5b-3e494fa0ea26 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:41:18.957964 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76c25bf-e285-4356-bd5b-3e494fa0ea26 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:41:18.958238 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76c25bf-e285-4356-bd5b-3e494fa0ea26 None admin] PATH_INFO: `/v3/users/f23f845d520f47aaaa25cd8c6d199f1a` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:41:18.972488 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76c25bf-e285-4356-bd5b-3e494fa0ea26 None admin] RBAC: Authorizing `identity:get_user(user_id=f23f845d520f47aaaa25cd8c6d199f1a)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:41:18.974265 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76c25bf-e285-4356-bd5b-3e494fa0ea26 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:41:18.975936 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 101/189] 10.222.0.57 () {56 vars in 1177 bytes} [Fri Sep 16 07:41:18 2022] GET /identity/v3/users/f23f845d520f47aaaa25cd8c6d199f1a => generated 283 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:41:18.981393 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76c25bf-e285-4356-bd5b-3e494fa0ea26 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:41:18.984917 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b31be2-4066-4544-b126-40374e218e55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:41:18.985626 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b31be2-4066-4544-b126-40374e218e55 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:41:18.985929 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b31be2-4066-4544-b126-40374e218e55 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:41:18.986198 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b31be2-4066-4544-b126-40374e218e55 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:41:18.987301 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b31be2-4066-4544-b126-40374e218e55 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:41:18.988733 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b31be2-4066-4544-b126-40374e218e55 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:41:18.993822 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 89/190] 10.222.0.57 () {56 vars in 1108 bytes} [Fri Sep 16 07:41:18 2022] GET /identity/v3/domains/default => generated 199 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 07:41:18.995707 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b31be2-4066-4544-b126-40374e218e55 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:41:19.065716 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:41:19.111032 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b31be2-4066-4544-b126-40374e218e55 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:41:19.115690 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:41:19.119945 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76c25bf-e285-4356-bd5b-3e494fa0ea26 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:41:19.151613 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d8188d-4078-4967-851c-5e9a661b7739 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:41:19.152219 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d8188d-4078-4967-851c-5e9a661b7739 None admin] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:41:19.152502 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d8188d-4078-4967-851c-5e9a661b7739 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:41:19.152770 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d8188d-4078-4967-851c-5e9a661b7739 None admin] PATH_INFO: `/v3/users` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:41:19.153632 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d8188d-4078-4967-851c-5e9a661b7739 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:41:19.154453 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe6b196-4c93-49da-9ce7-1ec9eeb2fc22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:41:19.155050 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe6b196-4c93-49da-9ce7-1ec9eeb2fc22 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:41:19.155157 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d8188d-4078-4967-851c-5e9a661b7739 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:41:19.155331 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe6b196-4c93-49da-9ce7-1ec9eeb2fc22 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:41:19.155603 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe6b196-4c93-49da-9ce7-1ec9eeb2fc22 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:41:19.185839 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 90/191] 10.222.0.57 () {60 vars in 1132 bytes} [Fri Sep 16 07:41:18 2022] POST /identity/v3/users => generated 297 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 07:41:19.185839 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d8188d-4078-4967-851c-5e9a661b7739 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:41:19.246187 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe6b196-4c93-49da-9ce7-1ec9eeb2fc22 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:41:19.248513 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe6b196-4c93-49da-9ce7-1ec9eeb2fc22 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:41:19.307065 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d8188d-4078-4967-851c-5e9a661b7739 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:41:19.332536 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:41:19.350852 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0809dc45-5c93-4992-9cad-4629261328ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:41:19.351657 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0809dc45-5c93-4992-9cad-4629261328ab None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:41:19.352060 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0809dc45-5c93-4992-9cad-4629261328ab None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:41:19.352433 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0809dc45-5c93-4992-9cad-4629261328ab None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:41:19.368501 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0809dc45-5c93-4992-9cad-4629261328ab None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 07:41:19.373709 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application [None req-0809dc45-5c93-4992-9cad-4629261328ab None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 16 07:41:19.373709 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 07:41:19.373709 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 07:41:19.373709 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 07:41:19.373709 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 07:41:19.373709 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 07:41:19.373709 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 07:41:19.373709 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 07:41:19.373709 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 07:41:19.373709 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 07:41:19.373709 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 07:41:19.373709 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 07:41:19.373709 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 07:41:19.373709 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 07:41:19.373709 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 07:41:19.373709 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 07:41:19.374624 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 07:41:19.374624 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 07:41:19.374624 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 07:41:19.374624 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 07:41:19.374624 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 07:41:19.374624 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 07:41:19.374624 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 07:41:19.374624 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 07:41:19.374624 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 07:41:19.374624 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 07:41:19.374624 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 07:41:19.374624 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application with Lock( Sep 16 07:41:19.374624 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 07:41:19.374624 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._enter() Sep 16 07:41:19.374624 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 07:41:19.374624 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 07:41:19.376181 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 07:41:19.376181 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.creator() Sep 16 07:41:19.376181 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 07:41:19.376181 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application created_value = creator( Sep 16 07:41:19.376181 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 07:41:19.376181 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 07:41:19.376181 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 07:41:19.376181 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 07:41:19.376181 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 07:41:19.376181 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 07:41:19.376181 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 16 07:41:19.376181 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Sep 16 07:41:19.376181 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 91/192] 10.222.0.57 () {56 vars in 1114 bytes} [Fri Sep 16 07:41:19 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 07:41:19.382304 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0809dc45-5c93-4992-9cad-4629261328ab None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:41:19.389978 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:41:19.396121 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 102/193] 10.222.0.57 () {58 vars in 1282 bytes} [Fri Sep 16 07:41:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 16 07:41:19.402728 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe6b196-4c93-49da-9ce7-1ec9eeb2fc22 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:41:19.512000 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0809dc45-5c93-4992-9cad-4629261328ab None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:41:19.528828 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe6b196-4c93-49da-9ce7-1ec9eeb2fc22 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:41:19.552760 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdeacbae-c0b7-4565-8a30-6384a28ad5f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:41:19.553391 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdeacbae-c0b7-4565-8a30-6384a28ad5f1 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:41:19.553652 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdeacbae-c0b7-4565-8a30-6384a28ad5f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:41:19.553961 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdeacbae-c0b7-4565-8a30-6384a28ad5f1 None admin] PATH_INFO: `/v3/roles` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:41:19.554631 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdeacbae-c0b7-4565-8a30-6384a28ad5f1 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:41:19.554943 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdeacbae-c0b7-4565-8a30-6384a28ad5f1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:41:19.556344 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdeacbae-c0b7-4565-8a30-6384a28ad5f1 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:41:19.569189 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 92/194] 10.222.0.57 () {56 vars in 1111 bytes} [Fri Sep 16 07:41:19 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:41:19.570481 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da52e18d-1f3f-4b9f-ba43-8fb1972cd635 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:41:19.571125 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da52e18d-1f3f-4b9f-ba43-8fb1972cd635 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:41:19.571419 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da52e18d-1f3f-4b9f-ba43-8fb1972cd635 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:41:19.571675 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da52e18d-1f3f-4b9f-ba43-8fb1972cd635 None admin] PATH_INFO: `/v3/projects/421354d0cc9f4200b553561891fddc5d` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:41:19.572833 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da52e18d-1f3f-4b9f-ba43-8fb1972cd635 None admin] RBAC: Authorizing `identity:get_project(project_id=421354d0cc9f4200b553561891fddc5d)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:41:19.574331 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da52e18d-1f3f-4b9f-ba43-8fb1972cd635 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:41:19.574682 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdeacbae-c0b7-4565-8a30-6384a28ad5f1 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:41:19.576093 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 103/195] 10.222.0.57 () {56 vars in 1186 bytes} [Fri Sep 16 07:41:19 2022] GET /identity/v3/projects/421354d0cc9f4200b553561891fddc5d => generated 302 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 07:41:19.581820 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da52e18d-1f3f-4b9f-ba43-8fb1972cd635 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:41:19.631643 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:41:19.658537 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:41:19.702300 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da52e18d-1f3f-4b9f-ba43-8fb1972cd635 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:41:19.716832 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdeacbae-c0b7-4565-8a30-6384a28ad5f1 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:41:19.750577 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e1a7b5-9ffd-4d3f-ae13-9d6e1edf18ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:41:19.751879 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e1a7b5-9ffd-4d3f-ae13-9d6e1edf18ce None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:41:19.752429 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e1a7b5-9ffd-4d3f-ae13-9d6e1edf18ce None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:41:19.752970 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e1a7b5-9ffd-4d3f-ae13-9d6e1edf18ce None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:41:19.754135 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e1a7b5-9ffd-4d3f-ae13-9d6e1edf18ce None admin] RBAC: Adding query filter params (role.id=567db03c91854ad9af1e9a87ec1bd275, scope.project.id=421354d0cc9f4200b553561891fddc5d, user.id=f23f845d520f47aaaa25cd8c6d199f1a) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:41:19.754715 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e1a7b5-9ffd-4d3f-ae13-9d6e1edf18ce None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:41:19.755271 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea80501f-30ab-40b8-b347-7e4f757260eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:41:19.755975 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea80501f-30ab-40b8-b347-7e4f757260eb None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:41:19.756329 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea80501f-30ab-40b8-b347-7e4f757260eb None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:41:19.756672 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea80501f-30ab-40b8-b347-7e4f757260eb None admin] PATH_INFO: `/v3/users/f23f845d520f47aaaa25cd8c6d199f1a` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:41:19.757105 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e1a7b5-9ffd-4d3f-ae13-9d6e1edf18ce None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:41:19.757957 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea80501f-30ab-40b8-b347-7e4f757260eb None admin] RBAC: Authorizing `identity:get_user(user_id=f23f845d520f47aaaa25cd8c6d199f1a)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:41:19.761092 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea80501f-30ab-40b8-b347-7e4f757260eb None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:41:19.762975 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 93/196] 10.222.0.57 () {56 vars in 1177 bytes} [Fri Sep 16 07:41:19 2022] GET /identity/v3/users/f23f845d520f47aaaa25cd8c6d199f1a => generated 283 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 07:41:19.764495 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 104/197] 10.222.0.57 () {56 vars in 1374 bytes} [Fri Sep 16 07:41:19 2022] GET /identity/v3/role_assignments?user.id=f23f845d520f47aaaa25cd8c6d199f1a&scope.project.id=421354d0cc9f4200b553561891fddc5d&role.id=567db03c91854ad9af1e9a87ec1bd275 => generated 259 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 07:41:19.768597 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea80501f-30ab-40b8-b347-7e4f757260eb None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:41:19.894020 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea80501f-30ab-40b8-b347-7e4f757260eb None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:41:19.907154 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:41:19.935318 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0dfcc22-22a5-4f5e-bfcb-d5f687a654c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:41:19.935943 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dfcc22-22a5-4f5e-bfcb-d5f687a654c9 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:41:19.936226 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dfcc22-22a5-4f5e-bfcb-d5f687a654c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:41:19.936507 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dfcc22-22a5-4f5e-bfcb-d5f687a654c9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:41:20.039945 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0dfcc22-22a5-4f5e-bfcb-d5f687a654c9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:41:20.041400 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0dfcc22-22a5-4f5e-bfcb-d5f687a654c9 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:41:20.164638 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 94/198] 10.222.0.57 () {58 vars in 1282 bytes} [Fri Sep 16 07:41:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 16 07:41:20.170331 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e1a7b5-9ffd-4d3f-ae13-9d6e1edf18ce None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:41:20.314082 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e1a7b5-9ffd-4d3f-ae13-9d6e1edf18ce None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:41:20.355992 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:41:20.363328 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef45eef1-609d-4466-a87e-1c4f863816dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:41:20.363975 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef45eef1-609d-4466-a87e-1c4f863816dc None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:41:20.364257 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef45eef1-609d-4466-a87e-1c4f863816dc None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:41:20.364536 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef45eef1-609d-4466-a87e-1c4f863816dc None admin] PATH_INFO: `/v3/projects/421354d0cc9f4200b553561891fddc5d` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:41:20.365690 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef45eef1-609d-4466-a87e-1c4f863816dc None admin] RBAC: Authorizing `identity:get_project(project_id=421354d0cc9f4200b553561891fddc5d)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:41:20.367225 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef45eef1-609d-4466-a87e-1c4f863816dc None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:41:20.369166 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 105/199] 10.222.0.57 () {56 vars in 1186 bytes} [Fri Sep 16 07:41:20 2022] GET /identity/v3/projects/421354d0cc9f4200b553561891fddc5d => generated 302 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:41:20.375406 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0dfcc22-22a5-4f5e-bfcb-d5f687a654c9 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:41:20.398168 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:41:20.516507 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0dfcc22-22a5-4f5e-bfcb-d5f687a654c9 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:41:20.567739 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f427f85-18bf-4ce1-b617-f26daa600bf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:41:20.569185 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f427f85-18bf-4ce1-b617-f26daa600bf1 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:41:20.569682 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f427f85-18bf-4ce1-b617-f26daa600bf1 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:41:20.570173 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f427f85-18bf-4ce1-b617-f26daa600bf1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:41:20.571085 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f427f85-18bf-4ce1-b617-f26daa600bf1 None admin] RBAC: Adding query filter params (role.id=e92664bc677b40769b7a05d102541bf0, scope.project.id=421354d0cc9f4200b553561891fddc5d, user.id=f23f845d520f47aaaa25cd8c6d199f1a) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:41:20.571602 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f427f85-18bf-4ce1-b617-f26daa600bf1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:41:20.573233 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f427f85-18bf-4ce1-b617-f26daa600bf1 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:41:20.586281 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 95/200] 10.222.0.57 () {56 vars in 1374 bytes} [Fri Sep 16 07:41:20 2022] GET /identity/v3/role_assignments?user.id=f23f845d520f47aaaa25cd8c6d199f1a&scope.project.id=421354d0cc9f4200b553561891fddc5d&role.id=e92664bc677b40769b7a05d102541bf0 => generated 259 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:41:20.837981 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2342315c-0d34-4de2-9331-eed01992c227 None None] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:41:20.838455 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2342315c-0d34-4de2-9331-eed01992c227 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:41:20.838455 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2342315c-0d34-4de2-9331-eed01992c227 None None] PATH_INFO: `/` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:41:20.839938 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 106/201] 10.222.0.57 () {54 vars in 927 bytes} [Fri Sep 16 07:41:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 07:41:20.846592 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1b346d-9c53-4f9a-83a3-6d86946a7be5 None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:41:20.846877 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1b346d-9c53-4f9a-83a3-6d86946a7be5 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:41:20.847154 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1b346d-9c53-4f9a-83a3-6d86946a7be5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:41:20.867533 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-cd1b346d-9c53-4f9a-83a3-6d86946a7be5 None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:41:20.868716 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-cd1b346d-9c53-4f9a-83a3-6d86946a7be5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:41:20.946470 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 96/202] 10.222.0.57 () {58 vars in 1024 bytes} [Fri Sep 16 07:41:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 07:41:21.252986 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2342315c-0d34-4de2-9331-eed01992c227 None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:41:21.377400 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2342315c-0d34-4de2-9331-eed01992c227 None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:41:21.414363 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b174b3a8-ad5b-481f-9d16-30fc4d093df9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:41:21.415009 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b174b3a8-ad5b-481f-9d16-30fc4d093df9 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:41:21.415292 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b174b3a8-ad5b-481f-9d16-30fc4d093df9 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:41:21.415569 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b174b3a8-ad5b-481f-9d16-30fc4d093df9 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:41:21.427523 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b174b3a8-ad5b-481f-9d16-30fc4d093df9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 07:41:21.433244 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application [None req-b174b3a8-ad5b-481f-9d16-30fc4d093df9 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 16 07:41:21.433244 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 07:41:21.433244 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 07:41:21.433244 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 07:41:21.433244 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 07:41:21.433244 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 07:41:21.433244 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 07:41:21.433244 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 07:41:21.433244 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 07:41:21.433244 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 07:41:21.433244 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 07:41:21.433244 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 07:41:21.433244 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 07:41:21.433244 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 07:41:21.433244 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 07:41:21.433244 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 07:41:21.434312 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 07:41:21.434312 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 07:41:21.434312 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 07:41:21.434312 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 07:41:21.434312 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 07:41:21.434312 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 07:41:21.434312 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 07:41:21.434312 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 07:41:21.434312 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 07:41:21.434312 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 07:41:21.434312 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 07:41:21.434312 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application with Lock( Sep 16 07:41:21.434312 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 07:41:21.434312 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._enter() Sep 16 07:41:21.434312 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 07:41:21.434312 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 07:41:21.435117 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 07:41:21.435117 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.creator() Sep 16 07:41:21.435117 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 07:41:21.435117 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application created_value = creator( Sep 16 07:41:21.435117 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 07:41:21.435117 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 07:41:21.435117 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 07:41:21.435117 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 07:41:21.435117 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 07:41:21.435117 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 07:41:21.435117 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 16 07:41:21.435117 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Sep 16 07:41:21.435117 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 107/203] 10.222.0.57 () {56 vars in 1099 bytes} [Fri Sep 16 07:41:21 2022] GET /identity/v3/roles/reader => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 07:41:21.442592 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1b346d-9c53-4f9a-83a3-6d86946a7be5 None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:41:21.460406 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:41:21.589292 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1b346d-9c53-4f9a-83a3-6d86946a7be5 None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:41:21.625631 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadd1065-c385-4786-be78-9c6434e81e96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:41:21.626712 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadd1065-c385-4786-be78-9c6434e81e96 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:41:21.627243 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadd1065-c385-4786-be78-9c6434e81e96 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:41:21.627773 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadd1065-c385-4786-be78-9c6434e81e96 None admin] PATH_INFO: `/v3/roles` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:41:21.628653 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dadd1065-c385-4786-be78-9c6434e81e96 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:41:21.629161 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dadd1065-c385-4786-be78-9c6434e81e96 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:41:21.630782 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dadd1065-c385-4786-be78-9c6434e81e96 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:41:21.639729 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 97/204] 10.222.0.57 () {56 vars in 1101 bytes} [Fri Sep 16 07:41:21 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:41:21.646068 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b174b3a8-ad5b-481f-9d16-30fc4d093df9 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:41:21.743331 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:41:21.801656 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b174b3a8-ad5b-481f-9d16-30fc4d093df9 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:41:21.838200 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b92ce6-11df-4bf7-be5d-5e9e1e1ac2f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:41:21.839606 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b92ce6-11df-4bf7-be5d-5e9e1e1ac2f4 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:41:21.840085 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b92ce6-11df-4bf7-be5d-5e9e1e1ac2f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:41:21.840580 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b92ce6-11df-4bf7-be5d-5e9e1e1ac2f4 None admin] PATH_INFO: `/v3/users/3a2f1a60395144368e2832ffe4c8afe2` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:41:21.841947 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b92ce6-11df-4bf7-be5d-5e9e1e1ac2f4 None admin] RBAC: Authorizing `identity:get_user(user_id=3a2f1a60395144368e2832ffe4c8afe2)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:41:21.843576 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b92ce6-11df-4bf7-be5d-5e9e1e1ac2f4 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:41:21.845541 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 108/205] 10.222.0.57 () {56 vars in 1177 bytes} [Fri Sep 16 07:41:21 2022] GET /identity/v3/users/3a2f1a60395144368e2832ffe4c8afe2 => generated 289 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:41:21.854890 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadd1065-c385-4786-be78-9c6434e81e96 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:41:21.909227 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6a3f0d-3d16-4674-8e59-e5142c91b3a9 None None] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:41:21.909554 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6a3f0d-3d16-4674-8e59-e5142c91b3a9 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:41:21.909749 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6a3f0d-3d16-4674-8e59-e5142c91b3a9 None None] PATH_INFO: `/` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:41:21.917890 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 109/206] 10.222.0.57 () {54 vars in 927 bytes} [Fri Sep 16 07:41:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 07:41:21.924286 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f2f79d-29ee-42cc-960d-42c939a678ba None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:41:21.924573 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f2f79d-29ee-42cc-960d-42c939a678ba None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:41:21.924846 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f2f79d-29ee-42cc-960d-42c939a678ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:41:21.943329 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:41:21.959902 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-f1f2f79d-29ee-42cc-960d-42c939a678ba None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:41:21.961277 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-f1f2f79d-29ee-42cc-960d-42c939a678ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:41:22.006589 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadd1065-c385-4786-be78-9c6434e81e96 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:41:22.070798 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983e414c-f7b7-4bd6-b0a4-34ab2118b186 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:41:22.071480 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983e414c-f7b7-4bd6-b0a4-34ab2118b186 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:41:22.071758 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983e414c-f7b7-4bd6-b0a4-34ab2118b186 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:41:22.072024 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983e414c-f7b7-4bd6-b0a4-34ab2118b186 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:41:22.097584 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 110/207] 10.222.0.57 () {58 vars in 1024 bytes} [Fri Sep 16 07:41:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 16 07:41:22.181172 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983e414c-f7b7-4bd6-b0a4-34ab2118b186 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:41:22.182605 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983e414c-f7b7-4bd6-b0a4-34ab2118b186 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:41:22.270432 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:41:22.315428 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 98/208] 10.222.0.57 () {58 vars in 1282 bytes} [Fri Sep 16 07:41:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 461 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 16 07:41:22.321231 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f2f79d-29ee-42cc-960d-42c939a678ba None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:41:22.417877 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:41:22.450086 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d673c2-2997-438f-ace8-b7a4c3a7314e None None] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:41:22.450322 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d673c2-2997-438f-ace8-b7a4c3a7314e None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:41:22.450551 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d673c2-2997-438f-ace8-b7a4c3a7314e None None] PATH_INFO: `/` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:41:22.451909 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 99/209] 10.222.0.57 () {54 vars in 927 bytes} [Fri Sep 16 07:41:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 07:41:22.465361 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b585369f-ee03-498d-a805-1df8d235ae65 None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:41:22.465643 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b585369f-ee03-498d-a805-1df8d235ae65 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:41:22.465940 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b585369f-ee03-498d-a805-1df8d235ae65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:41:22.470440 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f2f79d-29ee-42cc-960d-42c939a678ba None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:41:22.491980 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-b585369f-ee03-498d-a805-1df8d235ae65 None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:41:22.493869 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-b585369f-ee03-498d-a805-1df8d235ae65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:41:22.523047 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee3f0a9-5912-48cd-84d6-72427e36c38a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:41:22.523694 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee3f0a9-5912-48cd-84d6-72427e36c38a None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:41:22.523969 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee3f0a9-5912-48cd-84d6-72427e36c38a None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:41:22.524237 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee3f0a9-5912-48cd-84d6-72427e36c38a None admin] PATH_INFO: `/v3/projects/5324c5a353924497b2d5372a26cbe6fc` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:41:22.525392 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee3f0a9-5912-48cd-84d6-72427e36c38a None admin] RBAC: Authorizing `identity:get_project(project_id=5324c5a353924497b2d5372a26cbe6fc)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:41:22.526873 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee3f0a9-5912-48cd-84d6-72427e36c38a None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:41:22.528491 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 111/210] 10.222.0.57 () {56 vars in 1186 bytes} [Fri Sep 16 07:41:22 2022] GET /identity/v3/projects/5324c5a353924497b2d5372a26cbe6fc => generated 298 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:41:22.529248 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee3f0a9-5912-48cd-84d6-72427e36c38a None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:41:22.597317 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 100/211] 10.222.0.57 () {58 vars in 1024 bytes} [Fri Sep 16 07:41:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 16 07:41:22.599319 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68975d56-7e80-421e-9f66-9928ad26a285 None None] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:41:22.599746 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68975d56-7e80-421e-9f66-9928ad26a285 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:41:22.600138 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68975d56-7e80-421e-9f66-9928ad26a285 None None] PATH_INFO: `/` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:41:22.601696 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 101/212] 10.222.0.57 () {54 vars in 927 bytes} [Fri Sep 16 07:41:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 07:41:22.602481 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68975d56-7e80-421e-9f66-9928ad26a285 None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:41:22.663176 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee3f0a9-5912-48cd-84d6-72427e36c38a None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:41:22.687362 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:41:22.700652 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c8dc73-fd5a-4b60-ac6f-4bc00faba69e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:41:22.701289 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c8dc73-fd5a-4b60-ac6f-4bc00faba69e None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:41:22.701540 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:41:22.701643 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c8dc73-fd5a-4b60-ac6f-4bc00faba69e None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:41:22.702035 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c8dc73-fd5a-4b60-ac6f-4bc00faba69e None admin] PATH_INFO: `/v3/roles/member` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:41:22.711206 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68975d56-7e80-421e-9f66-9928ad26a285 None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:41:22.715680 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c8dc73-fd5a-4b60-ac6f-4bc00faba69e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 07:41:22.723099 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application [None req-67c8dc73-fd5a-4b60-ac6f-4bc00faba69e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 16 07:41:22.723099 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 07:41:22.723099 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 07:41:22.723099 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 07:41:22.723099 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 07:41:22.723099 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 07:41:22.723099 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 07:41:22.723099 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 07:41:22.723099 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 07:41:22.723099 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 07:41:22.723099 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 07:41:22.723099 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 07:41:22.723099 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 07:41:22.723099 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 07:41:22.723099 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 07:41:22.723099 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 07:41:22.723989 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 07:41:22.723989 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 07:41:22.723989 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 07:41:22.723989 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 07:41:22.723989 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 07:41:22.723989 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 07:41:22.723989 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 07:41:22.723989 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 07:41:22.723989 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 07:41:22.723989 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 07:41:22.723989 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 07:41:22.723989 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application with Lock( Sep 16 07:41:22.723989 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 07:41:22.723989 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._enter() Sep 16 07:41:22.723989 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 07:41:22.723989 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 07:41:22.729656 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 07:41:22.729656 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.creator() Sep 16 07:41:22.729656 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 07:41:22.729656 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application created_value = creator( Sep 16 07:41:22.729656 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 07:41:22.729656 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 07:41:22.729656 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 07:41:22.729656 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 07:41:22.729656 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 07:41:22.729656 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 07:41:22.729656 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 16 07:41:22.729656 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Sep 16 07:41:22.729656 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 112/213] 10.222.0.57 () {56 vars in 1099 bytes} [Fri Sep 16 07:41:22 2022] GET /identity/v3/roles/member => generated 84 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 07:41:22.729656 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b22a06-9493-4f0a-93a4-a9cf516183b8 None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:41:22.730427 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b22a06-9493-4f0a-93a4-a9cf516183b8 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:41:22.730427 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b22a06-9493-4f0a-93a4-a9cf516183b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:41:22.746748 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-b4b22a06-9493-4f0a-93a4-a9cf516183b8 None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:41:22.748106 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-b4b22a06-9493-4f0a-93a4-a9cf516183b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:41:22.765387 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d44c2ec-e7b3-4c1f-9a45-905fcb5030e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:41:22.767179 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d44c2ec-e7b3-4c1f-9a45-905fcb5030e1 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:41:22.767457 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d44c2ec-e7b3-4c1f-9a45-905fcb5030e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:41:22.767728 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d44c2ec-e7b3-4c1f-9a45-905fcb5030e1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:41:22.768864 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d44c2ec-e7b3-4c1f-9a45-905fcb5030e1 None admin] RBAC: Adding query filter params (role.id=d4544aeb3a2940b08df3279eab1f529b, scope.project.id=5324c5a353924497b2d5372a26cbe6fc, user.id=3a2f1a60395144368e2832ffe4c8afe2) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:41:22.769164 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d44c2ec-e7b3-4c1f-9a45-905fcb5030e1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:41:22.770903 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d44c2ec-e7b3-4c1f-9a45-905fcb5030e1 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:41:22.778146 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 102/214] 10.222.0.57 () {56 vars in 1374 bytes} [Fri Sep 16 07:41:22 2022] GET /identity/v3/role_assignments?user.id=3a2f1a60395144368e2832ffe4c8afe2&scope.project.id=5324c5a353924497b2d5372a26cbe6fc&role.id=d4544aeb3a2940b08df3279eab1f529b => generated 608 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:41:22.779002 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d44c2ec-e7b3-4c1f-9a45-905fcb5030e1 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:41:22.830242 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 113/215] 10.222.0.57 () {58 vars in 1024 bytes} [Fri Sep 16 07:41:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 07:41:22.901879 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d44c2ec-e7b3-4c1f-9a45-905fcb5030e1 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:41:22.903343 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b22a06-9493-4f0a-93a4-a9cf516183b8 None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:41:22.950760 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a8591c-369a-4aef-a0a9-f5a162ce2cfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:41:22.951301 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a8591c-369a-4aef-a0a9-f5a162ce2cfd None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:41:22.951578 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a8591c-369a-4aef-a0a9-f5a162ce2cfd None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:41:22.951850 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a8591c-369a-4aef-a0a9-f5a162ce2cfd None admin] PATH_INFO: `/v3/roles` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:41:22.952521 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a8591c-369a-4aef-a0a9-f5a162ce2cfd None admin] RBAC: Adding query filter params (name=member) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:41:22.952817 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a8591c-369a-4aef-a0a9-f5a162ce2cfd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:41:22.955268 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a8591c-369a-4aef-a0a9-f5a162ce2cfd None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:41:22.967281 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 103/216] 10.222.0.57 () {56 vars in 1101 bytes} [Fri Sep 16 07:41:22 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:41:22.973467 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a8591c-369a-4aef-a0a9-f5a162ce2cfd None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:41:22.999499 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:41:23.025223 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b22a06-9493-4f0a-93a4-a9cf516183b8 None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:41:23.044664 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:41:23.070405 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ae09b6-9e09-43b3-832e-5433a22957e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:41:23.071574 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ae09b6-9e09-43b3-832e-5433a22957e6 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:41:23.072074 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ae09b6-9e09-43b3-832e-5433a22957e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:41:23.072540 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ae09b6-9e09-43b3-832e-5433a22957e6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:41:23.073873 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ae09b6-9e09-43b3-832e-5433a22957e6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:41:23.075611 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ae09b6-9e09-43b3-832e-5433a22957e6 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:41:23.077411 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 114/217] 10.222.0.57 () {56 vars in 1108 bytes} [Fri Sep 16 07:41:22 2022] GET /identity/v3/domains/default => generated 199 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:41:23.083253 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ae09b6-9e09-43b3-832e-5433a22957e6 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:41:23.087919 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a8591c-369a-4aef-a0a9-f5a162ce2cfd None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:41:23.123698 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdd9ea2-b4f0-4876-96d5-427c897a58f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:41:23.124330 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdd9ea2-b4f0-4876-96d5-427c897a58f1 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:41:23.124605 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdd9ea2-b4f0-4876-96d5-427c897a58f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:41:23.125736 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdd9ea2-b4f0-4876-96d5-427c897a58f1 None admin] PATH_INFO: `/v3/users/0cbca87a934548768ff797909da06fa8` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:41:23.140905 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecdd9ea2-b4f0-4876-96d5-427c897a58f1 None admin] RBAC: Authorizing `identity:get_user(user_id=0cbca87a934548768ff797909da06fa8)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:41:23.142510 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecdd9ea2-b4f0-4876-96d5-427c897a58f1 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:41:23.144380 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 104/218] 10.222.0.57 () {56 vars in 1177 bytes} [Fri Sep 16 07:41:22 2022] GET /identity/v3/users/0cbca87a934548768ff797909da06fa8 => generated 297 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 07:41:23.150279 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdd9ea2-b4f0-4876-96d5-427c897a58f1 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:41:23.196655 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ae09b6-9e09-43b3-832e-5433a22957e6 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:41:23.239108 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc0d609-eaee-4dd6-9f73-4986449fe1f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:41:23.240005 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc0d609-eaee-4dd6-9f73-4986449fe1f6 None admin] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:41:23.240521 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc0d609-eaee-4dd6-9f73-4986449fe1f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:41:23.240969 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc0d609-eaee-4dd6-9f73-4986449fe1f6 None admin] PATH_INFO: `/v3/users` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:41:23.241822 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc0d609-eaee-4dd6-9f73-4986449fe1f6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:41:23.243423 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc0d609-eaee-4dd6-9f73-4986449fe1f6 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:41:23.248430 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:41:23.268623 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 115/219] 10.222.0.57 () {60 vars in 1132 bytes} [Fri Sep 16 07:41:23 2022] POST /identity/v3/users => generated 297 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 16 07:41:23.269284 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc0d609-eaee-4dd6-9f73-4986449fe1f6 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:41:23.280336 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdd9ea2-b4f0-4876-96d5-427c897a58f1 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:41:23.318578 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:41:23.339429 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17443c5-59a4-47ce-91fe-d3f017a4b50c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:41:23.340676 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17443c5-59a4-47ce-91fe-d3f017a4b50c None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:41:23.341165 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17443c5-59a4-47ce-91fe-d3f017a4b50c None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:41:23.342028 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17443c5-59a4-47ce-91fe-d3f017a4b50c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:41:23.359448 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17443c5-59a4-47ce-91fe-d3f017a4b50c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 07:41:23.364540 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application [None req-b17443c5-59a4-47ce-91fe-d3f017a4b50c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 16 07:41:23.364540 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 07:41:23.364540 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 07:41:23.364540 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 07:41:23.364540 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 07:41:23.364540 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 07:41:23.364540 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 07:41:23.364540 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 07:41:23.364540 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 07:41:23.364540 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 07:41:23.364540 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 07:41:23.364540 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 07:41:23.364540 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 07:41:23.364540 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 07:41:23.364540 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 07:41:23.364540 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 07:41:23.365497 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 07:41:23.365497 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 07:41:23.365497 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 07:41:23.365497 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 07:41:23.365497 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 07:41:23.365497 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 07:41:23.365497 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 07:41:23.365497 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 07:41:23.365497 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 07:41:23.365497 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 07:41:23.365497 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 07:41:23.365497 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application with Lock( Sep 16 07:41:23.365497 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 07:41:23.365497 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._enter() Sep 16 07:41:23.365497 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 07:41:23.365497 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 07:41:23.366303 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 07:41:23.366303 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.creator() Sep 16 07:41:23.366303 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 07:41:23.366303 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application created_value = creator( Sep 16 07:41:23.366303 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 07:41:23.366303 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 07:41:23.366303 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 07:41:23.366303 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 07:41:23.366303 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 07:41:23.366303 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 07:41:23.366303 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 16 07:41:23.366303 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Sep 16 07:41:23.371048 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 105/220] 10.222.0.57 () {56 vars in 1096 bytes} [Fri Sep 16 07:41:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 07:41:23.372232 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17443c5-59a4-47ce-91fe-d3f017a4b50c None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:41:23.418612 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc0d609-eaee-4dd6-9f73-4986449fe1f6 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:41:23.459171 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7c8074-307f-4b16-a6ad-67cac9fb438c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:41:23.459842 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7c8074-307f-4b16-a6ad-67cac9fb438c None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:41:23.460123 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7c8074-307f-4b16-a6ad-67cac9fb438c None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:41:23.460442 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7c8074-307f-4b16-a6ad-67cac9fb438c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:41:23.502907 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17443c5-59a4-47ce-91fe-d3f017a4b50c None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:41:23.545351 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be60c12b-4711-4996-96c5-f5ff2b81e2e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:41:23.546037 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be60c12b-4711-4996-96c5-f5ff2b81e2e0 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:41:23.546311 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be60c12b-4711-4996-96c5-f5ff2b81e2e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:41:23.546580 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be60c12b-4711-4996-96c5-f5ff2b81e2e0 None admin] PATH_INFO: `/v3/roles` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:41:23.547816 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be60c12b-4711-4996-96c5-f5ff2b81e2e0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:41:23.548116 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be60c12b-4711-4996-96c5-f5ff2b81e2e0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:41:23.549500 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be60c12b-4711-4996-96c5-f5ff2b81e2e0 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:41:23.549607 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7c8074-307f-4b16-a6ad-67cac9fb438c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:41:23.551078 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7c8074-307f-4b16-a6ad-67cac9fb438c None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:41:23.565118 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 106/221] 10.222.0.57 () {56 vars in 1099 bytes} [Fri Sep 16 07:41:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:41:23.566436 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4530d87f-9141-4fc5-a195-2819a019040c None None] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:41:23.566725 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4530d87f-9141-4fc5-a195-2819a019040c None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:41:23.566999 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4530d87f-9141-4fc5-a195-2819a019040c None None] PATH_INFO: `/` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:41:23.568363 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 107/222] 10.222.0.57 () {54 vars in 927 bytes} [Fri Sep 16 07:41:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 07:41:23.572134 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4530d87f-9141-4fc5-a195-2819a019040c None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:41:23.575018 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:41:23.604190 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:41:23.680570 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 116/223] 10.222.0.57 () {58 vars in 1282 bytes} [Fri Sep 16 07:41:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 16 07:41:23.681613 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0411dfe9-3921-4451-866a-f8ccc06b2f24 None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:41:23.681979 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0411dfe9-3921-4451-866a-f8ccc06b2f24 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:41:23.682390 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0411dfe9-3921-4451-866a-f8ccc06b2f24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:41:23.702299 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4530d87f-9141-4fc5-a195-2819a019040c None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:41:23.707895 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-0411dfe9-3921-4451-866a-f8ccc06b2f24 None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:41:23.709317 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-0411dfe9-3921-4451-866a-f8ccc06b2f24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:41:23.739308 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552c73cf-7cac-4d9b-839e-21b1f354073f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:41:23.740049 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552c73cf-7cac-4d9b-839e-21b1f354073f None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:41:23.740678 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552c73cf-7cac-4d9b-839e-21b1f354073f None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:41:23.740678 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552c73cf-7cac-4d9b-839e-21b1f354073f None admin] PATH_INFO: `/v3/users/f23f845d520f47aaaa25cd8c6d199f1a` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:41:23.742064 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552c73cf-7cac-4d9b-839e-21b1f354073f None admin] RBAC: Authorizing `identity:get_user(user_id=f23f845d520f47aaaa25cd8c6d199f1a)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:41:23.743703 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552c73cf-7cac-4d9b-839e-21b1f354073f None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:41:23.745394 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 108/224] 10.222.0.57 () {56 vars in 1177 bytes} [Fri Sep 16 07:41:23 2022] GET /identity/v3/users/f23f845d520f47aaaa25cd8c6d199f1a => generated 283 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:41:23.746275 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552c73cf-7cac-4d9b-839e-21b1f354073f None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:41:23.788951 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 117/225] 10.222.0.57 () {58 vars in 1024 bytes} [Fri Sep 16 07:41:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 07:41:23.790269 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0411dfe9-3921-4451-866a-f8ccc06b2f24 None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:41:23.819344 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:41:23.880293 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552c73cf-7cac-4d9b-839e-21b1f354073f None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:41:23.895210 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:41:23.950640 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5bbd3d-b9f5-405e-b309-0d176f724ea6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:41:23.951268 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5bbd3d-b9f5-405e-b309-0d176f724ea6 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:41:23.951541 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5bbd3d-b9f5-405e-b309-0d176f724ea6 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:41:23.951806 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5bbd3d-b9f5-405e-b309-0d176f724ea6 None admin] PATH_INFO: `/v3/projects/421354d0cc9f4200b553561891fddc5d` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:41:23.955428 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5bbd3d-b9f5-405e-b309-0d176f724ea6 None admin] RBAC: Authorizing `identity:get_project(project_id=421354d0cc9f4200b553561891fddc5d)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:41:23.956999 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5bbd3d-b9f5-405e-b309-0d176f724ea6 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:41:23.957337 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0411dfe9-3921-4451-866a-f8ccc06b2f24 None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:41:23.959129 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 109/226] 10.222.0.57 () {56 vars in 1186 bytes} [Fri Sep 16 07:41:23 2022] GET /identity/v3/projects/421354d0cc9f4200b553561891fddc5d => generated 302 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:41:23.964684 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5bbd3d-b9f5-405e-b309-0d176f724ea6 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:41:23.995401 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abe349c-ad84-4b11-96d2-a6f225d18643 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:41:23.996079 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abe349c-ad84-4b11-96d2-a6f225d18643 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:41:23.996360 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abe349c-ad84-4b11-96d2-a6f225d18643 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:41:23.996630 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abe349c-ad84-4b11-96d2-a6f225d18643 None admin] PATH_INFO: `/v3/projects/421354d0cc9f4200b553561891fddc5d` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:41:23.997838 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abe349c-ad84-4b11-96d2-a6f225d18643 None admin] RBAC: Authorizing `identity:get_project(project_id=421354d0cc9f4200b553561891fddc5d)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:41:24.007594 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abe349c-ad84-4b11-96d2-a6f225d18643 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:41:24.007594 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 118/227] 10.222.0.57 () {56 vars in 1186 bytes} [Fri Sep 16 07:41:23 2022] GET /identity/v3/projects/421354d0cc9f4200b553561891fddc5d => generated 302 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:41:24.008586 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abe349c-ad84-4b11-96d2-a6f225d18643 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:41:24.072214 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5bbd3d-b9f5-405e-b309-0d176f724ea6 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:41:24.115874 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abe349c-ad84-4b11-96d2-a6f225d18643 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:41:24.124125 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8737eb9a-af4e-441b-aa3a-315c6afffe49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:41:24.125509 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8737eb9a-af4e-441b-aa3a-315c6afffe49 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:41:24.125901 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8737eb9a-af4e-441b-aa3a-315c6afffe49 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:41:24.126270 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8737eb9a-af4e-441b-aa3a-315c6afffe49 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:41:24.127145 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8737eb9a-af4e-441b-aa3a-315c6afffe49 None admin] RBAC: Adding query filter params (role.id=4818d38cf2564825b312e66c9eb24762, scope.project.id=421354d0cc9f4200b553561891fddc5d, user.id=0cbca87a934548768ff797909da06fa8) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:41:24.127574 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8737eb9a-af4e-441b-aa3a-315c6afffe49 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:41:24.129239 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8737eb9a-af4e-441b-aa3a-315c6afffe49 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:41:24.140990 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 110/228] 10.222.0.57 () {56 vars in 1374 bytes} [Fri Sep 16 07:41:23 2022] GET /identity/v3/role_assignments?user.id=0cbca87a934548768ff797909da06fa8&scope.project.id=421354d0cc9f4200b553561891fddc5d&role.id=4818d38cf2564825b312e66c9eb24762 => generated 259 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 07:41:24.142195 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8737eb9a-af4e-441b-aa3a-315c6afffe49 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:41:24.151076 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:41:24.153875 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881096bd-a025-4c99-8828-61cac57f59fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:41:24.154868 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881096bd-a025-4c99-8828-61cac57f59fd None admin] REQUEST_METHOD: `PUT` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:41:24.155197 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881096bd-a025-4c99-8828-61cac57f59fd None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:41:24.155471 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881096bd-a025-4c99-8828-61cac57f59fd None admin] PATH_INFO: `/v3/projects/421354d0cc9f4200b553561891fddc5d/users/f23f845d520f47aaaa25cd8c6d199f1a/roles/567db03c91854ad9af1e9a87ec1bd275` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:41:24.157774 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881096bd-a025-4c99-8828-61cac57f59fd None admin] RBAC: Authorizing `identity:create_grant(project_id=421354d0cc9f4200b553561891fddc5d, user_id=f23f845d520f47aaaa25cd8c6d199f1a, role_id=567db03c91854ad9af1e9a87ec1bd275)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:41:24.159355 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881096bd-a025-4c99-8828-61cac57f59fd None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:41:24.162779 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:41:24.178300 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 119/229] 10.222.0.57 () {58 vars in 1439 bytes} [Fri Sep 16 07:41:24 2022] PUT /identity/v3/projects/421354d0cc9f4200b553561891fddc5d/users/f23f845d520f47aaaa25cd8c6d199f1a/roles/567db03c91854ad9af1e9a87ec1bd275 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 16 07:41:24.323469 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8737eb9a-af4e-441b-aa3a-315c6afffe49 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:41:24.371120 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61258398-7670-4c5f-9ce2-d3848b1321bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:41:24.372093 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61258398-7670-4c5f-9ce2-d3848b1321bc None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:41:24.372467 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61258398-7670-4c5f-9ce2-d3848b1321bc None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:41:24.372859 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61258398-7670-4c5f-9ce2-d3848b1321bc None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:41:24.385392 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61258398-7670-4c5f-9ce2-d3848b1321bc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 07:41:24.391070 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application [None req-61258398-7670-4c5f-9ce2-d3848b1321bc None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 16 07:41:24.391070 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 07:41:24.391070 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 07:41:24.391070 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 07:41:24.391070 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 07:41:24.391070 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 07:41:24.391070 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 07:41:24.391070 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 07:41:24.391070 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 07:41:24.391070 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 07:41:24.391070 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 07:41:24.391070 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 07:41:24.391070 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 07:41:24.391070 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 07:41:24.391070 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 07:41:24.391070 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 07:41:24.392133 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 07:41:24.392133 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 07:41:24.392133 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 07:41:24.392133 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 07:41:24.392133 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 07:41:24.392133 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 07:41:24.392133 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 07:41:24.392133 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 07:41:24.392133 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 07:41:24.392133 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 07:41:24.392133 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 07:41:24.392133 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application with Lock( Sep 16 07:41:24.392133 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 07:41:24.392133 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._enter() Sep 16 07:41:24.392133 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 07:41:24.392133 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 07:41:24.392933 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 07:41:24.392933 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.creator() Sep 16 07:41:24.392933 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 07:41:24.392933 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application created_value = creator( Sep 16 07:41:24.392933 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 07:41:24.392933 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 07:41:24.392933 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 07:41:24.392933 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 07:41:24.392933 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 07:41:24.392933 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 07:41:24.392933 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 16 07:41:24.392933 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Sep 16 07:41:24.392933 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 111/230] 10.222.0.57 () {56 vars in 1114 bytes} [Fri Sep 16 07:41:24 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 07:41:24.399975 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881096bd-a025-4c99-8828-61cac57f59fd None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:41:24.521482 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881096bd-a025-4c99-8828-61cac57f59fd None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:41:24.556814 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b8f822-6d7d-43d5-a472-b482b96d7822 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:41:24.557501 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b8f822-6d7d-43d5-a472-b482b96d7822 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:41:24.557815 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b8f822-6d7d-43d5-a472-b482b96d7822 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:41:24.558087 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b8f822-6d7d-43d5-a472-b482b96d7822 None admin] PATH_INFO: `/v3/roles` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:41:24.558836 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b8f822-6d7d-43d5-a472-b482b96d7822 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:41:24.559140 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b8f822-6d7d-43d5-a472-b482b96d7822 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:41:24.560622 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b8f822-6d7d-43d5-a472-b482b96d7822 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:41:24.575602 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 120/231] 10.222.0.57 () {56 vars in 1111 bytes} [Fri Sep 16 07:41:24 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:41:24.581058 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61258398-7670-4c5f-9ce2-d3848b1321bc None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:41:24.645903 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:41:24.686315 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61258398-7670-4c5f-9ce2-d3848b1321bc None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:41:24.721981 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b47f60-7517-4cb9-85ca-d8a081534ab6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:41:24.722619 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b47f60-7517-4cb9-85ca-d8a081534ab6 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:41:24.722885 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b47f60-7517-4cb9-85ca-d8a081534ab6 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:41:24.723160 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b47f60-7517-4cb9-85ca-d8a081534ab6 None admin] PATH_INFO: `/v3/users/f23f845d520f47aaaa25cd8c6d199f1a` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:41:24.724298 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b47f60-7517-4cb9-85ca-d8a081534ab6 None admin] RBAC: Authorizing `identity:get_user(user_id=f23f845d520f47aaaa25cd8c6d199f1a)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:41:24.725841 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b47f60-7517-4cb9-85ca-d8a081534ab6 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:41:24.727697 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 112/232] 10.222.0.57 () {56 vars in 1177 bytes} [Fri Sep 16 07:41:24 2022] GET /identity/v3/users/f23f845d520f47aaaa25cd8c6d199f1a => generated 283 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:41:24.733053 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b8f822-6d7d-43d5-a472-b482b96d7822 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:41:24.810535 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:41:24.857753 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b8f822-6d7d-43d5-a472-b482b96d7822 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:41:24.893456 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87d33a0-52d3-46f0-b50e-5b9f193e64e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:41:24.894112 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87d33a0-52d3-46f0-b50e-5b9f193e64e5 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:41:24.894387 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87d33a0-52d3-46f0-b50e-5b9f193e64e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:41:24.894655 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87d33a0-52d3-46f0-b50e-5b9f193e64e5 None admin] PATH_INFO: `/v3/projects/421354d0cc9f4200b553561891fddc5d` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:41:24.895788 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87d33a0-52d3-46f0-b50e-5b9f193e64e5 None admin] RBAC: Authorizing `identity:get_project(project_id=421354d0cc9f4200b553561891fddc5d)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:41:24.897220 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87d33a0-52d3-46f0-b50e-5b9f193e64e5 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:41:24.899167 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 121/233] 10.222.0.57 () {56 vars in 1186 bytes} [Fri Sep 16 07:41:24 2022] GET /identity/v3/projects/421354d0cc9f4200b553561891fddc5d => generated 302 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:41:24.904648 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b47f60-7517-4cb9-85ca-d8a081534ab6 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:41:25.041028 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b47f60-7517-4cb9-85ca-d8a081534ab6 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:41:25.070684 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:41:25.076852 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fe84eb-a738-4220-99cc-1d7d011c866a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:41:25.077512 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fe84eb-a738-4220-99cc-1d7d011c866a None admin] REQUEST_METHOD: `PUT` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:41:25.077904 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fe84eb-a738-4220-99cc-1d7d011c866a None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:41:25.078278 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fe84eb-a738-4220-99cc-1d7d011c866a None admin] PATH_INFO: `/v3/projects/421354d0cc9f4200b553561891fddc5d/users/f23f845d520f47aaaa25cd8c6d199f1a/roles/e92664bc677b40769b7a05d102541bf0` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:41:25.085809 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fe84eb-a738-4220-99cc-1d7d011c866a None admin] RBAC: Authorizing `identity:create_grant(project_id=421354d0cc9f4200b553561891fddc5d, user_id=f23f845d520f47aaaa25cd8c6d199f1a, role_id=e92664bc677b40769b7a05d102541bf0)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:41:25.087283 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fe84eb-a738-4220-99cc-1d7d011c866a None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:41:25.110859 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 113/234] 10.222.0.57 () {58 vars in 1439 bytes} [Fri Sep 16 07:41:24 2022] PUT /identity/v3/projects/421354d0cc9f4200b553561891fddc5d/users/f23f845d520f47aaaa25cd8c6d199f1a/roles/e92664bc677b40769b7a05d102541bf0 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 07:41:26.012493 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36704299-5ce3-48cd-83e2-70286d4bf2da None None] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:41:26.013005 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36704299-5ce3-48cd-83e2-70286d4bf2da None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:41:26.013081 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36704299-5ce3-48cd-83e2-70286d4bf2da None None] PATH_INFO: `/` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:41:26.014391 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 122/235] 10.222.0.57 () {54 vars in 927 bytes} [Fri Sep 16 07:41:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 07:41:26.020285 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c8fdbc-2d0e-4103-a170-496f726e195f None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:41:26.020764 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c8fdbc-2d0e-4103-a170-496f726e195f None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:41:26.020840 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c8fdbc-2d0e-4103-a170-496f726e195f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:41:26.039417 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-69c8fdbc-2d0e-4103-a170-496f726e195f None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:41:26.040604 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-69c8fdbc-2d0e-4103-a170-496f726e195f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:41:26.142659 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 114/236] 10.222.0.57 () {58 vars in 1024 bytes} [Fri Sep 16 07:41:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 16 07:41:26.248178 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424fa841-d79d-49f1-bab8-840b39006149 None None] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:41:26.248493 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424fa841-d79d-49f1-bab8-840b39006149 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:41:26.248724 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424fa841-d79d-49f1-bab8-840b39006149 None None] PATH_INFO: `/` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:41:26.251183 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 123/237] 10.222.0.57 () {54 vars in 927 bytes} [Fri Sep 16 07:41:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 07:41:26.256127 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23a030b-0e93-446e-a5af-5045d661d30f None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:41:26.256417 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23a030b-0e93-446e-a5af-5045d661d30f None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:41:26.256693 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23a030b-0e93-446e-a5af-5045d661d30f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:41:26.280807 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-d23a030b-0e93-446e-a5af-5045d661d30f None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:41:26.282111 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-d23a030b-0e93-446e-a5af-5045d661d30f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:41:26.367546 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 115/238] 10.222.0.57 () {58 vars in 1024 bytes} [Fri Sep 16 07:41:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 07:41:26.516276 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424fa841-d79d-49f1-bab8-840b39006149 None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:41:26.628449 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424fa841-d79d-49f1-bab8-840b39006149 None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:41:26.659515 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:41:26.674649 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317c16ab-616a-4fca-9bcc-058195de5460 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:41:26.675288 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317c16ab-616a-4fca-9bcc-058195de5460 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:41:26.675570 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317c16ab-616a-4fca-9bcc-058195de5460 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:41:26.675846 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317c16ab-616a-4fca-9bcc-058195de5460 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:41:26.694247 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317c16ab-616a-4fca-9bcc-058195de5460 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 07:41:26.698768 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28309110-979f-4578-9d26-7ab14ffd84d5 None None] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:41:26.699261 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application [None req-317c16ab-616a-4fca-9bcc-058195de5460 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 16 07:41:26.699261 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 07:41:26.699261 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 07:41:26.699261 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 07:41:26.699261 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 07:41:26.699261 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 07:41:26.699261 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 07:41:26.699261 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 07:41:26.699261 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 07:41:26.699261 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 07:41:26.699261 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 07:41:26.699261 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 07:41:26.699261 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 07:41:26.699261 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 07:41:26.699261 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 07:41:26.699261 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 07:41:26.700120 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 07:41:26.700120 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 07:41:26.700120 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 07:41:26.700120 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 07:41:26.700120 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 07:41:26.700120 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 07:41:26.700120 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 07:41:26.700120 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 07:41:26.700120 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 07:41:26.700120 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 07:41:26.700120 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 07:41:26.700120 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application with Lock( Sep 16 07:41:26.700120 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 07:41:26.700120 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._enter() Sep 16 07:41:26.700120 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 07:41:26.700120 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 07:41:26.700912 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 07:41:26.700912 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.creator() Sep 16 07:41:26.700912 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 07:41:26.700912 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application created_value = creator( Sep 16 07:41:26.700912 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 07:41:26.700912 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 07:41:26.700912 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 07:41:26.700912 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 07:41:26.700912 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 07:41:26.700912 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 07:41:26.700912 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 16 07:41:26.700912 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Sep 16 07:41:26.700912 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 124/239] 10.222.0.57 () {56 vars in 1099 bytes} [Fri Sep 16 07:41:26 2022] GET /identity/v3/roles/reader => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 07:41:26.702287 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28309110-979f-4578-9d26-7ab14ffd84d5 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:41:26.702811 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28309110-979f-4578-9d26-7ab14ffd84d5 None None] PATH_INFO: `/` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:41:26.707448 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 116/240] 10.222.0.57 () {54 vars in 927 bytes} [Fri Sep 16 07:41:26 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 07:41:26.710819 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317c16ab-616a-4fca-9bcc-058195de5460 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:41:26.715687 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671a36eb-6f27-4d77-bd9a-6bb092e053d0 None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:41:26.716502 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671a36eb-6f27-4d77-bd9a-6bb092e053d0 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:41:26.716968 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671a36eb-6f27-4d77-bd9a-6bb092e053d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:41:26.744779 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-671a36eb-6f27-4d77-bd9a-6bb092e053d0 None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:41:26.746431 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-671a36eb-6f27-4d77-bd9a-6bb092e053d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:41:26.838076 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:41:26.871299 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 117/241] 10.222.0.57 () {58 vars in 1024 bytes} [Fri Sep 16 07:41:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 16 07:41:26.876952 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671a36eb-6f27-4d77-bd9a-6bb092e053d0 None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:41:26.883764 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317c16ab-616a-4fca-9bcc-058195de5460 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:41:26.946482 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b1349d-c051-478b-b54e-587bff54ff05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:41:26.947101 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b1349d-c051-478b-b54e-587bff54ff05 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:41:26.947383 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b1349d-c051-478b-b54e-587bff54ff05 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:41:26.947657 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b1349d-c051-478b-b54e-587bff54ff05 None admin] PATH_INFO: `/v3/roles` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:41:26.948333 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b1349d-c051-478b-b54e-587bff54ff05 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:41:26.948627 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b1349d-c051-478b-b54e-587bff54ff05 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:41:26.950038 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b1349d-c051-478b-b54e-587bff54ff05 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:41:26.964321 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 125/242] 10.222.0.57 () {56 vars in 1101 bytes} [Fri Sep 16 07:41:26 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:41:26.970765 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b1349d-c051-478b-b54e-587bff54ff05 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:41:27.038350 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:41:27.097560 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b1349d-c051-478b-b54e-587bff54ff05 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:41:27.106668 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671a36eb-6f27-4d77-bd9a-6bb092e053d0 None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:41:27.136398 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60aa35e-4051-460b-bccf-a4a697cb2bd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:41:27.136983 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60aa35e-4051-460b-bccf-a4a697cb2bd1 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:41:27.137266 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60aa35e-4051-460b-bccf-a4a697cb2bd1 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:41:27.137540 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60aa35e-4051-460b-bccf-a4a697cb2bd1 None admin] PATH_INFO: `/v3/users/09540d9761da46299a6b98cd23a2a95c` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:41:27.160499 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60aa35e-4051-460b-bccf-a4a697cb2bd1 None admin] RBAC: Authorizing `identity:get_user(user_id=09540d9761da46299a6b98cd23a2a95c)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:41:27.160945 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bc5bb0-f1ca-4e35-b1f4-1a41fc9a3ad7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:41:27.161582 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bc5bb0-f1ca-4e35-b1f4-1a41fc9a3ad7 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:41:27.161891 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bc5bb0-f1ca-4e35-b1f4-1a41fc9a3ad7 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:41:27.162018 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60aa35e-4051-460b-bccf-a4a697cb2bd1 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:41:27.162173 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bc5bb0-f1ca-4e35-b1f4-1a41fc9a3ad7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:41:27.163274 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52bc5bb0-f1ca-4e35-b1f4-1a41fc9a3ad7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:41:27.163740 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 126/243] 10.222.0.57 () {56 vars in 1177 bytes} [Fri Sep 16 07:41:26 2022] GET /identity/v3/users/09540d9761da46299a6b98cd23a2a95c => generated 297 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 07:41:27.164713 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52bc5bb0-f1ca-4e35-b1f4-1a41fc9a3ad7 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:41:27.166295 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 118/244] 10.222.0.57 () {56 vars in 1108 bytes} [Fri Sep 16 07:41:26 2022] GET /identity/v3/domains/default => generated 199 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:41:27.169645 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60aa35e-4051-460b-bccf-a4a697cb2bd1 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:41:27.182679 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bc5bb0-f1ca-4e35-b1f4-1a41fc9a3ad7 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:41:27.257314 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:41:27.291348 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60aa35e-4051-460b-bccf-a4a697cb2bd1 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:41:27.299681 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:41:27.312602 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bc5bb0-f1ca-4e35-b1f4-1a41fc9a3ad7 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:41:27.329347 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21ca621-0c50-46c7-b210-23bf7e22c41e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:41:27.330255 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21ca621-0c50-46c7-b210-23bf7e22c41e None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:41:27.330531 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21ca621-0c50-46c7-b210-23bf7e22c41e None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:41:27.330797 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21ca621-0c50-46c7-b210-23bf7e22c41e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:41:27.350292 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06e7a05-1570-4b4c-a426-bb04c41da110 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:41:27.350898 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06e7a05-1570-4b4c-a426-bb04c41da110 None admin] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:41:27.351169 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06e7a05-1570-4b4c-a426-bb04c41da110 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:41:27.351435 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06e7a05-1570-4b4c-a426-bb04c41da110 None admin] PATH_INFO: `/v3/users` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:41:27.352071 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06e7a05-1570-4b4c-a426-bb04c41da110 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:41:27.353772 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06e7a05-1570-4b4c-a426-bb04c41da110 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:41:27.385754 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 119/245] 10.222.0.57 () {60 vars in 1132 bytes} [Fri Sep 16 07:41:27 2022] POST /identity/v3/users => generated 293 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 07:41:27.385754 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06e7a05-1570-4b4c-a426-bb04c41da110 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:41:27.417312 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21ca621-0c50-46c7-b210-23bf7e22c41e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:41:27.419044 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21ca621-0c50-46c7-b210-23bf7e22c41e None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:41:27.509966 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06e7a05-1570-4b4c-a426-bb04c41da110 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:41:27.513499 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:41:27.553251 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6524f8fe-2bf7-4f60-802f-2a923e540be0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:41:27.554108 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6524f8fe-2bf7-4f60-802f-2a923e540be0 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:41:27.554459 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6524f8fe-2bf7-4f60-802f-2a923e540be0 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:41:27.554850 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6524f8fe-2bf7-4f60-802f-2a923e540be0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:41:27.567117 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6524f8fe-2bf7-4f60-802f-2a923e540be0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 07:41:27.572303 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application [None req-6524f8fe-2bf7-4f60-802f-2a923e540be0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 16 07:41:27.572303 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 07:41:27.572303 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 07:41:27.572303 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 07:41:27.572303 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 07:41:27.572303 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 07:41:27.572303 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 07:41:27.572303 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 07:41:27.572303 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 07:41:27.572303 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 07:41:27.572303 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 07:41:27.572303 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 07:41:27.572303 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 07:41:27.572303 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 07:41:27.572303 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 07:41:27.572303 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 07:41:27.573204 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 07:41:27.573204 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 07:41:27.573204 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 07:41:27.573204 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 07:41:27.573204 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 07:41:27.573204 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 07:41:27.573204 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 07:41:27.573204 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 07:41:27.573204 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 07:41:27.573204 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 07:41:27.573204 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 07:41:27.573204 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application with Lock( Sep 16 07:41:27.573204 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 07:41:27.573204 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._enter() Sep 16 07:41:27.573204 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 07:41:27.573204 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 07:41:27.574089 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 07:41:27.574089 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.creator() Sep 16 07:41:27.574089 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 07:41:27.574089 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application created_value = creator( Sep 16 07:41:27.574089 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 07:41:27.574089 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 07:41:27.574089 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 07:41:27.574089 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 07:41:27.574089 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 07:41:27.574089 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 07:41:27.574089 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 16 07:41:27.574089 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Sep 16 07:41:27.574089 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 120/246] 10.222.0.57 () {56 vars in 1096 bytes} [Fri Sep 16 07:41:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 07:41:27.575270 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62633877-f542-4a16-be1b-68b2a67ec325 None None] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:41:27.575270 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62633877-f542-4a16-be1b-68b2a67ec325 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:41:27.575270 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62633877-f542-4a16-be1b-68b2a67ec325 None None] PATH_INFO: `/` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:41:27.581387 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 121/247] 10.222.0.57 () {54 vars in 927 bytes} [Fri Sep 16 07:41:27 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 07:41:27.582269 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62633877-f542-4a16-be1b-68b2a67ec325 None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:41:27.586979 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 127/248] 10.222.0.57 () {58 vars in 1282 bytes} [Fri Sep 16 07:41:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 16 07:41:27.588308 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2bb789-7a02-46cf-8c24-000f4713b4cb None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:41:27.588604 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2bb789-7a02-46cf-8c24-000f4713b4cb None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:41:27.588881 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2bb789-7a02-46cf-8c24-000f4713b4cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:41:27.606531 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:41:27.614881 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-eb2bb789-7a02-46cf-8c24-000f4713b4cb None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:41:27.616416 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-eb2bb789-7a02-46cf-8c24-000f4713b4cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:41:27.704031 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 128/249] 10.222.0.57 () {58 vars in 1024 bytes} [Fri Sep 16 07:41:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 07:41:27.707922 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2bb789-7a02-46cf-8c24-000f4713b4cb None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:41:27.728680 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62633877-f542-4a16-be1b-68b2a67ec325 None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:41:27.773331 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672266aa-09cc-4e89-92a2-c89e14b75b9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:41:27.774141 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672266aa-09cc-4e89-92a2-c89e14b75b9b None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:41:27.774424 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672266aa-09cc-4e89-92a2-c89e14b75b9b None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:41:27.774700 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672266aa-09cc-4e89-92a2-c89e14b75b9b None admin] PATH_INFO: `/v3/roles` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:41:27.775397 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672266aa-09cc-4e89-92a2-c89e14b75b9b None admin] RBAC: Adding query filter params (name=admin) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:41:27.775702 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672266aa-09cc-4e89-92a2-c89e14b75b9b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:41:27.777998 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672266aa-09cc-4e89-92a2-c89e14b75b9b None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:41:27.791590 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 122/250] 10.222.0.57 () {56 vars in 1099 bytes} [Fri Sep 16 07:41:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:41:27.798832 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672266aa-09cc-4e89-92a2-c89e14b75b9b None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:41:27.831317 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:41:27.882121 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2bb789-7a02-46cf-8c24-000f4713b4cb None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:41:27.926448 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4a5851-d6b9-41c7-bd1f-e1313158f92c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:41:27.927087 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4a5851-d6b9-41c7-bd1f-e1313158f92c None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:41:27.927512 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4a5851-d6b9-41c7-bd1f-e1313158f92c None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:41:27.927794 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4a5851-d6b9-41c7-bd1f-e1313158f92c None admin] PATH_INFO: `/v3/projects/421354d0cc9f4200b553561891fddc5d` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:41:27.929515 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4a5851-d6b9-41c7-bd1f-e1313158f92c None admin] RBAC: Authorizing `identity:get_project(project_id=421354d0cc9f4200b553561891fddc5d)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:41:27.931185 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4a5851-d6b9-41c7-bd1f-e1313158f92c None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:41:27.933188 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 129/251] 10.222.0.57 () {56 vars in 1186 bytes} [Fri Sep 16 07:41:27 2022] GET /identity/v3/projects/421354d0cc9f4200b553561891fddc5d => generated 302 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:41:27.934678 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebf8089-1615-4deb-9b42-8369c715fd28 None None] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:41:27.935109 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebf8089-1615-4deb-9b42-8369c715fd28 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:41:27.935388 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebf8089-1615-4deb-9b42-8369c715fd28 None None] PATH_INFO: `/` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:41:27.937825 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 130/252] 10.222.0.57 () {54 vars in 927 bytes} [Fri Sep 16 07:41:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 07:41:27.940469 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672266aa-09cc-4e89-92a2-c89e14b75b9b None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:41:27.940590 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebf8089-1615-4deb-9b42-8369c715fd28 None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:41:27.945271 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:41:27.980276 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c2ebfb-2097-41d1-a370-84df6e668c52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:41:27.981247 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c2ebfb-2097-41d1-a370-84df6e668c52 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:41:27.981764 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c2ebfb-2097-41d1-a370-84df6e668c52 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:41:27.982178 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c2ebfb-2097-41d1-a370-84df6e668c52 None admin] PATH_INFO: `/v3/users/f23f845d520f47aaaa25cd8c6d199f1a` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:41:27.983484 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c2ebfb-2097-41d1-a370-84df6e668c52 None admin] RBAC: Authorizing `identity:get_user(user_id=f23f845d520f47aaaa25cd8c6d199f1a)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:41:27.985664 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c2ebfb-2097-41d1-a370-84df6e668c52 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:41:27.987846 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 123/253] 10.222.0.57 () {56 vars in 1177 bytes} [Fri Sep 16 07:41:27 2022] GET /identity/v3/users/f23f845d520f47aaaa25cd8c6d199f1a => generated 283 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:41:27.989252 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5048cf-8668-4948-aaa8-c2f0ac38103b None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:41:27.989677 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5048cf-8668-4948-aaa8-c2f0ac38103b None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:41:27.990111 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5048cf-8668-4948-aaa8-c2f0ac38103b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:41:28.010435 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-5a5048cf-8668-4948-aaa8-c2f0ac38103b None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:41:28.011677 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-5a5048cf-8668-4948-aaa8-c2f0ac38103b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:41:28.071276 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebf8089-1615-4deb-9b42-8369c715fd28 None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:41:28.092548 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 124/254] 10.222.0.57 () {58 vars in 1024 bytes} [Fri Sep 16 07:41:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 07:41:28.094779 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5048cf-8668-4948-aaa8-c2f0ac38103b None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:41:28.128838 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:41:28.156201 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757dd741-5c12-490a-871d-2bf8e5bd675a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:41:28.157106 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757dd741-5c12-490a-871d-2bf8e5bd675a None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:41:28.157393 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757dd741-5c12-490a-871d-2bf8e5bd675a None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:41:28.157683 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757dd741-5c12-490a-871d-2bf8e5bd675a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:41:28.158456 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757dd741-5c12-490a-871d-2bf8e5bd675a None admin] RBAC: Adding query filter params (role.id=d4544aeb3a2940b08df3279eab1f529b, scope.project.id=421354d0cc9f4200b553561891fddc5d, user.id=09540d9761da46299a6b98cd23a2a95c) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:41:28.158747 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757dd741-5c12-490a-871d-2bf8e5bd675a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:41:28.160187 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757dd741-5c12-490a-871d-2bf8e5bd675a None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:41:28.173349 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 131/255] 10.222.0.57 () {56 vars in 1374 bytes} [Fri Sep 16 07:41:27 2022] GET /identity/v3/role_assignments?user.id=09540d9761da46299a6b98cd23a2a95c&scope.project.id=421354d0cc9f4200b553561891fddc5d&role.id=d4544aeb3a2940b08df3279eab1f529b => generated 259 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 07:41:28.174397 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757dd741-5c12-490a-871d-2bf8e5bd675a None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:41:28.218761 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5048cf-8668-4948-aaa8-c2f0ac38103b None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:41:28.263967 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022d7e3e-90b5-4a98-a45a-aa703c5cecfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:41:28.264950 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022d7e3e-90b5-4a98-a45a-aa703c5cecfb None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:41:28.266168 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022d7e3e-90b5-4a98-a45a-aa703c5cecfb None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:41:28.266632 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022d7e3e-90b5-4a98-a45a-aa703c5cecfb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:41:28.278791 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:41:28.322317 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757dd741-5c12-490a-871d-2bf8e5bd675a None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:41:28.364905 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109903ee-a0f1-4d2e-ac4f-6261c40868b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:41:28.365116 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109903ee-a0f1-4d2e-ac4f-6261c40868b1 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:41:28.365348 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109903ee-a0f1-4d2e-ac4f-6261c40868b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:41:28.366949 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109903ee-a0f1-4d2e-ac4f-6261c40868b1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:41:28.393391 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109903ee-a0f1-4d2e-ac4f-6261c40868b1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 07:41:28.400146 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application [None req-109903ee-a0f1-4d2e-ac4f-6261c40868b1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 16 07:41:28.400146 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 07:41:28.400146 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 07:41:28.400146 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 07:41:28.400146 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 07:41:28.400146 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 07:41:28.400146 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 07:41:28.400146 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 07:41:28.400146 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 07:41:28.400146 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 07:41:28.400146 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 07:41:28.400146 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 07:41:28.400146 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 07:41:28.400146 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 07:41:28.400146 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 07:41:28.400146 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 07:41:28.401050 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 07:41:28.401050 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 07:41:28.401050 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 07:41:28.401050 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 07:41:28.401050 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 07:41:28.401050 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 07:41:28.401050 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 07:41:28.401050 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 07:41:28.401050 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 07:41:28.401050 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 07:41:28.401050 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 07:41:28.401050 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application with Lock( Sep 16 07:41:28.401050 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 07:41:28.401050 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._enter() Sep 16 07:41:28.401050 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 07:41:28.401050 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 07:41:28.401867 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 07:41:28.401867 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.creator() Sep 16 07:41:28.401867 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 07:41:28.401867 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application created_value = creator( Sep 16 07:41:28.401867 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 07:41:28.401867 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 07:41:28.401867 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 07:41:28.401867 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 07:41:28.401867 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 07:41:28.401867 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 07:41:28.401867 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 16 07:41:28.401867 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Sep 16 07:41:28.402482 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 132/256] 10.222.0.57 () {56 vars in 1099 bytes} [Fri Sep 16 07:41:28 2022] GET /identity/v3/roles/member => generated 84 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 07:41:28.404091 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022d7e3e-90b5-4a98-a45a-aa703c5cecfb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:41:28.405583 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022d7e3e-90b5-4a98-a45a-aa703c5cecfb None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:41:28.408938 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109903ee-a0f1-4d2e-ac4f-6261c40868b1 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:41:28.454828 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:41:28.534540 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109903ee-a0f1-4d2e-ac4f-6261c40868b1 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:41:28.564278 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:41:28.575432 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86a2446-57bb-429d-b28e-bfc8682c1ce5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:41:28.576809 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86a2446-57bb-429d-b28e-bfc8682c1ce5 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:41:28.577544 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86a2446-57bb-429d-b28e-bfc8682c1ce5 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:41:28.578109 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86a2446-57bb-429d-b28e-bfc8682c1ce5 None admin] PATH_INFO: `/v3/roles` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:41:28.579703 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86a2446-57bb-429d-b28e-bfc8682c1ce5 None admin] RBAC: Adding query filter params (name=member) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:41:28.580198 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86a2446-57bb-429d-b28e-bfc8682c1ce5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:41:28.582222 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86a2446-57bb-429d-b28e-bfc8682c1ce5 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:41:28.589984 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 125/257] 10.222.0.57 () {58 vars in 1282 bytes} [Fri Sep 16 07:41:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 497 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 16 07:41:28.591755 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022d7e3e-90b5-4a98-a45a-aa703c5cecfb None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:41:28.594589 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 133/258] 10.222.0.57 () {56 vars in 1101 bytes} [Fri Sep 16 07:41:28 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:41:28.600196 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86a2446-57bb-429d-b28e-bfc8682c1ce5 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:41:28.758334 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86a2446-57bb-429d-b28e-bfc8682c1ce5 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:41:28.797482 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022d7e3e-90b5-4a98-a45a-aa703c5cecfb None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:41:28.801246 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e15ecd-ff2e-44fe-941a-c83a85531bea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:41:28.802002 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e15ecd-ff2e-44fe-941a-c83a85531bea None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:41:28.802356 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e15ecd-ff2e-44fe-941a-c83a85531bea None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:41:28.802699 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e15ecd-ff2e-44fe-941a-c83a85531bea None admin] PATH_INFO: `/v3/users/0cbca87a934548768ff797909da06fa8` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:41:28.803916 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e15ecd-ff2e-44fe-941a-c83a85531bea None admin] RBAC: Authorizing `identity:get_user(user_id=0cbca87a934548768ff797909da06fa8)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:41:28.806465 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e15ecd-ff2e-44fe-941a-c83a85531bea None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:41:28.808306 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 134/259] 10.222.0.57 () {56 vars in 1177 bytes} [Fri Sep 16 07:41:28 2022] GET /identity/v3/users/0cbca87a934548768ff797909da06fa8 => generated 297 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:41:28.809077 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e15ecd-ff2e-44fe-941a-c83a85531bea None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:41:28.845440 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:41:28.857340 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70d650a-b1ee-43c5-aa98-f189c74f7b5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:41:28.858102 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70d650a-b1ee-43c5-aa98-f189c74f7b5e None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:41:28.858454 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70d650a-b1ee-43c5-aa98-f189c74f7b5e None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:41:28.858799 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70d650a-b1ee-43c5-aa98-f189c74f7b5e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:41:28.870379 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70d650a-b1ee-43c5-aa98-f189c74f7b5e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 07:41:28.875825 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application [None req-f70d650a-b1ee-43c5-aa98-f189c74f7b5e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 16 07:41:28.875825 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 07:41:28.875825 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 07:41:28.875825 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 07:41:28.875825 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 07:41:28.875825 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 07:41:28.875825 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 07:41:28.875825 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 07:41:28.875825 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 07:41:28.875825 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 07:41:28.875825 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 07:41:28.875825 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 07:41:28.875825 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 07:41:28.875825 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 07:41:28.875825 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 07:41:28.875825 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 07:41:28.876706 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 07:41:28.876706 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 07:41:28.876706 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 07:41:28.876706 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 07:41:28.876706 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 07:41:28.876706 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 07:41:28.876706 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 07:41:28.876706 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 07:41:28.876706 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 07:41:28.876706 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 07:41:28.876706 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 07:41:28.876706 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application with Lock( Sep 16 07:41:28.876706 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 07:41:28.876706 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._enter() Sep 16 07:41:28.876706 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 07:41:28.876706 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 07:41:28.877499 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 07:41:28.877499 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.creator() Sep 16 07:41:28.877499 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 07:41:28.877499 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application created_value = creator( Sep 16 07:41:28.877499 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 07:41:28.877499 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 07:41:28.877499 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 07:41:28.877499 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 07:41:28.877499 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 07:41:28.877499 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 07:41:28.877499 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 16 07:41:28.877499 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Sep 16 07:41:28.877499 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 126/260] 10.222.0.57 () {56 vars in 1114 bytes} [Fri Sep 16 07:41:28 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 07:41:28.878248 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70d650a-b1ee-43c5-aa98-f189c74f7b5e None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:41:28.918096 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:41:28.989676 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70d650a-b1ee-43c5-aa98-f189c74f7b5e None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:41:29.007992 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e15ecd-ff2e-44fe-941a-c83a85531bea None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:41:29.028420 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b95ef6-7734-4ffa-84c2-5f208eaa8a3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:41:29.029145 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b95ef6-7734-4ffa-84c2-5f208eaa8a3e None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:41:29.029501 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b95ef6-7734-4ffa-84c2-5f208eaa8a3e None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:41:29.029865 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b95ef6-7734-4ffa-84c2-5f208eaa8a3e None admin] PATH_INFO: `/v3/projects/421354d0cc9f4200b553561891fddc5d` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:41:29.031709 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b95ef6-7734-4ffa-84c2-5f208eaa8a3e None admin] RBAC: Authorizing `identity:get_project(project_id=421354d0cc9f4200b553561891fddc5d)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:41:29.036008 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b95ef6-7734-4ffa-84c2-5f208eaa8a3e None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:41:29.036008 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 127/261] 10.222.0.57 () {56 vars in 1186 bytes} [Fri Sep 16 07:41:28 2022] GET /identity/v3/projects/421354d0cc9f4200b553561891fddc5d => generated 302 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:41:29.036008 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b95ef6-7734-4ffa-84c2-5f208eaa8a3e None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:41:29.084711 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a88977-7f24-427b-b101-46325d727c4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:41:29.085926 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a88977-7f24-427b-b101-46325d727c4e None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:41:29.086341 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a88977-7f24-427b-b101-46325d727c4e None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:41:29.086751 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a88977-7f24-427b-b101-46325d727c4e None admin] PATH_INFO: `/v3/projects/421354d0cc9f4200b553561891fddc5d` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:41:29.088017 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a88977-7f24-427b-b101-46325d727c4e None admin] RBAC: Authorizing `identity:get_project(project_id=421354d0cc9f4200b553561891fddc5d)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:41:29.095763 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a88977-7f24-427b-b101-46325d727c4e None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:41:29.096008 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:41:29.097790 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 135/262] 10.222.0.57 () {56 vars in 1186 bytes} [Fri Sep 16 07:41:28 2022] GET /identity/v3/projects/421354d0cc9f4200b553561891fddc5d => generated 302 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:41:29.098659 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a88977-7f24-427b-b101-46325d727c4e None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:41:29.148204 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b95ef6-7734-4ffa-84c2-5f208eaa8a3e None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:41:29.184797 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bbd2b6-6c1d-443b-9d33-e25cf425b6c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:41:29.185575 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bbd2b6-6c1d-443b-9d33-e25cf425b6c3 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:41:29.185906 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bbd2b6-6c1d-443b-9d33-e25cf425b6c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:41:29.186182 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bbd2b6-6c1d-443b-9d33-e25cf425b6c3 None admin] PATH_INFO: `/v3/roles` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:41:29.186844 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04bbd2b6-6c1d-443b-9d33-e25cf425b6c3 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:41:29.187331 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04bbd2b6-6c1d-443b-9d33-e25cf425b6c3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:41:29.188842 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04bbd2b6-6c1d-443b-9d33-e25cf425b6c3 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:41:29.197687 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 128/263] 10.222.0.57 () {56 vars in 1111 bytes} [Fri Sep 16 07:41:29 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:41:29.198440 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bbd2b6-6c1d-443b-9d33-e25cf425b6c3 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:41:29.306219 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a88977-7f24-427b-b101-46325d727c4e None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:41:29.323510 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bbd2b6-6c1d-443b-9d33-e25cf425b6c3 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:41:29.345840 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:41:29.366850 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df86081-4890-4719-ba37-b5a308368a97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:41:29.367680 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df86081-4890-4719-ba37-b5a308368a97 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:41:29.368202 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df86081-4890-4719-ba37-b5a308368a97 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:41:29.368643 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df86081-4890-4719-ba37-b5a308368a97 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:41:29.369492 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df86081-4890-4719-ba37-b5a308368a97 None admin] RBAC: Adding query filter params (role.id=567db03c91854ad9af1e9a87ec1bd275, scope.project.id=421354d0cc9f4200b553561891fddc5d, user.id=f23f845d520f47aaaa25cd8c6d199f1a) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:41:29.369967 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df86081-4890-4719-ba37-b5a308368a97 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:41:29.371731 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df86081-4890-4719-ba37-b5a308368a97 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:41:29.378157 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 129/264] 10.222.0.57 () {56 vars in 1374 bytes} [Fri Sep 16 07:41:29 2022] GET /identity/v3/role_assignments?user.id=f23f845d520f47aaaa25cd8c6d199f1a&scope.project.id=421354d0cc9f4200b553561891fddc5d&role.id=567db03c91854ad9af1e9a87ec1bd275 => generated 608 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:41:29.378624 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:41:29.379311 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df86081-4890-4719-ba37-b5a308368a97 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:41:29.390795 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0ac6f8-d5a0-4824-9e1a-f6b72ba1946f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:41:29.392430 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0ac6f8-d5a0-4824-9e1a-f6b72ba1946f None admin] REQUEST_METHOD: `PUT` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:41:29.392786 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0ac6f8-d5a0-4824-9e1a-f6b72ba1946f None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:41:29.393070 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0ac6f8-d5a0-4824-9e1a-f6b72ba1946f None admin] PATH_INFO: `/v3/projects/421354d0cc9f4200b553561891fddc5d/users/0cbca87a934548768ff797909da06fa8/roles/4818d38cf2564825b312e66c9eb24762` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:41:29.400697 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0ac6f8-d5a0-4824-9e1a-f6b72ba1946f None admin] RBAC: Authorizing `identity:create_grant(project_id=421354d0cc9f4200b553561891fddc5d, user_id=0cbca87a934548768ff797909da06fa8, role_id=4818d38cf2564825b312e66c9eb24762)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:41:29.402368 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0ac6f8-d5a0-4824-9e1a-f6b72ba1946f None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:41:29.438138 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 136/265] 10.222.0.57 () {58 vars in 1439 bytes} [Fri Sep 16 07:41:29 2022] PUT /identity/v3/projects/421354d0cc9f4200b553561891fddc5d/users/0cbca87a934548768ff797909da06fa8/roles/4818d38cf2564825b312e66c9eb24762 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 07:41:29.505263 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df86081-4890-4719-ba37-b5a308368a97 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:41:29.545382 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e9abe7-ea5a-4dd0-bfff-fe73aab43b60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:41:29.546361 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e9abe7-ea5a-4dd0-bfff-fe73aab43b60 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:41:29.546833 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e9abe7-ea5a-4dd0-bfff-fe73aab43b60 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:41:29.547249 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e9abe7-ea5a-4dd0-bfff-fe73aab43b60 None admin] PATH_INFO: `/v3/users/f23f845d520f47aaaa25cd8c6d199f1a` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:41:29.548736 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e9abe7-ea5a-4dd0-bfff-fe73aab43b60 None admin] RBAC: Authorizing `identity:get_user(user_id=f23f845d520f47aaaa25cd8c6d199f1a)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:41:29.550371 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e9abe7-ea5a-4dd0-bfff-fe73aab43b60 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:41:29.552176 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 130/266] 10.222.0.57 () {56 vars in 1177 bytes} [Fri Sep 16 07:41:29 2022] GET /identity/v3/users/f23f845d520f47aaaa25cd8c6d199f1a => generated 283 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:41:29.557701 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0ac6f8-d5a0-4824-9e1a-f6b72ba1946f None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:41:29.682904 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0ac6f8-d5a0-4824-9e1a-f6b72ba1946f None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:41:29.723309 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5634d511-cf1d-423d-b4c7-d40380fb351c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:41:29.724230 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5634d511-cf1d-423d-b4c7-d40380fb351c None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:41:29.724668 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5634d511-cf1d-423d-b4c7-d40380fb351c None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:41:29.725081 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5634d511-cf1d-423d-b4c7-d40380fb351c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:41:29.787299 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:41:29.802506 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5634d511-cf1d-423d-b4c7-d40380fb351c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:41:29.804417 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5634d511-cf1d-423d-b4c7-d40380fb351c None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:41:29.908827 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 137/267] 10.222.0.57 () {58 vars in 1282 bytes} [Fri Sep 16 07:41:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 16 07:41:29.914164 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e9abe7-ea5a-4dd0-bfff-fe73aab43b60 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:41:29.983005 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:41:30.049160 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e9abe7-ea5a-4dd0-bfff-fe73aab43b60 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:41:30.101956 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9c590e-6604-4ccb-9c38-a321d8f1bfba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:41:30.102873 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9c590e-6604-4ccb-9c38-a321d8f1bfba None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:41:30.103300 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9c590e-6604-4ccb-9c38-a321d8f1bfba None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:41:30.103716 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9c590e-6604-4ccb-9c38-a321d8f1bfba None admin] PATH_INFO: `/v3/projects/421354d0cc9f4200b553561891fddc5d` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:41:30.110779 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9c590e-6604-4ccb-9c38-a321d8f1bfba None admin] RBAC: Authorizing `identity:get_project(project_id=421354d0cc9f4200b553561891fddc5d)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:41:30.112271 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9c590e-6604-4ccb-9c38-a321d8f1bfba None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:41:30.114000 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 131/268] 10.222.0.57 () {56 vars in 1186 bytes} [Fri Sep 16 07:41:29 2022] GET /identity/v3/projects/421354d0cc9f4200b553561891fddc5d => generated 302 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 07:41:30.119982 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5634d511-cf1d-423d-b4c7-d40380fb351c None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:41:30.221418 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:41:30.241412 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5634d511-cf1d-423d-b4c7-d40380fb351c None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:41:30.289250 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a36637-6470-4d10-b745-2762534bf49d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:41:30.289886 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a36637-6470-4d10-b745-2762534bf49d None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:41:30.290167 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a36637-6470-4d10-b745-2762534bf49d None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:41:30.290439 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a36637-6470-4d10-b745-2762534bf49d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:41:30.291175 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a36637-6470-4d10-b745-2762534bf49d None admin] RBAC: Adding query filter params (role.id=e92664bc677b40769b7a05d102541bf0, scope.project.id=421354d0cc9f4200b553561891fddc5d, user.id=f23f845d520f47aaaa25cd8c6d199f1a) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:41:30.291482 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a36637-6470-4d10-b745-2762534bf49d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:41:30.292931 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a36637-6470-4d10-b745-2762534bf49d None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:41:30.299878 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 138/269] 10.222.0.57 () {56 vars in 1374 bytes} [Fri Sep 16 07:41:30 2022] GET /identity/v3/role_assignments?user.id=f23f845d520f47aaaa25cd8c6d199f1a&scope.project.id=421354d0cc9f4200b553561891fddc5d&role.id=e92664bc677b40769b7a05d102541bf0 => generated 608 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:41:30.471882 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497a6816-d2be-4a90-ab5c-98471866824b None None] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:41:30.472391 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497a6816-d2be-4a90-ab5c-98471866824b None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:41:30.472508 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497a6816-d2be-4a90-ab5c-98471866824b None None] PATH_INFO: `/` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:41:30.473843 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 132/270] 10.222.0.57 () {54 vars in 927 bytes} [Fri Sep 16 07:41:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 07:41:30.479940 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce87db94-bfcf-49b8-bdb5-04d17bfa1c7e None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:41:30.480224 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce87db94-bfcf-49b8-bdb5-04d17bfa1c7e None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:41:30.480494 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce87db94-bfcf-49b8-bdb5-04d17bfa1c7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:41:30.506884 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-ce87db94-bfcf-49b8-bdb5-04d17bfa1c7e None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:41:30.508662 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-ce87db94-bfcf-49b8-bdb5-04d17bfa1c7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:41:30.579085 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 139/271] 10.222.0.57 () {58 vars in 1024 bytes} [Fri Sep 16 07:41:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 07:41:30.869423 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497a6816-d2be-4a90-ab5c-98471866824b None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:41:30.934469 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4383290c-eddf-4893-9cbd-c88edc7509b7 None None] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:41:30.935126 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4383290c-eddf-4893-9cbd-c88edc7509b7 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:41:30.935401 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4383290c-eddf-4893-9cbd-c88edc7509b7 None None] PATH_INFO: `/` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:41:30.936922 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 140/272] 10.222.0.57 () {54 vars in 927 bytes} [Fri Sep 16 07:41:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 07:41:30.943028 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f3660a-3976-49f7-a998-95218a07c33b None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:41:30.943545 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f3660a-3976-49f7-a998-95218a07c33b None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:41:30.944146 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f3660a-3976-49f7-a998-95218a07c33b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:41:30.964865 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-b6f3660a-3976-49f7-a998-95218a07c33b None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:41:30.967128 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-b6f3660a-3976-49f7-a998-95218a07c33b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:41:30.993521 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497a6816-d2be-4a90-ab5c-98471866824b None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:41:31.010168 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:41:31.042927 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b9881a-b5bf-41db-8e95-dac3a44dce5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:41:31.044134 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b9881a-b5bf-41db-8e95-dac3a44dce5f None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:41:31.044591 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b9881a-b5bf-41db-8e95-dac3a44dce5f None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:41:31.045260 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b9881a-b5bf-41db-8e95-dac3a44dce5f None admin] PATH_INFO: `/v3/roles/member` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:41:31.055282 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 141/273] 10.222.0.57 () {58 vars in 1024 bytes} [Fri Sep 16 07:41:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 07:41:31.062315 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b9881a-b5bf-41db-8e95-dac3a44dce5f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 07:41:31.067583 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application [None req-44b9881a-b5bf-41db-8e95-dac3a44dce5f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 16 07:41:31.067583 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 07:41:31.067583 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 07:41:31.067583 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 07:41:31.067583 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 07:41:31.067583 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 07:41:31.067583 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 07:41:31.067583 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 07:41:31.067583 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 07:41:31.067583 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 07:41:31.067583 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 07:41:31.067583 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 07:41:31.067583 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 07:41:31.067583 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 07:41:31.067583 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 07:41:31.067583 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 07:41:31.068436 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 07:41:31.068436 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 07:41:31.068436 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 07:41:31.068436 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 07:41:31.068436 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 07:41:31.068436 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 07:41:31.068436 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 07:41:31.068436 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 07:41:31.068436 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 07:41:31.068436 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 07:41:31.068436 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 07:41:31.068436 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application with Lock( Sep 16 07:41:31.068436 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 07:41:31.068436 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._enter() Sep 16 07:41:31.068436 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 07:41:31.068436 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 07:41:31.069232 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 07:41:31.069232 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.creator() Sep 16 07:41:31.069232 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 07:41:31.069232 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application created_value = creator( Sep 16 07:41:31.069232 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 07:41:31.069232 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 07:41:31.069232 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 07:41:31.069232 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 07:41:31.069232 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 07:41:31.069232 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 07:41:31.069232 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 16 07:41:31.069232 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Sep 16 07:41:31.071787 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 133/274] 10.222.0.57 () {56 vars in 1099 bytes} [Fri Sep 16 07:41:30 2022] GET /identity/v3/roles/member => generated 84 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 07:41:31.080898 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f3660a-3976-49f7-a998-95218a07c33b None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:41:31.091437 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:41:31.130932 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5623e601-07f3-4674-a369-5989fc9bda0b None None] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:41:31.131119 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5623e601-07f3-4674-a369-5989fc9bda0b None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:41:31.131295 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5623e601-07f3-4674-a369-5989fc9bda0b None None] PATH_INFO: `/` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:41:31.132881 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 134/275] 10.222.0.57 () {54 vars in 927 bytes} [Fri Sep 16 07:41:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 16 07:41:31.137804 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f50f01-454c-41ed-8cac-4ba959cbc19e None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:41:31.138256 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f50f01-454c-41ed-8cac-4ba959cbc19e None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:41:31.138530 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f50f01-454c-41ed-8cac-4ba959cbc19e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:41:31.157552 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-37f50f01-454c-41ed-8cac-4ba959cbc19e None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:41:31.158863 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-37f50f01-454c-41ed-8cac-4ba959cbc19e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:41:31.191008 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f3660a-3976-49f7-a998-95218a07c33b None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:41:31.230793 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ef2e73-9d73-42a0-bb6f-980bccb99000 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:41:31.232089 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ef2e73-9d73-42a0-bb6f-980bccb99000 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:41:31.232641 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ef2e73-9d73-42a0-bb6f-980bccb99000 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:41:31.233099 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ef2e73-9d73-42a0-bb6f-980bccb99000 None admin] PATH_INFO: `/v3/roles` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:41:31.235384 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ef2e73-9d73-42a0-bb6f-980bccb99000 None admin] RBAC: Adding query filter params (name=member) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:41:31.236146 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ef2e73-9d73-42a0-bb6f-980bccb99000 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:41:31.237739 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ef2e73-9d73-42a0-bb6f-980bccb99000 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:41:31.241855 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 135/276] 10.222.0.57 () {58 vars in 1024 bytes} [Fri Sep 16 07:41:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 16 07:41:31.257455 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 142/277] 10.222.0.57 () {56 vars in 1101 bytes} [Fri Sep 16 07:41:31 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:41:31.259252 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f50f01-454c-41ed-8cac-4ba959cbc19e None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:41:31.330164 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ef2e73-9d73-42a0-bb6f-980bccb99000 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:41:31.373022 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f50f01-454c-41ed-8cac-4ba959cbc19e None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:41:31.390713 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:41:31.409836 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:41:31.429080 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d349f0-e7c9-44a2-a44d-b6f979fcf647 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:41:31.430037 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d349f0-e7c9-44a2-a44d-b6f979fcf647 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:41:31.431104 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d349f0-e7c9-44a2-a44d-b6f979fcf647 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:41:31.431569 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d349f0-e7c9-44a2-a44d-b6f979fcf647 None admin] PATH_INFO: `/v3/users/9521b562836b487b83a5c9808332cecd` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:41:31.444046 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ef2e73-9d73-42a0-bb6f-980bccb99000 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:41:31.452138 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d349f0-e7c9-44a2-a44d-b6f979fcf647 None admin] RBAC: Authorizing `identity:get_user(user_id=9521b562836b487b83a5c9808332cecd)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:41:31.455370 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d349f0-e7c9-44a2-a44d-b6f979fcf647 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:41:31.457986 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 136/278] 10.222.0.57 () {56 vars in 1177 bytes} [Fri Sep 16 07:41:31 2022] GET /identity/v3/users/9521b562836b487b83a5c9808332cecd => generated 293 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:41:31.464544 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d349f0-e7c9-44a2-a44d-b6f979fcf647 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:41:31.485609 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0baccac-3d32-415c-bcb0-b3a08fa65145 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:41:31.486341 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0baccac-3d32-415c-bcb0-b3a08fa65145 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:41:31.486942 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0baccac-3d32-415c-bcb0-b3a08fa65145 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:41:31.486942 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0baccac-3d32-415c-bcb0-b3a08fa65145 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:41:31.488071 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0baccac-3d32-415c-bcb0-b3a08fa65145 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:41:31.489770 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0baccac-3d32-415c-bcb0-b3a08fa65145 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:41:31.495953 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 143/279] 10.222.0.57 () {56 vars in 1108 bytes} [Fri Sep 16 07:41:31 2022] GET /identity/v3/domains/default => generated 199 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 07:41:31.496948 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0baccac-3d32-415c-bcb0-b3a08fa65145 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:41:31.589296 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d349f0-e7c9-44a2-a44d-b6f979fcf647 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:41:31.602197 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0baccac-3d32-415c-bcb0-b3a08fa65145 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:41:31.632854 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15ffd6f-40c4-4801-a613-305fa3da2ead None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:41:31.633311 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15ffd6f-40c4-4801-a613-305fa3da2ead None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:41:31.633583 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15ffd6f-40c4-4801-a613-305fa3da2ead None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:41:31.633947 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15ffd6f-40c4-4801-a613-305fa3da2ead None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:41:31.634666 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15ffd6f-40c4-4801-a613-305fa3da2ead None admin] RBAC: Adding query filter params (role.id=4818d38cf2564825b312e66c9eb24762, user.id=9521b562836b487b83a5c9808332cecd, scope.system=all) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:41:31.634945 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15ffd6f-40c4-4801-a613-305fa3da2ead None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:41:31.636357 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15ffd6f-40c4-4801-a613-305fa3da2ead None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:41:31.638012 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149f6e16-99ba-4e8f-bf73-de0b748aa174 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:41:31.638623 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149f6e16-99ba-4e8f-bf73-de0b748aa174 None admin] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:41:31.638903 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149f6e16-99ba-4e8f-bf73-de0b748aa174 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:41:31.639182 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149f6e16-99ba-4e8f-bf73-de0b748aa174 None admin] PATH_INFO: `/v3/users` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:41:31.639839 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149f6e16-99ba-4e8f-bf73-de0b748aa174 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:41:31.642374 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149f6e16-99ba-4e8f-bf73-de0b748aa174 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:41:31.642643 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 137/280] 10.222.0.57 () {56 vars in 1308 bytes} [Fri Sep 16 07:41:31 2022] GET /identity/v3/role_assignments?user.id=9521b562836b487b83a5c9808332cecd&scope.system=all&role.id=4818d38cf2564825b312e66c9eb24762 => generated 226 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 07:41:31.643586 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15ffd6f-40c4-4801-a613-305fa3da2ead None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:41:31.670473 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:41:31.675427 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:41:31.688083 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 144/281] 10.222.0.57 () {60 vars in 1132 bytes} [Fri Sep 16 07:41:31 2022] POST /identity/v3/users => generated 293 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 07:41:31.790727 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15ffd6f-40c4-4801-a613-305fa3da2ead None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:41:31.833479 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76af42a1-41d2-48d0-92e8-05c9941fe6f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:41:31.834171 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76af42a1-41d2-48d0-92e8-05c9941fe6f3 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:41:31.834446 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76af42a1-41d2-48d0-92e8-05c9941fe6f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:41:31.834714 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76af42a1-41d2-48d0-92e8-05c9941fe6f3 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:41:31.847319 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76af42a1-41d2-48d0-92e8-05c9941fe6f3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 07:41:31.852358 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application [None req-76af42a1-41d2-48d0-92e8-05c9941fe6f3 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 16 07:41:31.852358 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 07:41:31.852358 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 07:41:31.852358 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 07:41:31.852358 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 07:41:31.852358 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 07:41:31.852358 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 07:41:31.852358 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 07:41:31.852358 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 07:41:31.852358 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 07:41:31.852358 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 07:41:31.852358 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 07:41:31.852358 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 07:41:31.852358 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 07:41:31.852358 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 07:41:31.852358 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 07:41:31.853292 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 07:41:31.853292 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 07:41:31.853292 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 07:41:31.853292 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 07:41:31.853292 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 07:41:31.853292 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 07:41:31.853292 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 07:41:31.853292 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 07:41:31.853292 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 07:41:31.853292 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 07:41:31.853292 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 07:41:31.853292 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application with Lock( Sep 16 07:41:31.853292 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 07:41:31.853292 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._enter() Sep 16 07:41:31.853292 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 07:41:31.853292 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 07:41:31.854123 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 07:41:31.854123 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.creator() Sep 16 07:41:31.854123 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 07:41:31.854123 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application created_value = creator( Sep 16 07:41:31.854123 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 07:41:31.854123 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 07:41:31.854123 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 07:41:31.854123 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 07:41:31.854123 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 07:41:31.854123 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 07:41:31.854123 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 16 07:41:31.854123 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Sep 16 07:41:31.854123 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 138/282] 10.222.0.57 () {56 vars in 1099 bytes} [Fri Sep 16 07:41:31 2022] GET /identity/v3/roles/reader => generated 84 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 07:41:31.861120 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149f6e16-99ba-4e8f-bf73-de0b748aa174 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:41:31.978030 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149f6e16-99ba-4e8f-bf73-de0b748aa174 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:41:32.013462 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76892a7-8362-40b8-889c-d4ec49b88dbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:41:32.014113 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76892a7-8362-40b8-889c-d4ec49b88dbb None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:41:32.014397 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76892a7-8362-40b8-889c-d4ec49b88dbb None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:41:32.014674 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76892a7-8362-40b8-889c-d4ec49b88dbb None admin] PATH_INFO: `/v3/roles` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:41:32.016101 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76892a7-8362-40b8-889c-d4ec49b88dbb None admin] RBAC: Adding query filter params (name=reader) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:41:32.016566 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76892a7-8362-40b8-889c-d4ec49b88dbb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:41:32.017992 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76892a7-8362-40b8-889c-d4ec49b88dbb None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:41:32.027086 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 145/283] 10.222.0.57 () {56 vars in 1101 bytes} [Fri Sep 16 07:41:31 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:41:32.032792 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76af42a1-41d2-48d0-92e8-05c9941fe6f3 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:41:32.129324 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:41:32.144948 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76af42a1-41d2-48d0-92e8-05c9941fe6f3 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:41:32.176418 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1166f467-d8f9-47b3-afe7-45b8fd42a268 None None] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:41:32.176712 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1166f467-d8f9-47b3-afe7-45b8fd42a268 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:41:32.176969 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1166f467-d8f9-47b3-afe7-45b8fd42a268 None None] PATH_INFO: `/` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:41:32.178481 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 146/284] 10.222.0.57 () {54 vars in 927 bytes} [Fri Sep 16 07:41:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 16 07:41:32.183566 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3805e5d3-e65e-491b-b4a3-c1f445839462 None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:41:32.183855 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3805e5d3-e65e-491b-b4a3-c1f445839462 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:41:32.184131 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3805e5d3-e65e-491b-b4a3-c1f445839462 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:41:32.185180 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f6477f-d9e6-4f43-941f-7ff876d1c0d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:41:32.185835 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f6477f-d9e6-4f43-941f-7ff876d1c0d2 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:41:32.186115 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f6477f-d9e6-4f43-941f-7ff876d1c0d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:41:32.186380 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f6477f-d9e6-4f43-941f-7ff876d1c0d2 None admin] PATH_INFO: `/v3/users/09540d9761da46299a6b98cd23a2a95c` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:41:32.188091 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f6477f-d9e6-4f43-941f-7ff876d1c0d2 None admin] RBAC: Authorizing `identity:get_user(user_id=09540d9761da46299a6b98cd23a2a95c)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:41:32.189534 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f6477f-d9e6-4f43-941f-7ff876d1c0d2 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:41:32.191449 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 139/285] 10.222.0.57 () {56 vars in 1177 bytes} [Fri Sep 16 07:41:32 2022] GET /identity/v3/users/09540d9761da46299a6b98cd23a2a95c => generated 297 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:41:32.198352 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f6477f-d9e6-4f43-941f-7ff876d1c0d2 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:41:32.211502 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-3805e5d3-e65e-491b-b4a3-c1f445839462 None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:41:32.212721 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-3805e5d3-e65e-491b-b4a3-c1f445839462 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:41:32.274257 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:41:32.295393 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 147/286] 10.222.0.57 () {58 vars in 1024 bytes} [Fri Sep 16 07:41:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 16 07:41:32.333429 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f6477f-d9e6-4f43-941f-7ff876d1c0d2 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:41:32.383267 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392a706b-dd12-451a-84b5-bd7a1bbe55c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:41:32.383953 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392a706b-dd12-451a-84b5-bd7a1bbe55c3 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:41:32.384236 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392a706b-dd12-451a-84b5-bd7a1bbe55c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:41:32.384575 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392a706b-dd12-451a-84b5-bd7a1bbe55c3 None admin] PATH_INFO: `/v3/projects/421354d0cc9f4200b553561891fddc5d` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:41:32.385749 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392a706b-dd12-451a-84b5-bd7a1bbe55c3 None admin] RBAC: Authorizing `identity:get_project(project_id=421354d0cc9f4200b553561891fddc5d)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:41:32.387184 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392a706b-dd12-451a-84b5-bd7a1bbe55c3 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:41:32.388978 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 140/287] 10.222.0.57 () {56 vars in 1186 bytes} [Fri Sep 16 07:41:32 2022] GET /identity/v3/projects/421354d0cc9f4200b553561891fddc5d => generated 302 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 07:41:32.395711 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3805e5d3-e65e-491b-b4a3-c1f445839462 None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:41:32.635947 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3805e5d3-e65e-491b-b4a3-c1f445839462 None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:41:32.668887 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392a706b-dd12-451a-84b5-bd7a1bbe55c3 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:41:32.747268 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:41:32.753030 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4a41d6-5d8f-461a-86fb-4da48f397bf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:41:32.753984 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4a41d6-5d8f-461a-86fb-4da48f397bf2 None admin] REQUEST_METHOD: `PUT` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:41:32.754480 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4a41d6-5d8f-461a-86fb-4da48f397bf2 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:41:32.754939 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4a41d6-5d8f-461a-86fb-4da48f397bf2 None admin] PATH_INFO: `/v3/projects/421354d0cc9f4200b553561891fddc5d/users/09540d9761da46299a6b98cd23a2a95c/roles/d4544aeb3a2940b08df3279eab1f529b` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:41:32.757031 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4a41d6-5d8f-461a-86fb-4da48f397bf2 None admin] RBAC: Authorizing `identity:create_grant(project_id=421354d0cc9f4200b553561891fddc5d, user_id=09540d9761da46299a6b98cd23a2a95c, role_id=d4544aeb3a2940b08df3279eab1f529b)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:41:32.758970 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4a41d6-5d8f-461a-86fb-4da48f397bf2 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:41:32.791938 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 148/288] 10.222.0.57 () {58 vars in 1439 bytes} [Fri Sep 16 07:41:32 2022] PUT /identity/v3/projects/421354d0cc9f4200b553561891fddc5d/users/09540d9761da46299a6b98cd23a2a95c/roles/d4544aeb3a2940b08df3279eab1f529b => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 07:41:32.992115 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392a706b-dd12-451a-84b5-bd7a1bbe55c3 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:41:33.046991 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb34f8c0-7158-4cc2-ac58-dda02101b86c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:41:33.047825 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb34f8c0-7158-4cc2-ac58-dda02101b86c None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:41:33.048099 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb34f8c0-7158-4cc2-ac58-dda02101b86c None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:41:33.048365 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb34f8c0-7158-4cc2-ac58-dda02101b86c None admin] PATH_INFO: `/v3/roles/member` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:41:33.060318 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb34f8c0-7158-4cc2-ac58-dda02101b86c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 07:41:33.065707 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application [None req-cb34f8c0-7158-4cc2-ac58-dda02101b86c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 16 07:41:33.065707 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 07:41:33.065707 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 07:41:33.065707 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 07:41:33.065707 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 07:41:33.065707 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 07:41:33.065707 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 07:41:33.065707 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 07:41:33.065707 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 07:41:33.065707 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 07:41:33.065707 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 07:41:33.065707 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 07:41:33.065707 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 07:41:33.065707 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 07:41:33.065707 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 07:41:33.065707 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 07:41:33.066608 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 07:41:33.066608 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 07:41:33.066608 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 07:41:33.066608 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 07:41:33.066608 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 07:41:33.066608 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 07:41:33.066608 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 07:41:33.066608 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 07:41:33.066608 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 07:41:33.066608 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 07:41:33.066608 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 07:41:33.066608 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application with Lock( Sep 16 07:41:33.066608 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 07:41:33.066608 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._enter() Sep 16 07:41:33.066608 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 07:41:33.066608 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 07:41:33.067393 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 07:41:33.067393 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.creator() Sep 16 07:41:33.067393 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 07:41:33.067393 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application created_value = creator( Sep 16 07:41:33.067393 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 07:41:33.067393 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 07:41:33.067393 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 07:41:33.067393 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 07:41:33.067393 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 07:41:33.067393 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 07:41:33.067393 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 16 07:41:33.067393 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Sep 16 07:41:33.070040 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 141/289] 10.222.0.57 () {56 vars in 1099 bytes} [Fri Sep 16 07:41:32 2022] GET /identity/v3/roles/member => generated 84 bytes in 401 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 16 07:41:33.078774 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4a41d6-5d8f-461a-86fb-4da48f397bf2 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:41:33.155226 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:41:33.191964 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4a41d6-5d8f-461a-86fb-4da48f397bf2 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:41:33.227344 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc5706d-d0ef-48cf-8fad-9b4b3552b8e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:41:33.227966 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc5706d-d0ef-48cf-8fad-9b4b3552b8e2 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:41:33.228212 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc5706d-d0ef-48cf-8fad-9b4b3552b8e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:41:33.228481 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc5706d-d0ef-48cf-8fad-9b4b3552b8e2 None admin] PATH_INFO: `/v3/roles` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:41:33.229141 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc5706d-d0ef-48cf-8fad-9b4b3552b8e2 None admin] RBAC: Adding query filter params (name=member) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:41:33.229441 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc5706d-d0ef-48cf-8fad-9b4b3552b8e2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:41:33.230812 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc5706d-d0ef-48cf-8fad-9b4b3552b8e2 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:41:33.239342 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 149/290] 10.222.0.57 () {56 vars in 1101 bytes} [Fri Sep 16 07:41:33 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:41:33.244793 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb34f8c0-7158-4cc2-ac58-dda02101b86c None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:41:33.331334 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:41:33.349607 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb34f8c0-7158-4cc2-ac58-dda02101b86c None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:41:33.383702 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e01ac32-e172-417e-9254-6a75b8600edb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:41:33.384331 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e01ac32-e172-417e-9254-6a75b8600edb None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:41:33.384607 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e01ac32-e172-417e-9254-6a75b8600edb None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:41:33.384875 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e01ac32-e172-417e-9254-6a75b8600edb None admin] PATH_INFO: `/v3/users/0cbca87a934548768ff797909da06fa8` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:41:33.386012 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e01ac32-e172-417e-9254-6a75b8600edb None admin] RBAC: Authorizing `identity:get_user(user_id=0cbca87a934548768ff797909da06fa8)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:41:33.387445 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e01ac32-e172-417e-9254-6a75b8600edb None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:41:33.389152 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 142/291] 10.222.0.57 () {56 vars in 1177 bytes} [Fri Sep 16 07:41:33 2022] GET /identity/v3/users/0cbca87a934548768ff797909da06fa8 => generated 297 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:41:33.395266 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc5706d-d0ef-48cf-8fad-9b4b3552b8e2 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:41:33.496273 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc5706d-d0ef-48cf-8fad-9b4b3552b8e2 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:41:33.507347 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:41:33.538194 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3491212-c33c-4b7b-9786-eee75b5d38c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:41:33.539407 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3491212-c33c-4b7b-9786-eee75b5d38c2 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:41:33.539687 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3491212-c33c-4b7b-9786-eee75b5d38c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:41:33.539960 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3491212-c33c-4b7b-9786-eee75b5d38c2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:41:33.608049 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3491212-c33c-4b7b-9786-eee75b5d38c2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:41:33.610075 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3491212-c33c-4b7b-9786-eee75b5d38c2 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:41:33.710941 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 150/292] 10.222.0.57 () {58 vars in 1282 bytes} [Fri Sep 16 07:41:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 16 07:41:33.716595 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e01ac32-e172-417e-9254-6a75b8600edb None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:41:33.819864 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e01ac32-e172-417e-9254-6a75b8600edb None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:41:33.854765 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3661e400-5e80-4eb4-9a6c-a5c55534cc67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:41:33.855396 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3661e400-5e80-4eb4-9a6c-a5c55534cc67 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:41:33.855667 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3661e400-5e80-4eb4-9a6c-a5c55534cc67 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:41:33.855932 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3661e400-5e80-4eb4-9a6c-a5c55534cc67 None admin] PATH_INFO: `/v3/projects/421354d0cc9f4200b553561891fddc5d` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:41:33.857029 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3661e400-5e80-4eb4-9a6c-a5c55534cc67 None admin] RBAC: Authorizing `identity:get_project(project_id=421354d0cc9f4200b553561891fddc5d)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:41:33.858499 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3661e400-5e80-4eb4-9a6c-a5c55534cc67 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:41:33.860562 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 143/293] 10.222.0.57 () {56 vars in 1186 bytes} [Fri Sep 16 07:41:33 2022] GET /identity/v3/projects/421354d0cc9f4200b553561891fddc5d => generated 302 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:41:33.866313 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3491212-c33c-4b7b-9786-eee75b5d38c2 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:41:33.878102 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:41:33.966936 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3491212-c33c-4b7b-9786-eee75b5d38c2 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:41:34.002852 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7486ff-8fd8-4ffd-8ee9-1e17caab96ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:41:34.003455 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7486ff-8fd8-4ffd-8ee9-1e17caab96ab None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:41:34.003735 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7486ff-8fd8-4ffd-8ee9-1e17caab96ab None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:41:34.004004 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7486ff-8fd8-4ffd-8ee9-1e17caab96ab None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:41:34.004717 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7486ff-8fd8-4ffd-8ee9-1e17caab96ab None admin] RBAC: Adding query filter params (role.id=4818d38cf2564825b312e66c9eb24762, scope.project.id=421354d0cc9f4200b553561891fddc5d, user.id=0cbca87a934548768ff797909da06fa8) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:41:34.005018 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7486ff-8fd8-4ffd-8ee9-1e17caab96ab None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:41:34.006448 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7486ff-8fd8-4ffd-8ee9-1e17caab96ab None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:41:34.012711 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 151/294] 10.222.0.57 () {56 vars in 1374 bytes} [Fri Sep 16 07:41:33 2022] GET /identity/v3/role_assignments?user.id=0cbca87a934548768ff797909da06fa8&scope.project.id=421354d0cc9f4200b553561891fddc5d&role.id=4818d38cf2564825b312e66c9eb24762 => generated 608 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:41:34.300827 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d65924d-3942-4ec1-9b1a-19cc996dd09e None None] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:41:34.301199 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d65924d-3942-4ec1-9b1a-19cc996dd09e None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:41:34.301375 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d65924d-3942-4ec1-9b1a-19cc996dd09e None None] PATH_INFO: `/` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:41:34.303046 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 144/295] 10.222.0.57 () {54 vars in 927 bytes} [Fri Sep 16 07:41:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 07:41:34.308254 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1a129a-dd31-4238-b0f6-911ac95dbc84 None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:41:34.308707 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1a129a-dd31-4238-b0f6-911ac95dbc84 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:41:34.308877 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1a129a-dd31-4238-b0f6-911ac95dbc84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:41:34.327010 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-0c1a129a-dd31-4238-b0f6-911ac95dbc84 None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:41:34.328732 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-0c1a129a-dd31-4238-b0f6-911ac95dbc84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:41:34.402096 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 152/296] 10.222.0.57 () {58 vars in 1024 bytes} [Fri Sep 16 07:41:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 07:41:34.707614 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d65924d-3942-4ec1-9b1a-19cc996dd09e None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:41:34.727373 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:41:34.787828 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12349af8-84cf-4d17-9676-ede0d3beaa84 None None] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:41:34.788151 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12349af8-84cf-4d17-9676-ede0d3beaa84 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:41:34.788382 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12349af8-84cf-4d17-9676-ede0d3beaa84 None None] PATH_INFO: `/` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:41:34.790093 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 153/297] 10.222.0.57 () {54 vars in 927 bytes} [Fri Sep 16 07:41:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 07:41:34.795998 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749c7519-c131-491b-b26b-8b82689ed86b None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:41:34.796274 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749c7519-c131-491b-b26b-8b82689ed86b None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:41:34.796553 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749c7519-c131-491b-b26b-8b82689ed86b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:41:34.809248 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:41:34.818801 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-749c7519-c131-491b-b26b-8b82689ed86b None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:41:34.820054 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-749c7519-c131-491b-b26b-8b82689ed86b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:41:34.826679 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d65924d-3942-4ec1-9b1a-19cc996dd09e None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:41:34.875866 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df77d579-3ce8-468b-bd40-319023a12748 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:41:34.877223 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df77d579-3ce8-468b-bd40-319023a12748 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:41:34.877656 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df77d579-3ce8-468b-bd40-319023a12748 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:41:34.878121 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df77d579-3ce8-468b-bd40-319023a12748 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:41:34.892678 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df77d579-3ce8-468b-bd40-319023a12748 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 07:41:34.897941 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application [None req-df77d579-3ce8-468b-bd40-319023a12748 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 16 07:41:34.897941 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 07:41:34.897941 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 07:41:34.897941 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 07:41:34.897941 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 07:41:34.897941 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 07:41:34.897941 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 07:41:34.897941 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 07:41:34.897941 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 07:41:34.897941 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 07:41:34.897941 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 07:41:34.897941 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 07:41:34.897941 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 07:41:34.897941 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 07:41:34.897941 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 07:41:34.897941 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 07:41:34.899003 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 07:41:34.899003 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 07:41:34.899003 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 07:41:34.899003 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 07:41:34.899003 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 07:41:34.899003 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 07:41:34.899003 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 07:41:34.899003 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 07:41:34.899003 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 07:41:34.899003 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 07:41:34.899003 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 07:41:34.899003 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application with Lock( Sep 16 07:41:34.899003 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 07:41:34.899003 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._enter() Sep 16 07:41:34.899003 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 07:41:34.899003 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 07:41:34.899967 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 07:41:34.899967 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.creator() Sep 16 07:41:34.899967 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 07:41:34.899967 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application created_value = creator( Sep 16 07:41:34.899967 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 07:41:34.899967 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 07:41:34.899967 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 07:41:34.899967 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 07:41:34.899967 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 07:41:34.899967 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 07:41:34.899967 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 16 07:41:34.899967 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Sep 16 07:41:34.900680 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 154/298] 10.222.0.57 () {58 vars in 1024 bytes} [Fri Sep 16 07:41:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 16 07:41:34.901940 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 145/299] 10.222.0.57 () {56 vars in 1099 bytes} [Fri Sep 16 07:41:34 2022] GET /identity/v3/roles/member => generated 84 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 07:41:34.908282 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749c7519-c131-491b-b26b-8b82689ed86b None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:41:34.910013 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43f0853-9646-498f-acc8-ee6ad69e89a0 None None] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:41:34.910450 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43f0853-9646-498f-acc8-ee6ad69e89a0 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:41:34.910870 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43f0853-9646-498f-acc8-ee6ad69e89a0 None None] PATH_INFO: `/` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:41:34.912365 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 146/300] 10.222.0.57 () {54 vars in 927 bytes} [Fri Sep 16 07:41:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 07:41:34.917534 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4015615-9740-446a-92d4-e4003a659363 None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:41:34.918007 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4015615-9740-446a-92d4-e4003a659363 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:41:34.918427 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4015615-9740-446a-92d4-e4003a659363 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:41:34.938740 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-e4015615-9740-446a-92d4-e4003a659363 None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:41:34.940280 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-e4015615-9740-446a-92d4-e4003a659363 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:41:35.016528 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749c7519-c131-491b-b26b-8b82689ed86b None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:41:35.025756 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 147/301] 10.222.0.57 () {58 vars in 1024 bytes} [Fri Sep 16 07:41:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 16 07:41:35.057229 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0a4a57-08c5-4e43-a323-6bc1fe31e910 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:41:35.057864 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0a4a57-08c5-4e43-a323-6bc1fe31e910 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:41:35.058198 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0a4a57-08c5-4e43-a323-6bc1fe31e910 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:41:35.058469 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0a4a57-08c5-4e43-a323-6bc1fe31e910 None admin] PATH_INFO: `/v3/roles` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:41:35.059175 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0a4a57-08c5-4e43-a323-6bc1fe31e910 None admin] RBAC: Adding query filter params (name=member) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:41:35.059537 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0a4a57-08c5-4e43-a323-6bc1fe31e910 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:41:35.060900 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0a4a57-08c5-4e43-a323-6bc1fe31e910 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:41:35.062826 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:41:35.072316 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 155/302] 10.222.0.57 () {56 vars in 1101 bytes} [Fri Sep 16 07:41:34 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:41:35.078026 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4015615-9740-446a-92d4-e4003a659363 None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:41:35.089674 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:41:35.184375 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4015615-9740-446a-92d4-e4003a659363 None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:41:35.213228 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0a4a57-08c5-4e43-a323-6bc1fe31e910 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:41:35.224406 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df09fa5-36e9-4ac1-9182-9e308785054e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:41:35.225046 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df09fa5-36e9-4ac1-9182-9e308785054e None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:41:35.225325 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df09fa5-36e9-4ac1-9182-9e308785054e None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:41:35.225594 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df09fa5-36e9-4ac1-9182-9e308785054e None admin] PATH_INFO: `/v3/users/9521b562836b487b83a5c9808332cecd` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:41:35.227309 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df09fa5-36e9-4ac1-9182-9e308785054e None admin] RBAC: Authorizing `identity:get_user(user_id=9521b562836b487b83a5c9808332cecd)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:41:35.229492 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df09fa5-36e9-4ac1-9182-9e308785054e None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:41:35.231433 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 148/303] 10.222.0.57 () {56 vars in 1177 bytes} [Fri Sep 16 07:41:35 2022] GET /identity/v3/users/9521b562836b487b83a5c9808332cecd => generated 293 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:41:35.237693 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df09fa5-36e9-4ac1-9182-9e308785054e None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:41:35.321498 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:41:35.342945 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0a4a57-08c5-4e43-a323-6bc1fe31e910 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:41:35.346694 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df09fa5-36e9-4ac1-9182-9e308785054e None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:41:35.379209 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f787bf1-69ee-4a13-8b2e-edd78e9164f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:41:35.380186 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f787bf1-69ee-4a13-8b2e-edd78e9164f8 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:41:35.380640 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f787bf1-69ee-4a13-8b2e-edd78e9164f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:41:35.380940 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f787bf1-69ee-4a13-8b2e-edd78e9164f8 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:41:35.384467 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda5ba48-2b26-4946-9fff-4f83cf0a3852 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:41:35.385115 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda5ba48-2b26-4946-9fff-4f83cf0a3852 None admin] REQUEST_METHOD: `PUT` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:41:35.385391 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda5ba48-2b26-4946-9fff-4f83cf0a3852 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:41:35.385661 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda5ba48-2b26-4946-9fff-4f83cf0a3852 None admin] PATH_INFO: `/v3/system/users/9521b562836b487b83a5c9808332cecd/roles/4818d38cf2564825b312e66c9eb24762` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:41:35.387123 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda5ba48-2b26-4946-9fff-4f83cf0a3852 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=9521b562836b487b83a5c9808332cecd, role_id=4818d38cf2564825b312e66c9eb24762)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:41:35.388449 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda5ba48-2b26-4946-9fff-4f83cf0a3852 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:41:35.392607 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f787bf1-69ee-4a13-8b2e-edd78e9164f8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 07:41:35.398301 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 149/304] 10.222.0.57 () {58 vars in 1334 bytes} [Fri Sep 16 07:41:35 2022] PUT /identity/v3/system/users/9521b562836b487b83a5c9808332cecd/roles/4818d38cf2564825b312e66c9eb24762 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 16 07:41:35.406020 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda5ba48-2b26-4946-9fff-4f83cf0a3852 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:41:35.406118 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application [None req-2f787bf1-69ee-4a13-8b2e-edd78e9164f8 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 16 07:41:35.406118 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 07:41:35.406118 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 07:41:35.406118 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 07:41:35.406118 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 07:41:35.406118 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 07:41:35.406118 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 07:41:35.406118 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 07:41:35.406118 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 07:41:35.406118 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 07:41:35.406118 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 07:41:35.406118 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 07:41:35.406118 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 07:41:35.406118 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 07:41:35.406118 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 07:41:35.406118 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 07:41:35.406964 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 07:41:35.406964 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 07:41:35.406964 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 07:41:35.406964 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 07:41:35.406964 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 07:41:35.406964 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 07:41:35.406964 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 07:41:35.406964 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 07:41:35.406964 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 07:41:35.406964 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 07:41:35.406964 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 07:41:35.406964 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application with Lock( Sep 16 07:41:35.406964 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 07:41:35.406964 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._enter() Sep 16 07:41:35.406964 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 07:41:35.406964 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 07:41:35.407842 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 07:41:35.407842 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.creator() Sep 16 07:41:35.407842 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 07:41:35.407842 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application created_value = creator( Sep 16 07:41:35.407842 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 07:41:35.407842 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 07:41:35.407842 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 07:41:35.407842 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 07:41:35.407842 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 07:41:35.407842 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 07:41:35.407842 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 16 07:41:35.407842 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Sep 16 07:41:35.407842 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 156/305] 10.222.0.57 () {56 vars in 1099 bytes} [Fri Sep 16 07:41:35 2022] GET /identity/v3/roles/reader => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 16 07:41:35.407842 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f787bf1-69ee-4a13-8b2e-edd78e9164f8 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:41:35.497623 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:41:35.534551 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda5ba48-2b26-4946-9fff-4f83cf0a3852 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:41:35.557980 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f787bf1-69ee-4a13-8b2e-edd78e9164f8 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:41:35.577119 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46fae8a-32dc-475d-af48-10b074e0135c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:41:35.578565 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46fae8a-32dc-475d-af48-10b074e0135c None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:41:35.579052 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46fae8a-32dc-475d-af48-10b074e0135c None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:41:35.579334 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46fae8a-32dc-475d-af48-10b074e0135c None admin] PATH_INFO: `/v3/domains/default` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:41:35.580587 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46fae8a-32dc-475d-af48-10b074e0135c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:41:35.582090 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46fae8a-32dc-475d-af48-10b074e0135c None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:41:35.585789 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 150/306] 10.222.0.57 () {56 vars in 1108 bytes} [Fri Sep 16 07:41:35 2022] GET /identity/v3/domains/default => generated 199 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:41:35.585789 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70714ac4-69fc-4c9e-bfa0-008452ba50da None None] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:41:35.585789 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70714ac4-69fc-4c9e-bfa0-008452ba50da None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:41:35.585789 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70714ac4-69fc-4c9e-bfa0-008452ba50da None None] PATH_INFO: `/` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:41:35.589911 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 151/307] 10.222.0.57 () {54 vars in 927 bytes} [Fri Sep 16 07:41:35 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 07:41:35.589911 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70714ac4-69fc-4c9e-bfa0-008452ba50da None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:41:35.603229 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:41:35.606304 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bce9bc6-8d7a-4110-817f-3a4aa51c604a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:41:35.607111 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bce9bc6-8d7a-4110-817f-3a4aa51c604a None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:41:35.607376 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bce9bc6-8d7a-4110-817f-3a4aa51c604a None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:41:35.607678 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bce9bc6-8d7a-4110-817f-3a4aa51c604a None admin] PATH_INFO: `/v3/roles` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:41:35.608319 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bce9bc6-8d7a-4110-817f-3a4aa51c604a None admin] RBAC: Adding query filter params (name=reader) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:41:35.608656 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bce9bc6-8d7a-4110-817f-3a4aa51c604a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:41:35.610070 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bce9bc6-8d7a-4110-817f-3a4aa51c604a None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:41:35.620375 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 157/308] 10.222.0.57 () {56 vars in 1101 bytes} [Fri Sep 16 07:41:35 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:41:35.625743 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06431477-472d-4f32-a2e6-cfaa618f3146 None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:41:35.625743 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06431477-472d-4f32-a2e6-cfaa618f3146 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:41:35.625743 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06431477-472d-4f32-a2e6-cfaa618f3146 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:41:35.641691 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-06431477-472d-4f32-a2e6-cfaa618f3146 None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:41:35.642907 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-06431477-472d-4f32-a2e6-cfaa618f3146 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:41:35.709339 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 158/309] 10.222.0.57 () {58 vars in 1024 bytes} [Fri Sep 16 07:41:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 07:41:35.710216 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06431477-472d-4f32-a2e6-cfaa618f3146 None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:41:35.723871 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70714ac4-69fc-4c9e-bfa0-008452ba50da None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:41:35.777079 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e5b50f-3adb-455e-8828-9a154d88f747 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:41:35.777834 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e5b50f-3adb-455e-8828-9a154d88f747 None admin] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:41:35.778150 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e5b50f-3adb-455e-8828-9a154d88f747 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:41:35.778342 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:41:35.778488 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e5b50f-3adb-455e-8828-9a154d88f747 None admin] PATH_INFO: `/v3/groups` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:41:35.779227 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e5b50f-3adb-455e-8828-9a154d88f747 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:41:35.780796 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e5b50f-3adb-455e-8828-9a154d88f747 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:41:35.800495 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 152/310] 10.222.0.57 () {60 vars in 1134 bytes} [Fri Sep 16 07:41:35 2022] POST /identity/v3/groups => generated 229 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 07:41:35.849938 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06431477-472d-4f32-a2e6-cfaa618f3146 None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:41:35.892664 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3322e9-0cd6-468f-ae4e-c23b11f0be2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:41:35.893630 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3322e9-0cd6-468f-ae4e-c23b11f0be2d None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:41:35.894217 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3322e9-0cd6-468f-ae4e-c23b11f0be2d None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:41:35.894684 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3322e9-0cd6-468f-ae4e-c23b11f0be2d None admin] PATH_INFO: `/v3/users/0e385c0e4f3b4dcb97e02504baacdc18` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:41:35.911908 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3322e9-0cd6-468f-ae4e-c23b11f0be2d None admin] RBAC: Authorizing `identity:get_user(user_id=0e385c0e4f3b4dcb97e02504baacdc18)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:41:35.913396 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3322e9-0cd6-468f-ae4e-c23b11f0be2d None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:41:35.915538 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 159/311] 10.222.0.57 () {56 vars in 1177 bytes} [Fri Sep 16 07:41:35 2022] GET /identity/v3/users/0e385c0e4f3b4dcb97e02504baacdc18 => generated 293 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:41:35.922877 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e5b50f-3adb-455e-8828-9a154d88f747 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:41:35.994746 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3322e9-0cd6-468f-ae4e-c23b11f0be2d None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:41:36.005798 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:41:36.049082 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e5b50f-3adb-455e-8828-9a154d88f747 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:41:36.095909 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56fb773-7ff4-4a51-bf88-376f835ea7bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:41:36.096531 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56fb773-7ff4-4a51-bf88-376f835ea7bc None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:41:36.096808 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56fb773-7ff4-4a51-bf88-376f835ea7bc None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:41:36.097080 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56fb773-7ff4-4a51-bf88-376f835ea7bc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:41:36.097896 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56fb773-7ff4-4a51-bf88-376f835ea7bc None admin] RBAC: Adding query filter params (role.id=d4544aeb3a2940b08df3279eab1f529b, user.id=0e385c0e4f3b4dcb97e02504baacdc18, scope.system=all) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:41:36.098203 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56fb773-7ff4-4a51-bf88-376f835ea7bc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:41:36.104457 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56fb773-7ff4-4a51-bf88-376f835ea7bc None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:41:36.110841 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 153/312] 10.222.0.57 () {56 vars in 1308 bytes} [Fri Sep 16 07:41:35 2022] GET /identity/v3/role_assignments?user.id=0e385c0e4f3b4dcb97e02504baacdc18&scope.system=all&role.id=d4544aeb3a2940b08df3279eab1f529b => generated 226 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:41:36.122353 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3322e9-0cd6-468f-ae4e-c23b11f0be2d None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:41:36.132310 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:41:36.167202 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a601065-2966-4e0c-9086-352201c68bbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:41:36.167868 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a601065-2966-4e0c-9086-352201c68bbf None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:41:36.168148 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a601065-2966-4e0c-9086-352201c68bbf None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:41:36.168420 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a601065-2966-4e0c-9086-352201c68bbf None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:41:36.182020 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a601065-2966-4e0c-9086-352201c68bbf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 07:41:36.187827 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application [None req-8a601065-2966-4e0c-9086-352201c68bbf None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 16 07:41:36.187827 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 07:41:36.187827 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 07:41:36.187827 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 07:41:36.187827 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 07:41:36.187827 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 07:41:36.187827 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 07:41:36.187827 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 07:41:36.187827 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 07:41:36.187827 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 07:41:36.187827 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 07:41:36.187827 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 07:41:36.187827 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 07:41:36.187827 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 07:41:36.187827 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 07:41:36.187827 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 07:41:36.188800 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 07:41:36.188800 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 07:41:36.188800 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 07:41:36.188800 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 07:41:36.188800 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 07:41:36.188800 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 07:41:36.188800 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 07:41:36.188800 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 07:41:36.188800 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 07:41:36.188800 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 07:41:36.188800 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 07:41:36.188800 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application with Lock( Sep 16 07:41:36.188800 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 07:41:36.188800 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._enter() Sep 16 07:41:36.188800 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 07:41:36.188800 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 07:41:36.189603 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 07:41:36.189603 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.creator() Sep 16 07:41:36.189603 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 07:41:36.189603 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application created_value = creator( Sep 16 07:41:36.189603 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 07:41:36.189603 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 07:41:36.189603 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 07:41:36.189603 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 07:41:36.189603 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 07:41:36.189603 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 07:41:36.189603 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 16 07:41:36.189603 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Sep 16 07:41:36.189603 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 160/313] 10.222.0.57 () {56 vars in 1099 bytes} [Fri Sep 16 07:41:35 2022] GET /identity/v3/roles/reader => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 07:41:36.196860 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56fb773-7ff4-4a51-bf88-376f835ea7bc None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:41:36.310292 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56fb773-7ff4-4a51-bf88-376f835ea7bc None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:41:36.341833 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:41:36.349179 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e496f7c1-abd0-45b0-a7ca-e5d6271cbb8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:41:36.350222 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e496f7c1-abd0-45b0-a7ca-e5d6271cbb8f None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:41:36.350701 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e496f7c1-abd0-45b0-a7ca-e5d6271cbb8f None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:41:36.351169 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e496f7c1-abd0-45b0-a7ca-e5d6271cbb8f None admin] PATH_INFO: `/v3/roles` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:41:36.352053 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e496f7c1-abd0-45b0-a7ca-e5d6271cbb8f None admin] RBAC: Adding query filter params (name=reader) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:41:36.352583 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e496f7c1-abd0-45b0-a7ca-e5d6271cbb8f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:41:36.354453 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e496f7c1-abd0-45b0-a7ca-e5d6271cbb8f None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:41:36.365046 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 154/314] 10.222.0.57 () {56 vars in 1101 bytes} [Fri Sep 16 07:41:36 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:41:36.371031 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a601065-2966-4e0c-9086-352201c68bbf None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:41:36.477799 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a601065-2966-4e0c-9086-352201c68bbf None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:41:36.513034 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fff3ef-6ce1-4200-a591-066913724d46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:41:36.513666 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fff3ef-6ce1-4200-a591-066913724d46 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:41:36.513975 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fff3ef-6ce1-4200-a591-066913724d46 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:41:36.514265 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fff3ef-6ce1-4200-a591-066913724d46 None admin] PATH_INFO: `/v3/users/09540d9761da46299a6b98cd23a2a95c` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:41:36.515525 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12fff3ef-6ce1-4200-a591-066913724d46 None admin] RBAC: Authorizing `identity:get_user(user_id=09540d9761da46299a6b98cd23a2a95c)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:41:36.516974 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12fff3ef-6ce1-4200-a591-066913724d46 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:41:36.518920 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 161/315] 10.222.0.57 () {56 vars in 1177 bytes} [Fri Sep 16 07:41:36 2022] GET /identity/v3/users/09540d9761da46299a6b98cd23a2a95c => generated 297 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:41:36.524340 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e496f7c1-abd0-45b0-a7ca-e5d6271cbb8f None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:41:36.631491 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e496f7c1-abd0-45b0-a7ca-e5d6271cbb8f None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:41:36.669648 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6f19e7-0fce-4e90-b4df-725d838a448b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:41:36.670643 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6f19e7-0fce-4e90-b4df-725d838a448b None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:41:36.671190 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6f19e7-0fce-4e90-b4df-725d838a448b None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:41:36.671821 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6f19e7-0fce-4e90-b4df-725d838a448b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:41:36.741493 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:41:36.751324 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6f19e7-0fce-4e90-b4df-725d838a448b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:41:36.752788 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6f19e7-0fce-4e90-b4df-725d838a448b None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:41:36.860396 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 155/316] 10.222.0.57 () {58 vars in 1282 bytes} [Fri Sep 16 07:41:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 16 07:41:36.866809 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fff3ef-6ce1-4200-a591-066913724d46 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:41:36.901886 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:41:36.969692 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fff3ef-6ce1-4200-a591-066913724d46 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:41:37.009599 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c899ef3d-4263-4c14-afc8-68704da6310e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:41:37.010607 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c899ef3d-4263-4c14-afc8-68704da6310e None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:41:37.011109 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c899ef3d-4263-4c14-afc8-68704da6310e None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:41:37.011574 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c899ef3d-4263-4c14-afc8-68704da6310e None admin] PATH_INFO: `/v3/projects/421354d0cc9f4200b553561891fddc5d` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:41:37.012906 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c899ef3d-4263-4c14-afc8-68704da6310e None admin] RBAC: Authorizing `identity:get_project(project_id=421354d0cc9f4200b553561891fddc5d)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:41:37.014698 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c899ef3d-4263-4c14-afc8-68704da6310e None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:41:37.016714 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 162/317] 10.222.0.57 () {56 vars in 1186 bytes} [Fri Sep 16 07:41:36 2022] GET /identity/v3/projects/421354d0cc9f4200b553561891fddc5d => generated 302 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:41:37.026862 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6f19e7-0fce-4e90-b4df-725d838a448b None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:41:37.140131 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:41:37.149180 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6f19e7-0fce-4e90-b4df-725d838a448b None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:41:37.186022 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22003477-9de6-4b38-890a-ca7491853eec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:41:37.187051 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22003477-9de6-4b38-890a-ca7491853eec None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:41:37.187528 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22003477-9de6-4b38-890a-ca7491853eec None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:41:37.187997 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22003477-9de6-4b38-890a-ca7491853eec None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:41:37.188911 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22003477-9de6-4b38-890a-ca7491853eec None admin] RBAC: Adding query filter params (role.id=d4544aeb3a2940b08df3279eab1f529b, scope.project.id=421354d0cc9f4200b553561891fddc5d, user.id=09540d9761da46299a6b98cd23a2a95c) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:41:37.189435 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22003477-9de6-4b38-890a-ca7491853eec None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:41:37.191094 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22003477-9de6-4b38-890a-ca7491853eec None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:41:37.197834 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 156/318] 10.222.0.57 () {56 vars in 1374 bytes} [Fri Sep 16 07:41:37 2022] GET /identity/v3/role_assignments?user.id=09540d9761da46299a6b98cd23a2a95c&scope.project.id=421354d0cc9f4200b553561891fddc5d&role.id=d4544aeb3a2940b08df3279eab1f529b => generated 608 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:41:37.698472 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a44db2-a5c9-47b4-b431-299aa5e65b93 None None] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:41:37.698979 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a44db2-a5c9-47b4-b431-299aa5e65b93 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:41:37.699085 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a44db2-a5c9-47b4-b431-299aa5e65b93 None None] PATH_INFO: `/` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:41:37.700353 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 163/319] 10.222.0.57 () {54 vars in 927 bytes} [Fri Sep 16 07:41:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 07:41:37.706669 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668ddced-b98c-432f-86ed-a9113c38f808 None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:41:37.706988 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668ddced-b98c-432f-86ed-a9113c38f808 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:41:37.707327 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668ddced-b98c-432f-86ed-a9113c38f808 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:41:37.726469 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-668ddced-b98c-432f-86ed-a9113c38f808 None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:41:37.727655 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-668ddced-b98c-432f-86ed-a9113c38f808 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:41:37.799292 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 157/320] 10.222.0.57 () {58 vars in 1024 bytes} [Fri Sep 16 07:41:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 07:41:38.070938 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a44db2-a5c9-47b4-b431-299aa5e65b93 None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:41:38.075838 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566879a2-b045-49fc-84e3-b683d9dfc153 None None] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:41:38.076286 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566879a2-b045-49fc-84e3-b683d9dfc153 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:41:38.076476 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566879a2-b045-49fc-84e3-b683d9dfc153 None None] PATH_INFO: `/` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:41:38.078524 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 158/321] 10.222.0.57 () {54 vars in 927 bytes} [Fri Sep 16 07:41:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 16 07:41:38.083693 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20e2175-dbf7-4953-9d6f-9bdd226f6458 None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:41:38.083971 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20e2175-dbf7-4953-9d6f-9bdd226f6458 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:41:38.084245 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20e2175-dbf7-4953-9d6f-9bdd226f6458 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:41:38.103377 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-b20e2175-dbf7-4953-9d6f-9bdd226f6458 None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:41:38.104564 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-b20e2175-dbf7-4953-9d6f-9bdd226f6458 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:41:38.176488 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 159/322] 10.222.0.57 () {58 vars in 1024 bytes} [Fri Sep 16 07:41:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 16 07:41:38.185442 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a44db2-a5c9-47b4-b431-299aa5e65b93 None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:41:38.187550 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:41:38.222195 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a697c1f3-fbf1-486b-bdc0-f7e11175c72e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:41:38.222824 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a697c1f3-fbf1-486b-bdc0-f7e11175c72e None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:41:38.223104 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a697c1f3-fbf1-486b-bdc0-f7e11175c72e None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:41:38.223377 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a697c1f3-fbf1-486b-bdc0-f7e11175c72e None admin] PATH_INFO: `/v3/roles/member` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:41:38.233518 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a697c1f3-fbf1-486b-bdc0-f7e11175c72e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 07:41:38.238470 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application [None req-a697c1f3-fbf1-486b-bdc0-f7e11175c72e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 16 07:41:38.238470 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 07:41:38.238470 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 07:41:38.238470 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 07:41:38.238470 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 07:41:38.238470 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 07:41:38.238470 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 07:41:38.238470 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 07:41:38.238470 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 07:41:38.238470 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 07:41:38.238470 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 07:41:38.238470 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 07:41:38.238470 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 07:41:38.238470 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 07:41:38.238470 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 07:41:38.238470 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 07:41:38.239304 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 07:41:38.239304 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 07:41:38.239304 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 07:41:38.239304 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 07:41:38.239304 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 07:41:38.239304 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 07:41:38.239304 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 07:41:38.239304 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 07:41:38.239304 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 07:41:38.239304 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 07:41:38.239304 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 07:41:38.239304 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application with Lock( Sep 16 07:41:38.239304 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 07:41:38.239304 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._enter() Sep 16 07:41:38.239304 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 07:41:38.239304 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 07:41:38.240109 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 07:41:38.240109 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.creator() Sep 16 07:41:38.240109 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 07:41:38.240109 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application created_value = creator( Sep 16 07:41:38.240109 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 07:41:38.240109 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 07:41:38.240109 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 07:41:38.240109 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 07:41:38.240109 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 07:41:38.240109 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 07:41:38.240109 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 16 07:41:38.240109 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Sep 16 07:41:38.244541 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 164/323] 10.222.0.57 () {56 vars in 1099 bytes} [Fri Sep 16 07:41:38 2022] GET /identity/v3/roles/member => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 07:41:38.245388 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20e2175-dbf7-4953-9d6f-9bdd226f6458 None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:41:38.264331 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:41:38.348386 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20e2175-dbf7-4953-9d6f-9bdd226f6458 None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:41:38.385519 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32d7956-696c-4929-9c5e-ba5a34da2eae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:41:38.386156 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32d7956-696c-4929-9c5e-ba5a34da2eae None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:41:38.386435 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32d7956-696c-4929-9c5e-ba5a34da2eae None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:41:38.386704 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32d7956-696c-4929-9c5e-ba5a34da2eae None admin] PATH_INFO: `/v3/roles` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:41:38.387368 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32d7956-696c-4929-9c5e-ba5a34da2eae None admin] RBAC: Adding query filter params (name=member) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:41:38.387666 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32d7956-696c-4929-9c5e-ba5a34da2eae None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:41:38.389043 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32d7956-696c-4929-9c5e-ba5a34da2eae None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:41:38.398293 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 160/324] 10.222.0.57 () {56 vars in 1101 bytes} [Fri Sep 16 07:41:38 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 07:41:38.403840 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a697c1f3-fbf1-486b-bdc0-f7e11175c72e None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:41:38.445509 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32d7956-696c-4929-9c5e-ba5a34da2eae None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:41:38.506619 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a697c1f3-fbf1-486b-bdc0-f7e11175c72e None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:41:38.526303 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:41:38.540901 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436e1868-e308-434d-a0e6-c28478abb3e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:41:38.541527 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436e1868-e308-434d-a0e6-c28478abb3e6 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:41:38.541830 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436e1868-e308-434d-a0e6-c28478abb3e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:41:38.542103 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436e1868-e308-434d-a0e6-c28478abb3e6 None admin] PATH_INFO: `/v3/users/9521b562836b487b83a5c9808332cecd` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:41:38.543229 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436e1868-e308-434d-a0e6-c28478abb3e6 None admin] RBAC: Authorizing `identity:get_user(user_id=9521b562836b487b83a5c9808332cecd)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:41:38.544651 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436e1868-e308-434d-a0e6-c28478abb3e6 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:41:38.545888 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32d7956-696c-4929-9c5e-ba5a34da2eae None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:41:38.546268 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 165/325] 10.222.0.57 () {56 vars in 1177 bytes} [Fri Sep 16 07:41:38 2022] GET /identity/v3/users/9521b562836b487b83a5c9808332cecd => generated 293 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:41:38.551066 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a589b0-ab93-43b0-9c6a-7ae2addc9215 None None] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:41:38.551355 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a589b0-ab93-43b0-9c6a-7ae2addc9215 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:41:38.551628 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a589b0-ab93-43b0-9c6a-7ae2addc9215 None None] PATH_INFO: `/` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:41:38.552877 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 166/326] 10.222.0.57 () {54 vars in 927 bytes} [Fri Sep 16 07:41:38 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 07:41:38.553576 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a589b0-ab93-43b0-9c6a-7ae2addc9215 None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:41:38.581432 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc91d4d4-0805-4c0a-99c3-3e3eeef3a7de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:41:38.582078 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc91d4d4-0805-4c0a-99c3-3e3eeef3a7de None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:41:38.582350 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc91d4d4-0805-4c0a-99c3-3e3eeef3a7de None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:41:38.582622 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc91d4d4-0805-4c0a-99c3-3e3eeef3a7de None admin] PATH_INFO: `/v3/domains/default` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:41:38.583708 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc91d4d4-0805-4c0a-99c3-3e3eeef3a7de None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:41:38.583844 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:41:38.585206 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc91d4d4-0805-4c0a-99c3-3e3eeef3a7de None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:41:38.586773 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 161/327] 10.222.0.57 () {56 vars in 1108 bytes} [Fri Sep 16 07:41:38 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 07:41:38.586773 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e39da1-3b34-46a1-bccb-df21671bf55d None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:41:38.586773 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e39da1-3b34-46a1-bccb-df21671bf55d None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:41:38.586773 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e39da1-3b34-46a1-bccb-df21671bf55d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:41:38.606112 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-58e39da1-3b34-46a1-bccb-df21671bf55d None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:41:38.607314 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-58e39da1-3b34-46a1-bccb-df21671bf55d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:41:38.657462 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a589b0-ab93-43b0-9c6a-7ae2addc9215 None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:41:38.673068 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 162/328] 10.222.0.57 () {58 vars in 1024 bytes} [Fri Sep 16 07:41:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 07:41:38.673918 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e39da1-3b34-46a1-bccb-df21671bf55d None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:41:38.691425 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309fad2b-99be-4590-bed7-167b21fa820f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:41:38.692024 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309fad2b-99be-4590-bed7-167b21fa820f None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:41:38.692302 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309fad2b-99be-4590-bed7-167b21fa820f None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:41:38.692569 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309fad2b-99be-4590-bed7-167b21fa820f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:41:38.693284 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309fad2b-99be-4590-bed7-167b21fa820f None admin] RBAC: Adding query filter params (role.id=4818d38cf2564825b312e66c9eb24762, user.id=9521b562836b487b83a5c9808332cecd, scope.system=all) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:41:38.693574 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309fad2b-99be-4590-bed7-167b21fa820f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:41:38.695018 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309fad2b-99be-4590-bed7-167b21fa820f None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:41:38.708145 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 167/329] 10.222.0.57 () {56 vars in 1308 bytes} [Fri Sep 16 07:41:38 2022] GET /identity/v3/role_assignments?user.id=9521b562836b487b83a5c9808332cecd&scope.system=all&role.id=4818d38cf2564825b312e66c9eb24762 => generated 510 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:41:38.778293 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:41:38.803794 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e39da1-3b34-46a1-bccb-df21671bf55d None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:41:38.840540 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb6236e-48de-4fbb-a12e-3de090f48536 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:41:38.841165 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb6236e-48de-4fbb-a12e-3de090f48536 None admin] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:41:38.841444 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb6236e-48de-4fbb-a12e-3de090f48536 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:41:38.841715 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb6236e-48de-4fbb-a12e-3de090f48536 None admin] PATH_INFO: `/v3/groups` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:41:38.842371 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb6236e-48de-4fbb-a12e-3de090f48536 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:41:38.844233 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb6236e-48de-4fbb-a12e-3de090f48536 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:41:38.869839 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 163/330] 10.222.0.57 () {60 vars in 1134 bytes} [Fri Sep 16 07:41:38 2022] POST /identity/v3/groups => generated 226 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 07:41:38.955680 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309fad2b-99be-4590-bed7-167b21fa820f None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:41:39.049066 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:41:39.062213 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309fad2b-99be-4590-bed7-167b21fa820f None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:41:39.096409 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f75e562-38df-4c29-a00f-f16178ae7a37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:41:39.097046 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f75e562-38df-4c29-a00f-f16178ae7a37 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:41:39.097330 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f75e562-38df-4c29-a00f-f16178ae7a37 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:41:39.097611 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f75e562-38df-4c29-a00f-f16178ae7a37 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:41:39.108048 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f75e562-38df-4c29-a00f-f16178ae7a37 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 07:41:39.114153 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application [None req-0f75e562-38df-4c29-a00f-f16178ae7a37 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 16 07:41:39.114153 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 07:41:39.114153 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 07:41:39.114153 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 07:41:39.114153 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 07:41:39.114153 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 07:41:39.114153 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 07:41:39.114153 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 07:41:39.114153 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 07:41:39.114153 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 07:41:39.114153 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 07:41:39.114153 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 07:41:39.114153 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 07:41:39.114153 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 07:41:39.114153 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 07:41:39.114153 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 07:41:39.115017 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 07:41:39.115017 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 07:41:39.115017 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 07:41:39.115017 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 07:41:39.115017 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 07:41:39.115017 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 07:41:39.115017 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 07:41:39.115017 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 07:41:39.115017 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 07:41:39.115017 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 07:41:39.115017 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 07:41:39.115017 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application with Lock( Sep 16 07:41:39.115017 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 07:41:39.115017 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._enter() Sep 16 07:41:39.115017 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 07:41:39.115017 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 07:41:39.116098 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 07:41:39.116098 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.creator() Sep 16 07:41:39.116098 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 07:41:39.116098 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application created_value = creator( Sep 16 07:41:39.116098 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 07:41:39.116098 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 07:41:39.116098 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 07:41:39.116098 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 07:41:39.116098 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 07:41:39.116098 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 07:41:39.116098 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 16 07:41:39.116098 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Sep 16 07:41:39.116098 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 168/331] 10.222.0.57 () {56 vars in 1099 bytes} [Fri Sep 16 07:41:38 2022] GET /identity/v3/roles/reader => generated 84 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 07:41:39.121428 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb6236e-48de-4fbb-a12e-3de090f48536 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:41:39.234136 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb6236e-48de-4fbb-a12e-3de090f48536 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:41:39.269202 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8eb807-ac6a-4fc7-8026-b89f8424c817 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:41:39.270217 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8eb807-ac6a-4fc7-8026-b89f8424c817 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:41:39.270741 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8eb807-ac6a-4fc7-8026-b89f8424c817 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:41:39.271210 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8eb807-ac6a-4fc7-8026-b89f8424c817 None admin] PATH_INFO: `/v3/roles` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:41:39.272200 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8eb807-ac6a-4fc7-8026-b89f8424c817 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:41:39.272702 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8eb807-ac6a-4fc7-8026-b89f8424c817 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:41:39.274408 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8eb807-ac6a-4fc7-8026-b89f8424c817 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:41:39.280732 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:41:39.285921 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 164/332] 10.222.0.57 () {56 vars in 1101 bytes} [Fri Sep 16 07:41:39 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:41:39.292724 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f75e562-38df-4c29-a00f-f16178ae7a37 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:41:39.401359 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f75e562-38df-4c29-a00f-f16178ae7a37 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:41:39.436887 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0fc68b-59ed-4ab3-a362-036127b06d02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:41:39.437685 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0fc68b-59ed-4ab3-a362-036127b06d02 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:41:39.437996 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0fc68b-59ed-4ab3-a362-036127b06d02 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:41:39.438273 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0fc68b-59ed-4ab3-a362-036127b06d02 None admin] PATH_INFO: `/v3/users/0e385c0e4f3b4dcb97e02504baacdc18` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:41:39.439488 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0fc68b-59ed-4ab3-a362-036127b06d02 None admin] RBAC: Authorizing `identity:get_user(user_id=0e385c0e4f3b4dcb97e02504baacdc18)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:41:39.440948 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0fc68b-59ed-4ab3-a362-036127b06d02 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:41:39.442976 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 169/333] 10.222.0.57 () {56 vars in 1177 bytes} [Fri Sep 16 07:41:39 2022] GET /identity/v3/users/0e385c0e4f3b4dcb97e02504baacdc18 => generated 293 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:41:39.448847 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8eb807-ac6a-4fc7-8026-b89f8424c817 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:41:39.561674 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8eb807-ac6a-4fc7-8026-b89f8424c817 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:41:39.607041 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99cb926-635a-4f46-af3e-387e55e04230 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:41:39.608048 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99cb926-635a-4f46-af3e-387e55e04230 None admin] REQUEST_METHOD: `PUT` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:41:39.608564 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99cb926-635a-4f46-af3e-387e55e04230 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:41:39.609032 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99cb926-635a-4f46-af3e-387e55e04230 None admin] PATH_INFO: `/v3/system/users/0e385c0e4f3b4dcb97e02504baacdc18/roles/d4544aeb3a2940b08df3279eab1f529b` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:41:39.610916 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99cb926-635a-4f46-af3e-387e55e04230 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=0e385c0e4f3b4dcb97e02504baacdc18, role_id=d4544aeb3a2940b08df3279eab1f529b)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:41:39.612508 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99cb926-635a-4f46-af3e-387e55e04230 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:41:39.622670 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 165/334] 10.222.0.57 () {58 vars in 1334 bytes} [Fri Sep 16 07:41:39 2022] PUT /identity/v3/system/users/0e385c0e4f3b4dcb97e02504baacdc18/roles/d4544aeb3a2940b08df3279eab1f529b => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 07:41:41.720375 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba9a661-68c7-4372-b713-4a67dcf054a3 None None] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:41:41.721425 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba9a661-68c7-4372-b713-4a67dcf054a3 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:41:41.721971 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba9a661-68c7-4372-b713-4a67dcf054a3 None None] PATH_INFO: `/` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:41:41.723876 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 170/335] 10.222.0.57 () {54 vars in 927 bytes} [Fri Sep 16 07:41:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 07:41:41.725984 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea624b4d-3260-4179-81fd-2995eb501f43 None None] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:41:41.726775 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea624b4d-3260-4179-81fd-2995eb501f43 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:41:41.727268 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea624b4d-3260-4179-81fd-2995eb501f43 None None] PATH_INFO: `/` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:41:41.729141 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 166/336] 10.222.0.57 () {54 vars in 927 bytes} [Fri Sep 16 07:41:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 07:41:41.735039 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992b796c-f9e9-49e2-8d62-ad22a8e88712 None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:41:41.735686 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992b796c-f9e9-49e2-8d62-ad22a8e88712 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:41:41.736168 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992b796c-f9e9-49e2-8d62-ad22a8e88712 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:41:41.744280 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2086ca-e29a-4119-a82b-d58fb99bbca8 None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:41:41.754761 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2086ca-e29a-4119-a82b-d58fb99bbca8 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:41:41.755378 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2086ca-e29a-4119-a82b-d58fb99bbca8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:41:41.776403 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-992b796c-f9e9-49e2-8d62-ad22a8e88712 None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:41:41.778074 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-992b796c-f9e9-49e2-8d62-ad22a8e88712 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:41:41.789595 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-8b2086ca-e29a-4119-a82b-d58fb99bbca8 None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:41:41.794514 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-8b2086ca-e29a-4119-a82b-d58fb99bbca8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:41:41.801529 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:41:41.901296 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:41:41.909750 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 167/337] 10.222.0.57 () {58 vars in 1024 bytes} [Fri Sep 16 07:41:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 16 07:41:41.911765 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8d09ba-1939-4990-a123-6f836bb08924 None None] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:41:41.913187 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 171/338] 10.222.0.57 () {58 vars in 1024 bytes} [Fri Sep 16 07:41:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 07:41:41.913688 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8d09ba-1939-4990-a123-6f836bb08924 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:41:41.918376 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8d09ba-1939-4990-a123-6f836bb08924 None None] PATH_INFO: `/` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:41:41.919908 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 168/339] 10.222.0.57 () {54 vars in 927 bytes} [Fri Sep 16 07:41:41 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 07:41:41.925762 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debe6236-a639-43ca-874e-bb96f93d9ab0 None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:41:41.926319 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debe6236-a639-43ca-874e-bb96f93d9ab0 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:41:41.926791 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debe6236-a639-43ca-874e-bb96f93d9ab0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:41:41.954771 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-debe6236-a639-43ca-874e-bb96f93d9ab0 None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:41:41.956339 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-debe6236-a639-43ca-874e-bb96f93d9ab0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:41:42.048081 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 172/340] 10.222.0.57 () {58 vars in 1024 bytes} [Fri Sep 16 07:41:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 07:41:42.316310 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8d09ba-1939-4990-a123-6f836bb08924 None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:41:42.443367 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8d09ba-1939-4990-a123-6f836bb08924 None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:41:42.465712 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debe6236-a639-43ca-874e-bb96f93d9ab0 None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:41:42.503835 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad84678-da45-4a0d-9949-5c3c45978502 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:41:42.504480 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad84678-da45-4a0d-9949-5c3c45978502 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:41:42.504755 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad84678-da45-4a0d-9949-5c3c45978502 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:41:42.505025 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad84678-da45-4a0d-9949-5c3c45978502 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:41:42.528705 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad84678-da45-4a0d-9949-5c3c45978502 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 07:41:42.539278 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application [None req-1ad84678-da45-4a0d-9949-5c3c45978502 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 16 07:41:42.539278 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 07:41:42.539278 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 07:41:42.539278 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 07:41:42.539278 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 07:41:42.539278 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 07:41:42.539278 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 07:41:42.539278 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 07:41:42.539278 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 07:41:42.539278 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 07:41:42.539278 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 07:41:42.539278 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 07:41:42.539278 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 07:41:42.539278 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 07:41:42.539278 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 07:41:42.539278 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 07:41:42.540263 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 07:41:42.540263 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 07:41:42.540263 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 07:41:42.540263 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 07:41:42.540263 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 07:41:42.540263 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 07:41:42.540263 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 07:41:42.540263 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 07:41:42.540263 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 07:41:42.540263 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 07:41:42.540263 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 07:41:42.540263 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application with Lock( Sep 16 07:41:42.540263 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 07:41:42.540263 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._enter() Sep 16 07:41:42.540263 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 07:41:42.540263 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 07:41:42.541094 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 07:41:42.541094 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.creator() Sep 16 07:41:42.541094 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 07:41:42.541094 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application created_value = creator( Sep 16 07:41:42.541094 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 07:41:42.541094 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 07:41:42.541094 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 07:41:42.541094 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 07:41:42.541094 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 07:41:42.541094 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 07:41:42.541094 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 16 07:41:42.541094 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Sep 16 07:41:42.541742 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 169/341] 10.222.0.57 () {56 vars in 1114 bytes} [Fri Sep 16 07:41:42 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 07:41:42.542580 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad84678-da45-4a0d-9949-5c3c45978502 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:41:42.627080 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:41:42.642100 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:41:42.680286 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad84678-da45-4a0d-9949-5c3c45978502 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:41:42.687486 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debe6236-a639-43ca-874e-bb96f93d9ab0 None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:41:42.722504 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a655e6-5680-4da1-8d3b-cfa3660b64f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:41:42.723208 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a655e6-5680-4da1-8d3b-cfa3660b64f1 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:41:42.723486 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a655e6-5680-4da1-8d3b-cfa3660b64f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:41:42.723761 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a655e6-5680-4da1-8d3b-cfa3660b64f1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:41:42.738233 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a655e6-5680-4da1-8d3b-cfa3660b64f1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 07:41:42.744435 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application [None req-d0a655e6-5680-4da1-8d3b-cfa3660b64f1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 16 07:41:42.744435 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 07:41:42.744435 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 07:41:42.744435 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 07:41:42.744435 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 07:41:42.744435 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 07:41:42.744435 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 07:41:42.744435 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 07:41:42.744435 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 07:41:42.744435 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 07:41:42.744435 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 07:41:42.744435 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 07:41:42.744435 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 07:41:42.744435 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 07:41:42.744435 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 07:41:42.744435 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 07:41:42.745503 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 07:41:42.745503 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 07:41:42.745503 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 07:41:42.745503 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 07:41:42.745503 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 07:41:42.745503 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 07:41:42.745503 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 07:41:42.745503 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 07:41:42.745503 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 07:41:42.745503 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 07:41:42.745503 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 07:41:42.745503 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application with Lock( Sep 16 07:41:42.745503 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 07:41:42.745503 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._enter() Sep 16 07:41:42.745503 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 07:41:42.745503 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 07:41:42.746507 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 07:41:42.746507 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.creator() Sep 16 07:41:42.746507 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 07:41:42.746507 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application created_value = creator( Sep 16 07:41:42.746507 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 07:41:42.746507 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 07:41:42.746507 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 07:41:42.746507 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 07:41:42.746507 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 07:41:42.746507 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 07:41:42.746507 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 16 07:41:42.746507 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Sep 16 07:41:42.748396 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 170/342] 10.222.0.57 () {56 vars in 1099 bytes} [Fri Sep 16 07:41:42 2022] GET /identity/v3/roles/member => generated 84 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 07:41:42.754188 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a655e6-5680-4da1-8d3b-cfa3660b64f1 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:41:42.783068 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14910716-cc8f-41e7-b536-9e05b45b68ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:41:42.783725 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14910716-cc8f-41e7-b536-9e05b45b68ac None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:41:42.784004 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14910716-cc8f-41e7-b536-9e05b45b68ac None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:41:42.784271 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14910716-cc8f-41e7-b536-9e05b45b68ac None admin] PATH_INFO: `/v3/roles/member` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:41:42.818373 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14910716-cc8f-41e7-b536-9e05b45b68ac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 07:41:42.823305 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application [None req-14910716-cc8f-41e7-b536-9e05b45b68ac None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 16 07:41:42.823305 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 07:41:42.823305 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 07:41:42.823305 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 07:41:42.823305 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 07:41:42.823305 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 07:41:42.823305 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 07:41:42.823305 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 07:41:42.823305 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 07:41:42.823305 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 07:41:42.823305 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 07:41:42.823305 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 07:41:42.823305 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 07:41:42.823305 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 07:41:42.823305 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 07:41:42.823305 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 07:41:42.824402 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 07:41:42.824402 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 07:41:42.824402 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 07:41:42.824402 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 07:41:42.824402 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 07:41:42.824402 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 07:41:42.824402 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 07:41:42.824402 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 07:41:42.824402 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 07:41:42.824402 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 07:41:42.824402 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 07:41:42.824402 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application with Lock( Sep 16 07:41:42.824402 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 07:41:42.824402 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._enter() Sep 16 07:41:42.824402 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 07:41:42.824402 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 07:41:42.825542 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 07:41:42.825542 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.creator() Sep 16 07:41:42.825542 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 07:41:42.825542 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application created_value = creator( Sep 16 07:41:42.825542 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 07:41:42.825542 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 07:41:42.825542 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 07:41:42.825542 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 07:41:42.825542 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 07:41:42.825542 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 07:41:42.825542 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 16 07:41:42.825542 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Sep 16 07:41:42.825542 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 173/343] 10.222.0.57 () {56 vars in 1099 bytes} [Fri Sep 16 07:41:42 2022] GET /identity/v3/roles/member => generated 84 bytes in 360 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 07:41:42.825542 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14910716-cc8f-41e7-b536-9e05b45b68ac None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:41:42.875491 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a655e6-5680-4da1-8d3b-cfa3660b64f1 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:41:42.903697 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:41:42.942639 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5ce403-0426-4a7f-a933-a0863df45809 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:41:42.944637 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5ce403-0426-4a7f-a933-a0863df45809 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:41:42.945616 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5ce403-0426-4a7f-a933-a0863df45809 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:41:42.946278 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5ce403-0426-4a7f-a933-a0863df45809 None admin] PATH_INFO: `/v3/roles` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:41:42.948310 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5ce403-0426-4a7f-a933-a0863df45809 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:41:42.949282 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5ce403-0426-4a7f-a933-a0863df45809 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:41:42.953407 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5ce403-0426-4a7f-a933-a0863df45809 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:41:42.961453 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14910716-cc8f-41e7-b536-9e05b45b68ac None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:41:42.971897 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 171/344] 10.222.0.57 () {56 vars in 1111 bytes} [Fri Sep 16 07:41:42 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:41:42.973016 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5ce403-0426-4a7f-a933-a0863df45809 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:41:43.014953 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472ce6ff-db66-4f88-a94a-3eb5ca58c51a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:41:43.015994 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472ce6ff-db66-4f88-a94a-3eb5ca58c51a None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:41:43.016578 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472ce6ff-db66-4f88-a94a-3eb5ca58c51a None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:41:43.016700 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472ce6ff-db66-4f88-a94a-3eb5ca58c51a None admin] PATH_INFO: `/v3/roles` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:41:43.017465 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472ce6ff-db66-4f88-a94a-3eb5ca58c51a None admin] RBAC: Adding query filter params (name=member) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:41:43.017897 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472ce6ff-db66-4f88-a94a-3eb5ca58c51a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:41:43.019360 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472ce6ff-db66-4f88-a94a-3eb5ca58c51a None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:41:43.022472 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:41:43.037166 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 174/345] 10.222.0.57 () {56 vars in 1101 bytes} [Fri Sep 16 07:41:42 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:41:43.037166 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981ee4b5-34de-465a-a2cc-a03cb2af5bb2 None None] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:41:43.037166 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981ee4b5-34de-465a-a2cc-a03cb2af5bb2 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:41:43.037166 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981ee4b5-34de-465a-a2cc-a03cb2af5bb2 None None] PATH_INFO: `/` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:41:43.037989 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 175/346] 10.222.0.57 () {54 vars in 927 bytes} [Fri Sep 16 07:41:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 07:41:43.039432 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981ee4b5-34de-465a-a2cc-a03cb2af5bb2 None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:41:43.125803 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5ce403-0426-4a7f-a933-a0863df45809 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:41:43.173339 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5501e1ec-cee6-4450-886f-d54eca4011a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:41:43.173908 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5501e1ec-cee6-4450-886f-d54eca4011a2 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:41:43.174193 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5501e1ec-cee6-4450-886f-d54eca4011a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:41:43.174469 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5501e1ec-cee6-4450-886f-d54eca4011a2 None admin] PATH_INFO: `/v3/roles` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:41:43.175441 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5501e1ec-cee6-4450-886f-d54eca4011a2 None admin] RBAC: Adding query filter params (name=member) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:41:43.175627 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5501e1ec-cee6-4450-886f-d54eca4011a2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:41:43.177052 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5501e1ec-cee6-4450-886f-d54eca4011a2 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:41:43.187824 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 172/347] 10.222.0.57 () {56 vars in 1101 bytes} [Fri Sep 16 07:41:42 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:41:43.188751 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5501e1ec-cee6-4450-886f-d54eca4011a2 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:41:43.198124 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981ee4b5-34de-465a-a2cc-a03cb2af5bb2 None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:41:43.241998 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:41:43.255693 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737acffb-c8be-4432-b9c2-423e4459988d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:41:43.256668 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737acffb-c8be-4432-b9c2-423e4459988d None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:41:43.259000 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737acffb-c8be-4432-b9c2-423e4459988d None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:41:43.259599 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737acffb-c8be-4432-b9c2-423e4459988d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:41:43.322756 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5501e1ec-cee6-4450-886f-d54eca4011a2 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:41:43.351161 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:41:43.353615 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737acffb-c8be-4432-b9c2-423e4459988d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:41:43.356463 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737acffb-c8be-4432-b9c2-423e4459988d None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:41:43.375836 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbb0297-4667-4cbf-bf3b-7a5700391ed1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:41:43.375836 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbb0297-4667-4cbf-bf3b-7a5700391ed1 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:41:43.376135 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbb0297-4667-4cbf-bf3b-7a5700391ed1 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:41:43.376135 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbb0297-4667-4cbf-bf3b-7a5700391ed1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:41:43.464867 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbb0297-4667-4cbf-bf3b-7a5700391ed1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:41:43.466447 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbb0297-4667-4cbf-bf3b-7a5700391ed1 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:41:43.497850 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 176/348] 10.222.0.57 () {58 vars in 1282 bytes} [Fri Sep 16 07:41:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 459 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 16 07:41:43.499924 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3c5555-d26b-44dc-a1ff-746799c1cb88 None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:41:43.504828 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3c5555-d26b-44dc-a1ff-746799c1cb88 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:41:43.505214 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3c5555-d26b-44dc-a1ff-746799c1cb88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:41:43.519983 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:41:43.527488 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-fc3c5555-d26b-44dc-a1ff-746799c1cb88 None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:41:43.528999 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-fc3c5555-d26b-44dc-a1ff-746799c1cb88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:41:43.604958 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 173/349] 10.222.0.57 () {58 vars in 1282 bytes} [Fri Sep 16 07:41:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 16 07:41:43.606565 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbb0297-4667-4cbf-bf3b-7a5700391ed1 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:41:43.623206 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 177/350] 10.222.0.57 () {58 vars in 1024 bytes} [Fri Sep 16 07:41:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 07:41:43.623206 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4508a1-6fee-40e3-91a2-be22f359867b None None] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:41:43.623206 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4508a1-6fee-40e3-91a2-be22f359867b None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:41:43.623206 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4508a1-6fee-40e3-91a2-be22f359867b None None] PATH_INFO: `/` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:41:43.623206 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 178/351] 10.222.0.57 () {54 vars in 927 bytes} [Fri Sep 16 07:41:43 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 07:41:43.624463 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4508a1-6fee-40e3-91a2-be22f359867b None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:41:43.668080 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:41:43.752574 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbb0297-4667-4cbf-bf3b-7a5700391ed1 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:41:43.761040 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4508a1-6fee-40e3-91a2-be22f359867b None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:41:43.801581 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f168c1-6e9f-4034-a3c2-5433d9b982b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:41:43.802586 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f168c1-6e9f-4034-a3c2-5433d9b982b3 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:41:43.803076 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f168c1-6e9f-4034-a3c2-5433d9b982b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:41:43.803605 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f168c1-6e9f-4034-a3c2-5433d9b982b3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:41:43.809704 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e721be42-8f26-4840-9fa2-f21dba6e9766 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:41:43.810366 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e721be42-8f26-4840-9fa2-f21dba6e9766 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:41:43.810653 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e721be42-8f26-4840-9fa2-f21dba6e9766 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:41:43.810926 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e721be42-8f26-4840-9fa2-f21dba6e9766 None admin] PATH_INFO: `/v3/projects/5324c5a353924497b2d5372a26cbe6fc` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:41:43.812677 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e721be42-8f26-4840-9fa2-f21dba6e9766 None admin] RBAC: Authorizing `identity:get_project(project_id=5324c5a353924497b2d5372a26cbe6fc)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:41:43.814192 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e721be42-8f26-4840-9fa2-f21dba6e9766 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:41:43.815176 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:41:43.821203 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 179/352] 10.222.0.57 () {56 vars in 1186 bytes} [Fri Sep 16 07:41:43 2022] GET /identity/v3/projects/5324c5a353924497b2d5372a26cbe6fc => generated 298 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:41:43.821203 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e721be42-8f26-4840-9fa2-f21dba6e9766 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:41:43.896654 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f168c1-6e9f-4034-a3c2-5433d9b982b3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:41:43.898569 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f168c1-6e9f-4034-a3c2-5433d9b982b3 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:41:43.935845 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:41:43.951520 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e721be42-8f26-4840-9fa2-f21dba6e9766 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:41:43.992905 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e160549-f86d-42e4-a81f-a4d8ff74d2dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:41:43.993540 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e160549-f86d-42e4-a81f-a4d8ff74d2dc None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:41:43.993854 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e160549-f86d-42e4-a81f-a4d8ff74d2dc None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:41:43.994136 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e160549-f86d-42e4-a81f-a4d8ff74d2dc None admin] PATH_INFO: `/v3/projects/421354d0cc9f4200b553561891fddc5d` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:41:43.995271 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e160549-f86d-42e4-a81f-a4d8ff74d2dc None admin] RBAC: Authorizing `identity:get_project(project_id=421354d0cc9f4200b553561891fddc5d)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:41:43.996713 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e160549-f86d-42e4-a81f-a4d8ff74d2dc None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:41:43.998437 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 180/353] 10.222.0.57 () {56 vars in 1186 bytes} [Fri Sep 16 07:41:43 2022] GET /identity/v3/projects/421354d0cc9f4200b553561891fddc5d => generated 302 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:41:44.000404 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a5ad88-0d0a-4acf-acb0-496fba8d3486 None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:41:44.000689 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a5ad88-0d0a-4acf-acb0-496fba8d3486 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:41:44.001019 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a5ad88-0d0a-4acf-acb0-496fba8d3486 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:41:44.022635 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-93a5ad88-0d0a-4acf-acb0-496fba8d3486 None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:41:44.023739 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-93a5ad88-0d0a-4acf-acb0-496fba8d3486 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:41:44.026060 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 174/354] 10.222.0.57 () {58 vars in 1282 bytes} [Fri Sep 16 07:41:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 16 07:41:44.027266 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f168c1-6e9f-4034-a3c2-5433d9b982b3 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:41:44.072630 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:41:44.103607 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 181/355] 10.222.0.57 () {58 vars in 1024 bytes} [Fri Sep 16 07:41:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 07:41:44.106143 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16478c49-7070-4428-b213-c7af3b3e33ca None None] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:41:44.106241 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16478c49-7070-4428-b213-c7af3b3e33ca None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:41:44.106478 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16478c49-7070-4428-b213-c7af3b3e33ca None None] PATH_INFO: `/` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:41:44.107723 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 182/356] 10.222.0.57 () {54 vars in 927 bytes} [Fri Sep 16 07:41:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 07:41:44.108469 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16478c49-7070-4428-b213-c7af3b3e33ca None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:41:44.160579 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f168c1-6e9f-4034-a3c2-5433d9b982b3 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:41:44.210529 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e940708f-ff5e-4664-89c0-38b65655956b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:41:44.211166 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e940708f-ff5e-4664-89c0-38b65655956b None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:41:44.211442 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e940708f-ff5e-4664-89c0-38b65655956b None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:41:44.211715 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e940708f-ff5e-4664-89c0-38b65655956b None admin] PATH_INFO: `/v3/groups/8cc9f5e52d0844e7896878082629bf5d` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:41:44.219322 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e940708f-ff5e-4664-89c0-38b65655956b None admin] RBAC: Authorizing `identity:get_group(group_id=8cc9f5e52d0844e7896878082629bf5d)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:41:44.220832 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e940708f-ff5e-4664-89c0-38b65655956b None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:41:44.222714 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 175/357] 10.222.0.57 () {56 vars in 1180 bytes} [Fri Sep 16 07:41:44 2022] GET /identity/v3/groups/8cc9f5e52d0844e7896878082629bf5d => generated 226 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:41:44.223282 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e940708f-ff5e-4664-89c0-38b65655956b None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:41:44.238530 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:41:44.250141 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16478c49-7070-4428-b213-c7af3b3e33ca None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:41:44.295751 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df68dafd-c673-4fac-b2b3-ee878cefe6a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:41:44.296590 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df68dafd-c673-4fac-b2b3-ee878cefe6a4 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:41:44.296879 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df68dafd-c673-4fac-b2b3-ee878cefe6a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:41:44.297138 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df68dafd-c673-4fac-b2b3-ee878cefe6a4 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:41:44.312809 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df68dafd-c673-4fac-b2b3-ee878cefe6a4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 07:41:44.319106 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application [None req-df68dafd-c673-4fac-b2b3-ee878cefe6a4 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 16 07:41:44.319106 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 07:41:44.319106 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 07:41:44.319106 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 07:41:44.319106 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 07:41:44.319106 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 07:41:44.319106 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 07:41:44.319106 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 07:41:44.319106 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 07:41:44.319106 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 07:41:44.319106 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 07:41:44.319106 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 07:41:44.319106 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 07:41:44.319106 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 07:41:44.319106 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 07:41:44.319106 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 07:41:44.320018 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 07:41:44.320018 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 07:41:44.320018 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 07:41:44.320018 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 07:41:44.320018 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 07:41:44.320018 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 07:41:44.320018 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 07:41:44.320018 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 07:41:44.320018 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 07:41:44.320018 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 07:41:44.320018 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 07:41:44.320018 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application with Lock( Sep 16 07:41:44.320018 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 07:41:44.320018 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._enter() Sep 16 07:41:44.320018 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 07:41:44.320018 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 07:41:44.320824 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 07:41:44.320824 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.creator() Sep 16 07:41:44.320824 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 07:41:44.320824 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application created_value = creator( Sep 16 07:41:44.320824 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 07:41:44.320824 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 07:41:44.320824 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 07:41:44.320824 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 07:41:44.320824 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 07:41:44.320824 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 07:41:44.320824 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 16 07:41:44.320824 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Sep 16 07:41:44.320824 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 183/358] 10.222.0.57 () {56 vars in 1099 bytes} [Fri Sep 16 07:41:44 2022] GET /identity/v3/roles/reader => generated 84 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 07:41:44.321490 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df68dafd-c673-4fac-b2b3-ee878cefe6a4 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:41:44.351072 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e940708f-ff5e-4664-89c0-38b65655956b None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:41:44.353249 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:41:44.394462 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b682314f-dae0-4631-8278-24843730b1ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:41:44.395136 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b682314f-dae0-4631-8278-24843730b1ae None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:41:44.395410 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b682314f-dae0-4631-8278-24843730b1ae None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:41:44.395684 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b682314f-dae0-4631-8278-24843730b1ae None admin] PATH_INFO: `/v3/groups/8cc9f5e52d0844e7896878082629bf5d` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:41:44.396785 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b682314f-dae0-4631-8278-24843730b1ae None admin] RBAC: Authorizing `identity:get_group(group_id=8cc9f5e52d0844e7896878082629bf5d)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:41:44.398390 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b682314f-dae0-4631-8278-24843730b1ae None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:41:44.399960 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 176/359] 10.222.0.57 () {56 vars in 1180 bytes} [Fri Sep 16 07:41:44 2022] GET /identity/v3/groups/8cc9f5e52d0844e7896878082629bf5d => generated 226 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:41:44.401067 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e960fb0-2492-4174-b9d1-12de5963b13f None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:41:44.402055 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e960fb0-2492-4174-b9d1-12de5963b13f None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:41:44.402055 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e960fb0-2492-4174-b9d1-12de5963b13f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:41:44.425656 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-7e960fb0-2492-4174-b9d1-12de5963b13f None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:41:44.426881 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-7e960fb0-2492-4174-b9d1-12de5963b13f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:41:44.454019 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df68dafd-c673-4fac-b2b3-ee878cefe6a4 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:41:44.502256 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b77ac1-1e6c-4a7f-8d7f-9c3b52734a42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:41:44.502895 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b77ac1-1e6c-4a7f-8d7f-9c3b52734a42 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:41:44.503181 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b77ac1-1e6c-4a7f-8d7f-9c3b52734a42 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:41:44.503455 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b77ac1-1e6c-4a7f-8d7f-9c3b52734a42 None admin] PATH_INFO: `/v3/projects/5324c5a353924497b2d5372a26cbe6fc` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:41:44.504621 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b77ac1-1e6c-4a7f-8d7f-9c3b52734a42 None admin] RBAC: Authorizing `identity:get_project(project_id=5324c5a353924497b2d5372a26cbe6fc)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:41:44.506153 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b77ac1-1e6c-4a7f-8d7f-9c3b52734a42 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:41:44.508480 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 184/360] 10.222.0.57 () {56 vars in 1186 bytes} [Fri Sep 16 07:41:44 2022] GET /identity/v3/projects/5324c5a353924497b2d5372a26cbe6fc => generated 298 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:41:44.508792 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b77ac1-1e6c-4a7f-8d7f-9c3b52734a42 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:41:44.510964 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 177/361] 10.222.0.57 () {58 vars in 1024 bytes} [Fri Sep 16 07:41:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 07:41:44.511682 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e960fb0-2492-4174-b9d1-12de5963b13f None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:41:44.536896 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:41:44.644243 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:41:44.650375 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e960fb0-2492-4174-b9d1-12de5963b13f None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:41:44.650687 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b77ac1-1e6c-4a7f-8d7f-9c3b52734a42 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:41:44.694562 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b59b606-b057-4006-9083-e2c7f4e3e36f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:41:44.695173 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b59b606-b057-4006-9083-e2c7f4e3e36f None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:41:44.695455 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b59b606-b057-4006-9083-e2c7f4e3e36f None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:41:44.695725 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b59b606-b057-4006-9083-e2c7f4e3e36f None admin] PATH_INFO: `/v3/roles` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:41:44.696331 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb2c7d0-78ba-4dd7-a81e-9feadcd4ca60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:41:44.696442 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b59b606-b057-4006-9083-e2c7f4e3e36f None admin] RBAC: Adding query filter params (name=reader) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:41:44.696703 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b59b606-b057-4006-9083-e2c7f4e3e36f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:41:44.696943 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb2c7d0-78ba-4dd7-a81e-9feadcd4ca60 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:41:44.697221 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb2c7d0-78ba-4dd7-a81e-9feadcd4ca60 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:41:44.697494 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb2c7d0-78ba-4dd7-a81e-9feadcd4ca60 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:41:44.698746 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b59b606-b057-4006-9083-e2c7f4e3e36f None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:41:44.698859 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb2c7d0-78ba-4dd7-a81e-9feadcd4ca60 None admin] RBAC: Adding query filter params (group.id=8cc9f5e52d0844e7896878082629bf5d, role.id=e92664bc677b40769b7a05d102541bf0, scope.project.id=5324c5a353924497b2d5372a26cbe6fc) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:41:44.698859 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb2c7d0-78ba-4dd7-a81e-9feadcd4ca60 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:41:44.703354 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb2c7d0-78ba-4dd7-a81e-9feadcd4ca60 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:41:44.709696 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 178/362] 10.222.0.57 () {56 vars in 1101 bytes} [Fri Sep 16 07:41:44 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:41:44.710004 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 185/363] 10.222.0.57 () {56 vars in 1376 bytes} [Fri Sep 16 07:41:44 2022] GET /identity/v3/role_assignments?group.id=8cc9f5e52d0844e7896878082629bf5d&scope.project.id=5324c5a353924497b2d5372a26cbe6fc&role.id=e92664bc677b40769b7a05d102541bf0 => generated 260 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:41:44.711361 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b59b606-b057-4006-9083-e2c7f4e3e36f None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:41:44.711468 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb2c7d0-78ba-4dd7-a81e-9feadcd4ca60 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:41:44.822096 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:41:44.845051 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b59b606-b057-4006-9083-e2c7f4e3e36f None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:41:44.846302 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb2c7d0-78ba-4dd7-a81e-9feadcd4ca60 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:41:44.896014 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b803ca66-5938-47b9-9972-a07e5029a563 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:41:44.896228 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb35cd5-9fcc-41a3-a51d-bec0a86c2bf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:41:44.896734 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb35cd5-9fcc-41a3-a51d-bec0a86c2bf1 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:41:44.897016 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb35cd5-9fcc-41a3-a51d-bec0a86c2bf1 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:41:44.897291 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb35cd5-9fcc-41a3-a51d-bec0a86c2bf1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:41:44.897832 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b803ca66-5938-47b9-9972-a07e5029a563 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:41:44.898066 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb35cd5-9fcc-41a3-a51d-bec0a86c2bf1 None admin] RBAC: Adding query filter params (group.id=8cc9f5e52d0844e7896878082629bf5d, role.id=4818d38cf2564825b312e66c9eb24762, scope.project.id=421354d0cc9f4200b553561891fddc5d) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:41:44.898375 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb35cd5-9fcc-41a3-a51d-bec0a86c2bf1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:41:44.898713 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b803ca66-5938-47b9-9972-a07e5029a563 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:41:44.899171 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b803ca66-5938-47b9-9972-a07e5029a563 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:41:44.899822 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb35cd5-9fcc-41a3-a51d-bec0a86c2bf1 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:41:44.906612 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 186/364] 10.222.0.57 () {56 vars in 1376 bytes} [Fri Sep 16 07:41:44 2022] GET /identity/v3/role_assignments?group.id=8cc9f5e52d0844e7896878082629bf5d&scope.project.id=421354d0cc9f4200b553561891fddc5d&role.id=4818d38cf2564825b312e66c9eb24762 => generated 260 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:41:44.907466 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb35cd5-9fcc-41a3-a51d-bec0a86c2bf1 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:41:44.912845 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b803ca66-5938-47b9-9972-a07e5029a563 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 07:41:44.918777 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application [None req-b803ca66-5938-47b9-9972-a07e5029a563 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 16 07:41:44.918777 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 07:41:44.918777 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 07:41:44.918777 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 07:41:44.918777 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 07:41:44.918777 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 07:41:44.918777 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 07:41:44.918777 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 07:41:44.918777 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 07:41:44.918777 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 07:41:44.918777 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 07:41:44.918777 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 07:41:44.918777 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 07:41:44.918777 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 07:41:44.918777 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 07:41:44.918777 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 07:41:44.919752 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 07:41:44.919752 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 07:41:44.919752 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 07:41:44.919752 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 07:41:44.919752 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 07:41:44.919752 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 07:41:44.919752 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 07:41:44.919752 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 07:41:44.919752 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 07:41:44.919752 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 07:41:44.919752 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 07:41:44.919752 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application with Lock( Sep 16 07:41:44.919752 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 07:41:44.919752 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._enter() Sep 16 07:41:44.919752 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 07:41:44.919752 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 07:41:44.921113 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 07:41:44.921113 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.creator() Sep 16 07:41:44.921113 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 07:41:44.921113 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application created_value = creator( Sep 16 07:41:44.921113 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 07:41:44.921113 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 07:41:44.921113 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 07:41:44.921113 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 07:41:44.921113 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 07:41:44.921113 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 07:41:44.921113 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 16 07:41:44.921113 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Sep 16 07:41:44.921924 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 179/365] 10.222.0.57 () {56 vars in 1114 bytes} [Fri Sep 16 07:41:44 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 07:41:44.922701 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b803ca66-5938-47b9-9972-a07e5029a563 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:41:44.956324 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:41:45.060231 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb35cd5-9fcc-41a3-a51d-bec0a86c2bf1 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:41:45.073150 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b803ca66-5938-47b9-9972-a07e5029a563 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:41:45.120736 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7139ebb7-c552-4123-a176-c89f8ef617ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:41:45.122226 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7139ebb7-c552-4123-a176-c89f8ef617ff None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:41:45.122226 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7139ebb7-c552-4123-a176-c89f8ef617ff None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:41:45.122226 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7139ebb7-c552-4123-a176-c89f8ef617ff None admin] PATH_INFO: `/v3/users/0e385c0e4f3b4dcb97e02504baacdc18` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:41:45.123294 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7139ebb7-c552-4123-a176-c89f8ef617ff None admin] RBAC: Authorizing `identity:get_user(user_id=0e385c0e4f3b4dcb97e02504baacdc18)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:41:45.124479 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900c18ac-abbe-440e-9c8c-842cd40d0fc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:41:45.125322 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900c18ac-abbe-440e-9c8c-842cd40d0fc5 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:41:45.125542 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7139ebb7-c552-4123-a176-c89f8ef617ff None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:41:45.125642 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900c18ac-abbe-440e-9c8c-842cd40d0fc5 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:41:45.125907 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900c18ac-abbe-440e-9c8c-842cd40d0fc5 None admin] PATH_INFO: `/v3/groups/8cc9f5e52d0844e7896878082629bf5d` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:41:45.127878 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 180/366] 10.222.0.57 () {56 vars in 1177 bytes} [Fri Sep 16 07:41:44 2022] GET /identity/v3/users/0e385c0e4f3b4dcb97e02504baacdc18 => generated 293 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:41:45.128650 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7139ebb7-c552-4123-a176-c89f8ef617ff None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:41:45.132990 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900c18ac-abbe-440e-9c8c-842cd40d0fc5 None admin] RBAC: Authorizing `identity:get_group(group_id=8cc9f5e52d0844e7896878082629bf5d)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:41:45.132990 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900c18ac-abbe-440e-9c8c-842cd40d0fc5 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:41:45.132990 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 187/367] 10.222.0.57 () {56 vars in 1180 bytes} [Fri Sep 16 07:41:44 2022] GET /identity/v3/groups/8cc9f5e52d0844e7896878082629bf5d => generated 226 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:41:45.133715 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900c18ac-abbe-440e-9c8c-842cd40d0fc5 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:41:45.164451 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:41:45.246667 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:41:45.259676 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7139ebb7-c552-4123-a176-c89f8ef617ff None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:41:45.269732 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900c18ac-abbe-440e-9c8c-842cd40d0fc5 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:41:45.299815 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b267cfc-3b59-44c4-8980-de05c3a64e46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:41:45.300909 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b267cfc-3b59-44c4-8980-de05c3a64e46 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:41:45.301332 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b267cfc-3b59-44c4-8980-de05c3a64e46 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:41:45.301801 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b267cfc-3b59-44c4-8980-de05c3a64e46 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:41:45.313809 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc04bb8b-06f9-4571-a878-85c5b94ad306 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:41:45.316151 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc04bb8b-06f9-4571-a878-85c5b94ad306 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:41:45.316151 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc04bb8b-06f9-4571-a878-85c5b94ad306 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:41:45.316151 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc04bb8b-06f9-4571-a878-85c5b94ad306 None admin] PATH_INFO: `/v3/roles` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:41:45.316151 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc04bb8b-06f9-4571-a878-85c5b94ad306 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:41:45.316151 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc04bb8b-06f9-4571-a878-85c5b94ad306 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:41:45.318335 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b267cfc-3b59-44c4-8980-de05c3a64e46 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 07:41:45.318657 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc04bb8b-06f9-4571-a878-85c5b94ad306 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:41:45.326333 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application [None req-0b267cfc-3b59-44c4-8980-de05c3a64e46 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 16 07:41:45.326333 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 07:41:45.326333 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 07:41:45.326333 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 07:41:45.326333 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 07:41:45.326333 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 07:41:45.326333 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 07:41:45.326333 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 07:41:45.326333 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 07:41:45.326333 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 07:41:45.326333 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 07:41:45.326333 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 07:41:45.326333 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 07:41:45.326333 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 07:41:45.326333 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 07:41:45.326333 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 07:41:45.327940 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 07:41:45.327940 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 07:41:45.327940 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 07:41:45.327940 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 07:41:45.327940 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 07:41:45.327940 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 07:41:45.327940 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 07:41:45.327940 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 07:41:45.327940 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 07:41:45.327940 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 07:41:45.327940 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 07:41:45.327940 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application with Lock( Sep 16 07:41:45.327940 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 07:41:45.327940 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._enter() Sep 16 07:41:45.327940 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 07:41:45.327940 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 07:41:45.328758 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 07:41:45.328758 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.creator() Sep 16 07:41:45.328758 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 07:41:45.328758 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application created_value = creator( Sep 16 07:41:45.328758 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 07:41:45.328758 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 07:41:45.328758 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 07:41:45.328758 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 07:41:45.328758 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 07:41:45.328758 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 07:41:45.328758 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 16 07:41:45.328758 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Sep 16 07:41:45.330176 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 188/368] 10.222.0.57 () {56 vars in 1111 bytes} [Fri Sep 16 07:41:45 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:41:45.331198 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc04bb8b-06f9-4571-a878-85c5b94ad306 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:41:45.331349 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 181/369] 10.222.0.57 () {56 vars in 1096 bytes} [Fri Sep 16 07:41:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 07:41:45.332278 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b267cfc-3b59-44c4-8980-de05c3a64e46 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:41:45.451151 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:41:45.457110 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b267cfc-3b59-44c4-8980-de05c3a64e46 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:41:45.478413 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc04bb8b-06f9-4571-a878-85c5b94ad306 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:41:45.502504 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbeabf8-ab52-403a-b8e3-4c35c8ba7448 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:41:45.503111 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbeabf8-ab52-403a-b8e3-4c35c8ba7448 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:41:45.503392 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbeabf8-ab52-403a-b8e3-4c35c8ba7448 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:41:45.503664 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbeabf8-ab52-403a-b8e3-4c35c8ba7448 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:41:45.504384 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbeabf8-ab52-403a-b8e3-4c35c8ba7448 None admin] RBAC: Adding query filter params (group.id=8cc9f5e52d0844e7896878082629bf5d, role.id=4818d38cf2564825b312e66c9eb24762, scope.project.id=5324c5a353924497b2d5372a26cbe6fc) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:41:45.504704 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbeabf8-ab52-403a-b8e3-4c35c8ba7448 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:41:45.506168 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbeabf8-ab52-403a-b8e3-4c35c8ba7448 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:41:45.512284 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 182/370] 10.222.0.57 () {56 vars in 1376 bytes} [Fri Sep 16 07:41:45 2022] GET /identity/v3/role_assignments?group.id=8cc9f5e52d0844e7896878082629bf5d&scope.project.id=5324c5a353924497b2d5372a26cbe6fc&role.id=4818d38cf2564825b312e66c9eb24762 => generated 260 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:41:45.512919 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbeabf8-ab52-403a-b8e3-4c35c8ba7448 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:41:45.526413 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f8a55f-80da-4d54-bd66-b2c5b6cbf79a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:41:45.527434 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f8a55f-80da-4d54-bd66-b2c5b6cbf79a None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:41:45.527917 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f8a55f-80da-4d54-bd66-b2c5b6cbf79a None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:41:45.528405 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f8a55f-80da-4d54-bd66-b2c5b6cbf79a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:41:45.529368 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f8a55f-80da-4d54-bd66-b2c5b6cbf79a None admin] RBAC: Adding query filter params (role.id=d4544aeb3a2940b08df3279eab1f529b, user.id=0e385c0e4f3b4dcb97e02504baacdc18, scope.system=all) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:41:45.530550 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f8a55f-80da-4d54-bd66-b2c5b6cbf79a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:41:45.532621 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f8a55f-80da-4d54-bd66-b2c5b6cbf79a None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:41:45.545188 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:41:45.553322 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 189/371] 10.222.0.57 () {56 vars in 1308 bytes} [Fri Sep 16 07:41:45 2022] GET /identity/v3/role_assignments?user.id=0e385c0e4f3b4dcb97e02504baacdc18&scope.system=all&role.id=d4544aeb3a2940b08df3279eab1f529b => generated 510 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:41:45.559627 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f8a55f-80da-4d54-bd66-b2c5b6cbf79a None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:41:45.755540 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbeabf8-ab52-403a-b8e3-4c35c8ba7448 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:41:45.782621 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f8a55f-80da-4d54-bd66-b2c5b6cbf79a None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:41:45.845666 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c216ac-4c8f-48a1-ae49-d7deb28fc079 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:41:45.846367 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c216ac-4c8f-48a1-ae49-d7deb28fc079 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:41:45.846607 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c216ac-4c8f-48a1-ae49-d7deb28fc079 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:41:45.846881 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c216ac-4c8f-48a1-ae49-d7deb28fc079 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:41:45.849925 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6515dcc7-a411-4edb-b282-cf46ea535975 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:41:45.851139 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6515dcc7-a411-4edb-b282-cf46ea535975 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:41:45.851732 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6515dcc7-a411-4edb-b282-cf46ea535975 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:41:45.852212 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6515dcc7-a411-4edb-b282-cf46ea535975 None admin] PATH_INFO: `/v3/roles` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:41:45.853092 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6515dcc7-a411-4edb-b282-cf46ea535975 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:41:45.853599 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6515dcc7-a411-4edb-b282-cf46ea535975 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:41:45.855309 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6515dcc7-a411-4edb-b282-cf46ea535975 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:41:45.866400 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:41:45.874219 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 190/372] 10.222.0.57 () {56 vars in 1099 bytes} [Fri Sep 16 07:41:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 320 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:41:45.880267 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6515dcc7-a411-4edb-b282-cf46ea535975 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:41:45.944361 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c216ac-4c8f-48a1-ae49-d7deb28fc079 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:41:45.946037 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c216ac-4c8f-48a1-ae49-d7deb28fc079 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:41:45.963744 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:41:46.066328 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 183/373] 10.222.0.57 () {58 vars in 1282 bytes} [Fri Sep 16 07:41:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 553 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 16 07:41:46.074886 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c216ac-4c8f-48a1-ae49-d7deb28fc079 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:41:46.112555 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6515dcc7-a411-4edb-b282-cf46ea535975 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:41:46.160141 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b44b85-2804-4058-9e7a-491649a7f549 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:41:46.161200 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b44b85-2804-4058-9e7a-491649a7f549 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:41:46.162813 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b44b85-2804-4058-9e7a-491649a7f549 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:41:46.163282 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b44b85-2804-4058-9e7a-491649a7f549 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:41:46.247289 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c216ac-4c8f-48a1-ae49-d7deb28fc079 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:41:46.276576 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:41:46.283663 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:41:46.289247 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b44b85-2804-4058-9e7a-491649a7f549 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:41:46.290744 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b44b85-2804-4058-9e7a-491649a7f549 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:41:46.320985 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f359d695-f800-41f8-8eec-cbfc9aa0142f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:41:46.321540 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f359d695-f800-41f8-8eec-cbfc9aa0142f None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:41:46.321843 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f359d695-f800-41f8-8eec-cbfc9aa0142f None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:41:46.322108 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f359d695-f800-41f8-8eec-cbfc9aa0142f None admin] PATH_INFO: `/v3/projects/421354d0cc9f4200b553561891fddc5d` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:41:46.324509 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f359d695-f800-41f8-8eec-cbfc9aa0142f None admin] RBAC: Authorizing `identity:get_project(project_id=421354d0cc9f4200b553561891fddc5d)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:41:46.325972 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f359d695-f800-41f8-8eec-cbfc9aa0142f None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:41:46.332539 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 184/374] 10.222.0.57 () {56 vars in 1186 bytes} [Fri Sep 16 07:41:46 2022] GET /identity/v3/projects/421354d0cc9f4200b553561891fddc5d => generated 302 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:41:46.333389 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f359d695-f800-41f8-8eec-cbfc9aa0142f None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:41:46.456764 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 191/375] 10.222.0.57 () {58 vars in 1282 bytes} [Fri Sep 16 07:41:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 577 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 16 07:41:46.462385 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b44b85-2804-4058-9e7a-491649a7f549 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:41:46.547100 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f359d695-f800-41f8-8eec-cbfc9aa0142f None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:41:46.616103 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4603c8-89e4-48e2-863f-5646e992033d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:41:46.616745 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4603c8-89e4-48e2-863f-5646e992033d None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:41:46.617023 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4603c8-89e4-48e2-863f-5646e992033d None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:41:46.617292 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4603c8-89e4-48e2-863f-5646e992033d None admin] PATH_INFO: `/v3/groups/8cc9f5e52d0844e7896878082629bf5d` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:41:46.619058 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4603c8-89e4-48e2-863f-5646e992033d None admin] RBAC: Authorizing `identity:get_group(group_id=8cc9f5e52d0844e7896878082629bf5d)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:41:46.620484 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4603c8-89e4-48e2-863f-5646e992033d None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:41:46.626078 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 185/376] 10.222.0.57 () {56 vars in 1180 bytes} [Fri Sep 16 07:41:46 2022] GET /identity/v3/groups/8cc9f5e52d0844e7896878082629bf5d => generated 226 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:41:46.628154 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:41:46.631890 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b44b85-2804-4058-9e7a-491649a7f549 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:41:46.633716 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4603c8-89e4-48e2-863f-5646e992033d None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:41:46.676058 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1095d42-a23a-4666-b45f-19fe81c27f68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:41:46.676705 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1095d42-a23a-4666-b45f-19fe81c27f68 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:41:46.676989 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1095d42-a23a-4666-b45f-19fe81c27f68 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:41:46.677567 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1095d42-a23a-4666-b45f-19fe81c27f68 None admin] PATH_INFO: `/v3/projects/ca665dd48e60491fbe57a7dec14fd437` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:41:46.679184 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1095d42-a23a-4666-b45f-19fe81c27f68 None admin] RBAC: Authorizing `identity:get_project(project_id=ca665dd48e60491fbe57a7dec14fd437)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:41:46.681108 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1095d42-a23a-4666-b45f-19fe81c27f68 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:41:46.683371 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 192/377] 10.222.0.57 () {56 vars in 1186 bytes} [Fri Sep 16 07:41:46 2022] GET /identity/v3/projects/ca665dd48e60491fbe57a7dec14fd437 => generated 344 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 07:41:46.691628 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1095d42-a23a-4666-b45f-19fe81c27f68 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:41:46.730303 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:41:46.812018 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4603c8-89e4-48e2-863f-5646e992033d None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:41:46.853681 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b8827e-ae19-4540-ab2e-e677e3307c3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:41:46.855026 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b8827e-ae19-4540-ab2e-e677e3307c3e None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:41:46.855312 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b8827e-ae19-4540-ab2e-e677e3307c3e None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:41:46.855584 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b8827e-ae19-4540-ab2e-e677e3307c3e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:41:46.856313 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b8827e-ae19-4540-ab2e-e677e3307c3e None admin] RBAC: Adding query filter params (group.id=8cc9f5e52d0844e7896878082629bf5d, role.id=e92664bc677b40769b7a05d102541bf0, scope.project.id=421354d0cc9f4200b553561891fddc5d) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:41:46.856619 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b8827e-ae19-4540-ab2e-e677e3307c3e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:41:46.858635 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b8827e-ae19-4540-ab2e-e677e3307c3e None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:41:46.862652 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1095d42-a23a-4666-b45f-19fe81c27f68 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:41:46.874199 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 186/378] 10.222.0.57 () {56 vars in 1376 bytes} [Fri Sep 16 07:41:46 2022] GET /identity/v3/role_assignments?group.id=8cc9f5e52d0844e7896878082629bf5d&scope.project.id=421354d0cc9f4200b553561891fddc5d&role.id=e92664bc677b40769b7a05d102541bf0 => generated 260 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 07:41:46.906101 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb9f6c9-73b3-4626-b4ff-6a8937576ca0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:41:46.906780 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb9f6c9-73b3-4626-b4ff-6a8937576ca0 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:41:46.907067 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb9f6c9-73b3-4626-b4ff-6a8937576ca0 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:41:46.907342 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb9f6c9-73b3-4626-b4ff-6a8937576ca0 None admin] PATH_INFO: `/v3/groups/5a0deafc19234dd38c37724addae93ed` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:41:46.914276 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb9f6c9-73b3-4626-b4ff-6a8937576ca0 None admin] RBAC: Authorizing `identity:get_group(group_id=5a0deafc19234dd38c37724addae93ed)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:41:46.915765 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb9f6c9-73b3-4626-b4ff-6a8937576ca0 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:41:46.917852 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 193/379] 10.222.0.57 () {56 vars in 1180 bytes} [Fri Sep 16 07:41:46 2022] GET /identity/v3/groups/5a0deafc19234dd38c37724addae93ed => generated 229 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:41:46.927004 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b8827e-ae19-4540-ab2e-e677e3307c3e None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:41:47.039306 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b8827e-ae19-4540-ab2e-e677e3307c3e None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:41:47.059211 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:41:47.079565 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce646bd9-d0c2-4fbc-b2d0-c3dcb561012e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:41:47.080188 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce646bd9-d0c2-4fbc-b2d0-c3dcb561012e None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:41:47.080469 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce646bd9-d0c2-4fbc-b2d0-c3dcb561012e None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:41:47.080743 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce646bd9-d0c2-4fbc-b2d0-c3dcb561012e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:41:47.081485 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce646bd9-d0c2-4fbc-b2d0-c3dcb561012e None admin] RBAC: Adding query filter params (group.id=5a0deafc19234dd38c37724addae93ed, role.id=567db03c91854ad9af1e9a87ec1bd275, scope.project.id=ca665dd48e60491fbe57a7dec14fd437) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:41:47.082102 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce646bd9-d0c2-4fbc-b2d0-c3dcb561012e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:41:47.083626 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce646bd9-d0c2-4fbc-b2d0-c3dcb561012e None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:41:47.090096 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 187/380] 10.222.0.57 () {56 vars in 1376 bytes} [Fri Sep 16 07:41:46 2022] GET /identity/v3/role_assignments?group.id=5a0deafc19234dd38c37724addae93ed&scope.project.id=ca665dd48e60491fbe57a7dec14fd437&role.id=567db03c91854ad9af1e9a87ec1bd275 => generated 260 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:41:47.483760 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde413c6-7e7a-4d7c-b258-7d2e73af9dde None None] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:41:47.484199 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde413c6-7e7a-4d7c-b258-7d2e73af9dde None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:41:47.484549 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde413c6-7e7a-4d7c-b258-7d2e73af9dde None None] PATH_INFO: `/` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:41:47.486256 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 194/381] 10.222.0.57 () {54 vars in 927 bytes} [Fri Sep 16 07:41:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 07:41:47.491504 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd5f8d2-2bf4-4bd2-af8f-1c94f68d301b None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:41:47.491862 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd5f8d2-2bf4-4bd2-af8f-1c94f68d301b None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:41:47.492199 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd5f8d2-2bf4-4bd2-af8f-1c94f68d301b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:41:47.511395 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-4fd5f8d2-2bf4-4bd2-af8f-1c94f68d301b None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:41:47.512575 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-4fd5f8d2-2bf4-4bd2-af8f-1c94f68d301b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:41:47.539224 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e3ea84-cbff-4dd4-ad39-bd3750dc3e5d None None] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:41:47.539557 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e3ea84-cbff-4dd4-ad39-bd3750dc3e5d None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:41:47.539772 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e3ea84-cbff-4dd4-ad39-bd3750dc3e5d None None] PATH_INFO: `/` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:41:47.541242 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 195/382] 10.222.0.57 () {54 vars in 927 bytes} [Fri Sep 16 07:41:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 07:41:47.551394 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e727470-7dc9-4a98-affa-e59d0da3f6c3 None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:41:47.551767 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e727470-7dc9-4a98-affa-e59d0da3f6c3 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:41:47.552142 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e727470-7dc9-4a98-affa-e59d0da3f6c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:41:47.575304 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-1e727470-7dc9-4a98-affa-e59d0da3f6c3 None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:41:47.576849 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-1e727470-7dc9-4a98-affa-e59d0da3f6c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:41:47.610180 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:41:47.628138 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 188/383] 10.222.0.57 () {58 vars in 1024 bytes} [Fri Sep 16 07:41:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 07:41:47.663366 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 196/384] 10.222.0.57 () {58 vars in 1024 bytes} [Fri Sep 16 07:41:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 16 07:41:47.970075 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd5f8d2-2bf4-4bd2-af8f-1c94f68d301b None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:41:47.983865 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e727470-7dc9-4a98-affa-e59d0da3f6c3 None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:41:48.129848 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd5f8d2-2bf4-4bd2-af8f-1c94f68d301b None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:41:48.140805 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:41:48.169199 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b7aeb1-5bb0-44c4-86f7-f8545505d012 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:41:48.170169 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b7aeb1-5bb0-44c4-86f7-f8545505d012 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:41:48.170602 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b7aeb1-5bb0-44c4-86f7-f8545505d012 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:41:48.171008 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b7aeb1-5bb0-44c4-86f7-f8545505d012 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:41:48.182059 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b7aeb1-5bb0-44c4-86f7-f8545505d012 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 07:41:48.187601 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application [None req-04b7aeb1-5bb0-44c4-86f7-f8545505d012 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 16 07:41:48.187601 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 07:41:48.187601 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 07:41:48.187601 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 07:41:48.187601 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 07:41:48.187601 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 07:41:48.187601 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 07:41:48.187601 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 07:41:48.187601 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 07:41:48.187601 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 07:41:48.187601 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 07:41:48.187601 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 07:41:48.187601 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 07:41:48.187601 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 07:41:48.187601 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 07:41:48.187601 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 07:41:48.188658 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 07:41:48.188658 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 07:41:48.188658 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 07:41:48.188658 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 07:41:48.188658 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 07:41:48.188658 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 07:41:48.188658 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 07:41:48.188658 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 07:41:48.188658 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 07:41:48.188658 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 07:41:48.188658 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 07:41:48.188658 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application with Lock( Sep 16 07:41:48.188658 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 07:41:48.188658 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._enter() Sep 16 07:41:48.188658 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 07:41:48.188658 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 07:41:48.189652 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 07:41:48.189652 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.creator() Sep 16 07:41:48.189652 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 07:41:48.189652 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application created_value = creator( Sep 16 07:41:48.189652 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 07:41:48.189652 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 07:41:48.189652 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 07:41:48.189652 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 07:41:48.189652 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 07:41:48.189652 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 07:41:48.189652 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 16 07:41:48.189652 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Sep 16 07:41:48.196318 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 189/385] 10.222.0.57 () {56 vars in 1099 bytes} [Fri Sep 16 07:41:47 2022] GET /identity/v3/roles/member => generated 84 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 07:41:48.197658 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b7aeb1-5bb0-44c4-86f7-f8545505d012 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:41:48.223766 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e727470-7dc9-4a98-affa-e59d0da3f6c3 None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:41:48.303549 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b7aeb1-5bb0-44c4-86f7-f8545505d012 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:41:48.318428 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b11496-f467-471f-901d-0fe99b027ccc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:41:48.319070 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b11496-f467-471f-901d-0fe99b027ccc None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:41:48.319519 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b11496-f467-471f-901d-0fe99b027ccc None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:41:48.319940 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b11496-f467-471f-901d-0fe99b027ccc None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:41:48.339346 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2774aa0d-629b-4674-bb0d-1d8eb20395f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:41:48.340164 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2774aa0d-629b-4674-bb0d-1d8eb20395f0 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:41:48.340603 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2774aa0d-629b-4674-bb0d-1d8eb20395f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:41:48.341023 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2774aa0d-629b-4674-bb0d-1d8eb20395f0 None admin] PATH_INFO: `/v3/roles` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:41:48.341851 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2774aa0d-629b-4674-bb0d-1d8eb20395f0 None admin] RBAC: Adding query filter params (name=member) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:41:48.342855 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2774aa0d-629b-4674-bb0d-1d8eb20395f0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:41:48.344404 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2774aa0d-629b-4674-bb0d-1d8eb20395f0 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:41:48.358375 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 190/386] 10.222.0.57 () {56 vars in 1101 bytes} [Fri Sep 16 07:41:48 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:41:48.359523 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b11496-f467-471f-901d-0fe99b027ccc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 07:41:48.360171 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2774aa0d-629b-4674-bb0d-1d8eb20395f0 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:41:48.364521 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application [None req-47b11496-f467-471f-901d-0fe99b027ccc None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 16 07:41:48.364521 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 07:41:48.364521 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 07:41:48.364521 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 07:41:48.364521 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 07:41:48.364521 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 07:41:48.364521 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 07:41:48.364521 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 07:41:48.364521 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 07:41:48.364521 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 07:41:48.364521 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 07:41:48.364521 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 07:41:48.364521 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 07:41:48.364521 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 07:41:48.364521 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 07:41:48.364521 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 07:41:48.365645 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 07:41:48.365645 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 07:41:48.365645 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 07:41:48.365645 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 07:41:48.365645 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 07:41:48.365645 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 07:41:48.365645 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 07:41:48.365645 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 07:41:48.365645 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 07:41:48.365645 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 07:41:48.365645 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 07:41:48.365645 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application with Lock( Sep 16 07:41:48.365645 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 07:41:48.365645 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._enter() Sep 16 07:41:48.365645 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 07:41:48.365645 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 07:41:48.366664 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 07:41:48.366664 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.creator() Sep 16 07:41:48.366664 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 07:41:48.366664 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application created_value = creator( Sep 16 07:41:48.366664 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 07:41:48.366664 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 07:41:48.366664 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 07:41:48.366664 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 07:41:48.366664 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 07:41:48.366664 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 07:41:48.366664 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 16 07:41:48.366664 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Sep 16 07:41:48.375482 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 197/387] 10.222.0.57 () {56 vars in 1114 bytes} [Fri Sep 16 07:41:47 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 392 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 07:41:48.380796 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b11496-f467-471f-901d-0fe99b027ccc None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:41:48.393005 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:41:48.449170 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:41:48.475077 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2774aa0d-629b-4674-bb0d-1d8eb20395f0 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:41:48.510147 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47085bf9-9478-4158-8533-2a778e3c8fbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:41:48.511043 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47085bf9-9478-4158-8533-2a778e3c8fbe None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:41:48.511457 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47085bf9-9478-4158-8533-2a778e3c8fbe None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:41:48.511865 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47085bf9-9478-4158-8533-2a778e3c8fbe None admin] PATH_INFO: `/v3/groups/8cc9f5e52d0844e7896878082629bf5d` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:41:48.513126 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47085bf9-9478-4158-8533-2a778e3c8fbe None admin] RBAC: Authorizing `identity:get_group(group_id=8cc9f5e52d0844e7896878082629bf5d)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:41:48.514852 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47085bf9-9478-4158-8533-2a778e3c8fbe None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:41:48.521136 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 191/388] 10.222.0.57 () {56 vars in 1180 bytes} [Fri Sep 16 07:41:48 2022] GET /identity/v3/groups/8cc9f5e52d0844e7896878082629bf5d => generated 226 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 07:41:48.522504 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47085bf9-9478-4158-8533-2a778e3c8fbe None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:41:48.604304 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b11496-f467-471f-901d-0fe99b027ccc None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:41:48.622498 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:41:48.626303 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47085bf9-9478-4158-8533-2a778e3c8fbe None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:41:48.648287 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af751f6-c9a0-4434-a385-559702ca6046 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:41:48.649504 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af751f6-c9a0-4434-a385-559702ca6046 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:41:48.650218 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af751f6-c9a0-4434-a385-559702ca6046 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:41:48.650632 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af751f6-c9a0-4434-a385-559702ca6046 None admin] PATH_INFO: `/v3/roles` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:41:48.651581 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af751f6-c9a0-4434-a385-559702ca6046 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:41:48.652350 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af751f6-c9a0-4434-a385-559702ca6046 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:41:48.654368 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af751f6-c9a0-4434-a385-559702ca6046 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:41:48.662830 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28dd5365-3727-47f3-87f4-63a1b494576f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:41:48.663454 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dd5365-3727-47f3-87f4-63a1b494576f None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:41:48.663729 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dd5365-3727-47f3-87f4-63a1b494576f None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:41:48.664004 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dd5365-3727-47f3-87f4-63a1b494576f None admin] PATH_INFO: `/v3/projects/421354d0cc9f4200b553561891fddc5d` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:41:48.665172 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28dd5365-3727-47f3-87f4-63a1b494576f None admin] RBAC: Authorizing `identity:get_project(project_id=421354d0cc9f4200b553561891fddc5d)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:41:48.666167 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 198/389] 10.222.0.57 () {56 vars in 1111 bytes} [Fri Sep 16 07:41:48 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:41:48.666621 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28dd5365-3727-47f3-87f4-63a1b494576f None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:41:48.667634 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d29109e-45f9-4623-a0a8-9325127ac9ad None None] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:41:48.668072 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d29109e-45f9-4623-a0a8-9325127ac9ad None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:41:48.668476 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d29109e-45f9-4623-a0a8-9325127ac9ad None None] PATH_INFO: `/` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:41:48.670754 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 199/390] 10.222.0.57 () {54 vars in 927 bytes} [Fri Sep 16 07:41:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 07:41:48.674134 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d29109e-45f9-4623-a0a8-9325127ac9ad None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:41:48.681217 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 192/391] 10.222.0.57 () {56 vars in 1186 bytes} [Fri Sep 16 07:41:48 2022] GET /identity/v3/projects/421354d0cc9f4200b553561891fddc5d => generated 302 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 07:41:48.681217 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f88096-a562-47cc-896c-180631f106a5 None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:41:48.681217 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f88096-a562-47cc-896c-180631f106a5 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:41:48.681217 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f88096-a562-47cc-896c-180631f106a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:41:48.698478 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-51f88096-a562-47cc-896c-180631f106a5 None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:41:48.699720 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-51f88096-a562-47cc-896c-180631f106a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:41:48.781387 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 193/392] 10.222.0.57 () {58 vars in 1024 bytes} [Fri Sep 16 07:41:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 16 07:41:48.782536 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f88096-a562-47cc-896c-180631f106a5 None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:41:48.791902 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:41:48.855549 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d29109e-45f9-4623-a0a8-9325127ac9ad None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:41:48.893712 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:41:48.901029 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f88096-a562-47cc-896c-180631f106a5 None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:41:48.940989 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a614502b-05ea-4b7d-b334-12bf9bdc1dc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:41:48.941956 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a614502b-05ea-4b7d-b334-12bf9bdc1dc6 None admin] REQUEST_METHOD: `PUT` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:41:48.942376 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a614502b-05ea-4b7d-b334-12bf9bdc1dc6 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:41:48.942788 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a614502b-05ea-4b7d-b334-12bf9bdc1dc6 None admin] PATH_INFO: `/v3/projects/421354d0cc9f4200b553561891fddc5d/groups/8cc9f5e52d0844e7896878082629bf5d/roles/4818d38cf2564825b312e66c9eb24762` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:41:48.944861 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a614502b-05ea-4b7d-b334-12bf9bdc1dc6 None admin] RBAC: Authorizing `identity:create_grant(project_id=421354d0cc9f4200b553561891fddc5d, group_id=8cc9f5e52d0844e7896878082629bf5d, role_id=4818d38cf2564825b312e66c9eb24762)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:41:48.946516 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a614502b-05ea-4b7d-b334-12bf9bdc1dc6 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:41:48.949103 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6f0dc7-ec25-4adf-af83-c8d726bc48d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:41:48.949755 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6f0dc7-ec25-4adf-af83-c8d726bc48d1 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:41:48.950043 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6f0dc7-ec25-4adf-af83-c8d726bc48d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:41:48.950535 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6f0dc7-ec25-4adf-af83-c8d726bc48d1 None admin] PATH_INFO: `/v3/groups/8cc9f5e52d0844e7896878082629bf5d` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:41:48.951499 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6f0dc7-ec25-4adf-af83-c8d726bc48d1 None admin] RBAC: Authorizing `identity:get_group(group_id=8cc9f5e52d0844e7896878082629bf5d)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:41:48.953024 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6f0dc7-ec25-4adf-af83-c8d726bc48d1 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:41:48.959424 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 200/393] 10.222.0.57 () {56 vars in 1180 bytes} [Fri Sep 16 07:41:48 2022] GET /identity/v3/groups/8cc9f5e52d0844e7896878082629bf5d => generated 226 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:41:48.960301 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6f0dc7-ec25-4adf-af83-c8d726bc48d1 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:41:48.978935 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 194/394] 10.222.0.57 () {58 vars in 1442 bytes} [Fri Sep 16 07:41:48 2022] PUT /identity/v3/projects/421354d0cc9f4200b553561891fddc5d/groups/8cc9f5e52d0844e7896878082629bf5d/roles/4818d38cf2564825b312e66c9eb24762 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 07:41:49.161953 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6f0dc7-ec25-4adf-af83-c8d726bc48d1 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:41:49.188948 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a614502b-05ea-4b7d-b334-12bf9bdc1dc6 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:41:49.224246 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9935ec9f-4720-4300-8b6b-06355802abfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:41:49.224893 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9935ec9f-4720-4300-8b6b-06355802abfd None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:41:49.225171 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9935ec9f-4720-4300-8b6b-06355802abfd None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:41:49.225444 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9935ec9f-4720-4300-8b6b-06355802abfd None admin] PATH_INFO: `/v3/projects/5324c5a353924497b2d5372a26cbe6fc` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:41:49.226611 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9935ec9f-4720-4300-8b6b-06355802abfd None admin] RBAC: Authorizing `identity:get_project(project_id=5324c5a353924497b2d5372a26cbe6fc)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:41:49.228120 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9935ec9f-4720-4300-8b6b-06355802abfd None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:41:49.230077 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 201/395] 10.222.0.57 () {56 vars in 1186 bytes} [Fri Sep 16 07:41:48 2022] GET /identity/v3/projects/5324c5a353924497b2d5372a26cbe6fc => generated 298 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:41:49.239427 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9935ec9f-4720-4300-8b6b-06355802abfd None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:41:49.269966 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:41:49.308638 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a614502b-05ea-4b7d-b334-12bf9bdc1dc6 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:41:49.344430 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfdf8d2-63a5-4e18-abf4-e71650d312bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:41:49.345416 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfdf8d2-63a5-4e18-abf4-e71650d312bb None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:41:49.345967 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfdf8d2-63a5-4e18-abf4-e71650d312bb None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:41:49.346455 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfdf8d2-63a5-4e18-abf4-e71650d312bb None admin] PATH_INFO: `/v3/roles/member` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:41:49.358092 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dfdf8d2-63a5-4e18-abf4-e71650d312bb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 07:41:49.363396 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application [None req-8dfdf8d2-63a5-4e18-abf4-e71650d312bb None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 16 07:41:49.363396 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 07:41:49.363396 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 07:41:49.363396 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 07:41:49.363396 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 07:41:49.363396 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 07:41:49.363396 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 07:41:49.363396 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 07:41:49.363396 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 07:41:49.363396 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 07:41:49.363396 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 07:41:49.363396 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 07:41:49.363396 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 07:41:49.363396 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 07:41:49.363396 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 07:41:49.363396 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 07:41:49.364280 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 07:41:49.364280 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 07:41:49.364280 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 07:41:49.364280 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 07:41:49.364280 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 07:41:49.364280 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 07:41:49.364280 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 07:41:49.364280 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 07:41:49.364280 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 07:41:49.364280 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 07:41:49.364280 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 07:41:49.364280 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application with Lock( Sep 16 07:41:49.364280 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 07:41:49.364280 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._enter() Sep 16 07:41:49.364280 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 07:41:49.364280 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 07:41:49.365078 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 07:41:49.365078 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.creator() Sep 16 07:41:49.365078 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 07:41:49.365078 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application created_value = creator( Sep 16 07:41:49.365078 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 07:41:49.365078 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 07:41:49.365078 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 07:41:49.365078 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 07:41:49.365078 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 07:41:49.365078 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 07:41:49.365078 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 16 07:41:49.365078 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Sep 16 07:41:49.367635 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 195/396] 10.222.0.57 () {56 vars in 1099 bytes} [Fri Sep 16 07:41:49 2022] GET /identity/v3/roles/member => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 16 07:41:49.373404 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfdf8d2-63a5-4e18-abf4-e71650d312bb None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:41:49.393999 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:41:49.409789 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9935ec9f-4720-4300-8b6b-06355802abfd None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:41:49.486063 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfdf8d2-63a5-4e18-abf4-e71650d312bb None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:41:49.518458 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba22d78-2079-46c0-aedd-515e2449e787 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:41:49.519143 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba22d78-2079-46c0-aedd-515e2449e787 None admin] REQUEST_METHOD: `PUT` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:41:49.519431 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba22d78-2079-46c0-aedd-515e2449e787 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:41:49.519707 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba22d78-2079-46c0-aedd-515e2449e787 None admin] PATH_INFO: `/v3/projects/5324c5a353924497b2d5372a26cbe6fc/groups/8cc9f5e52d0844e7896878082629bf5d/roles/e92664bc677b40769b7a05d102541bf0` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:41:49.523505 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ca9103-4481-4563-a71e-7ea9c95aad26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:41:49.524396 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ca9103-4481-4563-a71e-7ea9c95aad26 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:41:49.524876 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ca9103-4481-4563-a71e-7ea9c95aad26 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:41:49.525341 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ca9103-4481-4563-a71e-7ea9c95aad26 None admin] PATH_INFO: `/v3/roles` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:41:49.526245 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ca9103-4481-4563-a71e-7ea9c95aad26 None admin] RBAC: Adding query filter params (name=member) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:41:49.526478 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba22d78-2079-46c0-aedd-515e2449e787 None admin] RBAC: Authorizing `identity:create_grant(project_id=5324c5a353924497b2d5372a26cbe6fc, group_id=8cc9f5e52d0844e7896878082629bf5d, role_id=e92664bc677b40769b7a05d102541bf0)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:41:49.526969 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ca9103-4481-4563-a71e-7ea9c95aad26 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:41:49.527949 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba22d78-2079-46c0-aedd-515e2449e787 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:41:49.528765 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ca9103-4481-4563-a71e-7ea9c95aad26 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:41:49.538406 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 196/397] 10.222.0.57 () {56 vars in 1101 bytes} [Fri Sep 16 07:41:49 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 07:41:49.544479 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ca9103-4481-4563-a71e-7ea9c95aad26 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:41:49.556771 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 202/398] 10.222.0.57 () {58 vars in 1442 bytes} [Fri Sep 16 07:41:49 2022] PUT /identity/v3/projects/5324c5a353924497b2d5372a26cbe6fc/groups/8cc9f5e52d0844e7896878082629bf5d/roles/e92664bc677b40769b7a05d102541bf0 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 16 07:41:49.568092 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306fa26b-60a3-48d5-9ced-dd0b7f7d5eb3 None None] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:41:49.568417 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306fa26b-60a3-48d5-9ced-dd0b7f7d5eb3 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:41:49.568650 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306fa26b-60a3-48d5-9ced-dd0b7f7d5eb3 None None] PATH_INFO: `/` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:41:49.570297 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 203/399] 10.222.0.57 () {54 vars in 927 bytes} [Fri Sep 16 07:41:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 07:41:49.575364 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13286847-a382-4044-9c2b-89def588f2e8 None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:41:49.575720 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13286847-a382-4044-9c2b-89def588f2e8 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:41:49.575995 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13286847-a382-4044-9c2b-89def588f2e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:41:49.612222 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-13286847-a382-4044-9c2b-89def588f2e8 None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:41:49.613361 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-13286847-a382-4044-9c2b-89def588f2e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:41:49.714147 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:41:49.738468 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ca9103-4481-4563-a71e-7ea9c95aad26 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:41:49.784784 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 204/400] 10.222.0.57 () {58 vars in 1024 bytes} [Fri Sep 16 07:41:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 07:41:49.797488 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b79876-fb4c-4b5a-8693-dbed1a4a938d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:41:49.798529 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b79876-fb4c-4b5a-8693-dbed1a4a938d None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:41:49.799007 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b79876-fb4c-4b5a-8693-dbed1a4a938d None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:41:49.799497 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b79876-fb4c-4b5a-8693-dbed1a4a938d None admin] PATH_INFO: `/v3/groups/8cc9f5e52d0844e7896878082629bf5d` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:41:49.800812 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b79876-fb4c-4b5a-8693-dbed1a4a938d None admin] RBAC: Authorizing `identity:get_group(group_id=8cc9f5e52d0844e7896878082629bf5d)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:41:49.802483 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b79876-fb4c-4b5a-8693-dbed1a4a938d None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:41:49.804291 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 197/401] 10.222.0.57 () {56 vars in 1180 bytes} [Fri Sep 16 07:41:49 2022] GET /identity/v3/groups/8cc9f5e52d0844e7896878082629bf5d => generated 226 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 07:41:49.810086 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13286847-a382-4044-9c2b-89def588f2e8 None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:41:49.829163 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:41:49.835243 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e488a7f0-c062-46f6-99ac-ac87f730e1fd None None] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:41:49.835580 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e488a7f0-c062-46f6-99ac-ac87f730e1fd None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:41:49.835855 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e488a7f0-c062-46f6-99ac-ac87f730e1fd None None] PATH_INFO: `/` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:41:49.837711 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 198/402] 10.222.0.57 () {54 vars in 927 bytes} [Fri Sep 16 07:41:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 07:41:49.843974 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5442bb2-a532-41ab-b28d-40521542f18f None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:41:49.846056 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5442bb2-a532-41ab-b28d-40521542f18f None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:41:49.846341 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5442bb2-a532-41ab-b28d-40521542f18f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:41:49.878357 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-b5442bb2-a532-41ab-b28d-40521542f18f None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:41:49.879475 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-b5442bb2-a532-41ab-b28d-40521542f18f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:41:49.922116 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13286847-a382-4044-9c2b-89def588f2e8 None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:41:49.956220 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a02f70-cf60-4da1-85ae-372a9b05f523 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:41:49.956857 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a02f70-cf60-4da1-85ae-372a9b05f523 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:41:49.957132 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a02f70-cf60-4da1-85ae-372a9b05f523 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:41:49.957404 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a02f70-cf60-4da1-85ae-372a9b05f523 None admin] PATH_INFO: `/v3/projects/5324c5a353924497b2d5372a26cbe6fc` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:41:49.958937 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a02f70-cf60-4da1-85ae-372a9b05f523 None admin] RBAC: Authorizing `identity:get_project(project_id=5324c5a353924497b2d5372a26cbe6fc)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:41:49.960481 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a02f70-cf60-4da1-85ae-372a9b05f523 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:41:49.962614 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 205/403] 10.222.0.57 () {56 vars in 1186 bytes} [Fri Sep 16 07:41:49 2022] GET /identity/v3/projects/5324c5a353924497b2d5372a26cbe6fc => generated 298 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:41:49.968909 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a02f70-cf60-4da1-85ae-372a9b05f523 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:41:50.028381 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 199/404] 10.222.0.57 () {58 vars in 1024 bytes} [Fri Sep 16 07:41:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 16 07:41:50.094136 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:41:50.123220 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a02f70-cf60-4da1-85ae-372a9b05f523 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:41:50.157662 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5442bb2-a532-41ab-b28d-40521542f18f None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:41:50.176134 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e322879-e377-44a1-8fad-40354821eb70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:41:50.176809 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e322879-e377-44a1-8fad-40354821eb70 None admin] REQUEST_METHOD: `PUT` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:41:50.177084 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e322879-e377-44a1-8fad-40354821eb70 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:41:50.177356 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e322879-e377-44a1-8fad-40354821eb70 None admin] PATH_INFO: `/v3/projects/5324c5a353924497b2d5372a26cbe6fc/groups/8cc9f5e52d0844e7896878082629bf5d/roles/4818d38cf2564825b312e66c9eb24762` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:41:50.180227 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e322879-e377-44a1-8fad-40354821eb70 None admin] RBAC: Authorizing `identity:create_grant(project_id=5324c5a353924497b2d5372a26cbe6fc, group_id=8cc9f5e52d0844e7896878082629bf5d, role_id=4818d38cf2564825b312e66c9eb24762)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:41:50.181666 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e322879-e377-44a1-8fad-40354821eb70 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:41:50.204260 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 206/405] 10.222.0.57 () {58 vars in 1442 bytes} [Fri Sep 16 07:41:49 2022] PUT /identity/v3/projects/5324c5a353924497b2d5372a26cbe6fc/groups/8cc9f5e52d0844e7896878082629bf5d/roles/4818d38cf2564825b312e66c9eb24762 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 07:41:50.288266 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:41:50.324678 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5442bb2-a532-41ab-b28d-40521542f18f None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:41:50.342553 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e322879-e377-44a1-8fad-40354821eb70 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:41:50.402778 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4962cf9e-bdc4-443e-9d1a-a4bc15e0dd7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:41:50.403422 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4962cf9e-bdc4-443e-9d1a-a4bc15e0dd7a None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:41:50.403699 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4962cf9e-bdc4-443e-9d1a-a4bc15e0dd7a None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:41:50.403969 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4962cf9e-bdc4-443e-9d1a-a4bc15e0dd7a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:41:50.418195 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4962cf9e-bdc4-443e-9d1a-a4bc15e0dd7a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 07:41:50.424061 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application [None req-4962cf9e-bdc4-443e-9d1a-a4bc15e0dd7a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 16 07:41:50.424061 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 07:41:50.424061 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 07:41:50.424061 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 07:41:50.424061 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 07:41:50.424061 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 07:41:50.424061 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 07:41:50.424061 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 07:41:50.424061 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 07:41:50.424061 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 07:41:50.424061 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 07:41:50.424061 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 07:41:50.424061 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 07:41:50.424061 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 07:41:50.424061 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 07:41:50.424061 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 07:41:50.424977 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 07:41:50.424977 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 07:41:50.424977 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 07:41:50.424977 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 07:41:50.424977 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 07:41:50.424977 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 07:41:50.424977 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 07:41:50.424977 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 07:41:50.424977 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 07:41:50.424977 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 07:41:50.424977 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 07:41:50.424977 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application with Lock( Sep 16 07:41:50.424977 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 07:41:50.424977 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._enter() Sep 16 07:41:50.424977 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 07:41:50.424977 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 07:41:50.425797 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 07:41:50.425797 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.creator() Sep 16 07:41:50.425797 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 07:41:50.425797 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application created_value = creator( Sep 16 07:41:50.425797 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 07:41:50.425797 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 07:41:50.425797 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 07:41:50.425797 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 07:41:50.425797 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 07:41:50.425797 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 07:41:50.425797 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 16 07:41:50.425797 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Sep 16 07:41:50.425797 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 200/406] 10.222.0.57 () {56 vars in 1114 bytes} [Fri Sep 16 07:41:50 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 07:41:50.432709 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4962cf9e-bdc4-443e-9d1a-a4bc15e0dd7a None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:41:50.490376 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e322879-e377-44a1-8fad-40354821eb70 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:41:50.528373 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1d001c-f19d-4dac-8427-fe496abb76c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:41:50.529016 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1d001c-f19d-4dac-8427-fe496abb76c5 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:41:50.529868 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1d001c-f19d-4dac-8427-fe496abb76c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:41:50.530326 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1d001c-f19d-4dac-8427-fe496abb76c5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:41:50.538824 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:41:50.542778 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1d001c-f19d-4dac-8427-fe496abb76c5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 07:41:50.549934 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application [None req-1e1d001c-f19d-4dac-8427-fe496abb76c5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 16 07:41:50.549934 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 07:41:50.549934 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 07:41:50.549934 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 07:41:50.549934 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 07:41:50.549934 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 07:41:50.549934 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 07:41:50.549934 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 07:41:50.549934 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 07:41:50.549934 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 07:41:50.549934 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 07:41:50.549934 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 07:41:50.549934 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 07:41:50.549934 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 07:41:50.549934 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 07:41:50.549934 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 07:41:50.550876 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 07:41:50.550876 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 07:41:50.550876 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 07:41:50.550876 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 07:41:50.550876 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 07:41:50.550876 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 07:41:50.550876 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 07:41:50.550876 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 07:41:50.550876 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 07:41:50.550876 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 07:41:50.550876 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 07:41:50.550876 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application with Lock( Sep 16 07:41:50.550876 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 07:41:50.550876 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._enter() Sep 16 07:41:50.550876 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 07:41:50.550876 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 07:41:50.551677 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 07:41:50.551677 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.creator() Sep 16 07:41:50.551677 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 07:41:50.551677 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application created_value = creator( Sep 16 07:41:50.551677 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 07:41:50.551677 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 07:41:50.551677 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 07:41:50.551677 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 07:41:50.551677 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 07:41:50.551677 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 07:41:50.551677 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 16 07:41:50.551677 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Sep 16 07:41:50.558039 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 207/407] 10.222.0.57 () {56 vars in 1096 bytes} [Fri Sep 16 07:41:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 16 07:41:50.559527 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4962cf9e-bdc4-443e-9d1a-a4bc15e0dd7a None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:41:50.559990 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1d001c-f19d-4dac-8427-fe496abb76c5 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:41:50.600945 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20e1775-f385-42f7-999d-f925872688ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:41:50.602018 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20e1775-f385-42f7-999d-f925872688ab None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:41:50.602598 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20e1775-f385-42f7-999d-f925872688ab None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:41:50.603081 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20e1775-f385-42f7-999d-f925872688ab None admin] PATH_INFO: `/v3/roles` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:41:50.604007 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20e1775-f385-42f7-999d-f925872688ab None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:41:50.604519 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20e1775-f385-42f7-999d-f925872688ab None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:41:50.606249 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20e1775-f385-42f7-999d-f925872688ab None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:41:50.609585 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:41:50.618747 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 201/408] 10.222.0.57 () {56 vars in 1111 bytes} [Fri Sep 16 07:41:50 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 07:41:50.623925 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20e1775-f385-42f7-999d-f925872688ab None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:41:50.747869 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20e1775-f385-42f7-999d-f925872688ab None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:41:50.760105 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1d001c-f19d-4dac-8427-fe496abb76c5 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:41:50.790385 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380ef327-a1d5-4837-ba29-e9d0350036f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:41:50.791775 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380ef327-a1d5-4837-ba29-e9d0350036f7 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:41:50.792268 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380ef327-a1d5-4837-ba29-e9d0350036f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:41:50.792747 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380ef327-a1d5-4837-ba29-e9d0350036f7 None admin] PATH_INFO: `/v3/groups/8cc9f5e52d0844e7896878082629bf5d` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:41:50.794691 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380ef327-a1d5-4837-ba29-e9d0350036f7 None admin] RBAC: Authorizing `identity:get_group(group_id=8cc9f5e52d0844e7896878082629bf5d)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:41:50.797245 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380ef327-a1d5-4837-ba29-e9d0350036f7 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:41:50.800344 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 202/409] 10.222.0.57 () {56 vars in 1180 bytes} [Fri Sep 16 07:41:50 2022] GET /identity/v3/groups/8cc9f5e52d0844e7896878082629bf5d => generated 226 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 07:41:50.806030 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380ef327-a1d5-4837-ba29-e9d0350036f7 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:41:50.811556 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8addc137-b3ed-425b-91d4-2d4281af3a6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:41:50.812174 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8addc137-b3ed-425b-91d4-2d4281af3a6a None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:41:50.812458 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8addc137-b3ed-425b-91d4-2d4281af3a6a None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:41:50.812794 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8addc137-b3ed-425b-91d4-2d4281af3a6a None admin] PATH_INFO: `/v3/roles` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:41:50.813477 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8addc137-b3ed-425b-91d4-2d4281af3a6a None admin] RBAC: Adding query filter params (name=admin) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:41:50.813855 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8addc137-b3ed-425b-91d4-2d4281af3a6a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:41:50.815231 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8addc137-b3ed-425b-91d4-2d4281af3a6a None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:41:50.824212 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 208/410] 10.222.0.57 () {56 vars in 1099 bytes} [Fri Sep 16 07:41:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 07:41:50.830819 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8addc137-b3ed-425b-91d4-2d4281af3a6a None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:41:50.879945 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:41:50.919816 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380ef327-a1d5-4837-ba29-e9d0350036f7 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:41:50.954307 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:41:50.958565 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48530c2-8dd7-49b8-8622-3e00e5e00027 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:41:50.959460 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48530c2-8dd7-49b8-8622-3e00e5e00027 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:41:50.959973 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48530c2-8dd7-49b8-8622-3e00e5e00027 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:41:50.960452 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48530c2-8dd7-49b8-8622-3e00e5e00027 None admin] PATH_INFO: `/v3/projects/421354d0cc9f4200b553561891fddc5d` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:41:50.961841 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48530c2-8dd7-49b8-8622-3e00e5e00027 None admin] RBAC: Authorizing `identity:get_project(project_id=421354d0cc9f4200b553561891fddc5d)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:41:50.963768 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48530c2-8dd7-49b8-8622-3e00e5e00027 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:41:50.965626 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 203/411] 10.222.0.57 () {56 vars in 1186 bytes} [Fri Sep 16 07:41:50 2022] GET /identity/v3/projects/421354d0cc9f4200b553561891fddc5d => generated 302 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:41:50.972184 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48530c2-8dd7-49b8-8622-3e00e5e00027 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:41:51.044396 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8addc137-b3ed-425b-91d4-2d4281af3a6a None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:41:51.082608 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48530c2-8dd7-49b8-8622-3e00e5e00027 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:41:51.121217 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8408d74-300f-42ad-869a-eff800cadb36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:41:51.122270 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8408d74-300f-42ad-869a-eff800cadb36 None admin] REQUEST_METHOD: `PUT` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:41:51.122778 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8408d74-300f-42ad-869a-eff800cadb36 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:41:51.123292 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8408d74-300f-42ad-869a-eff800cadb36 None admin] PATH_INFO: `/v3/projects/421354d0cc9f4200b553561891fddc5d/groups/8cc9f5e52d0844e7896878082629bf5d/roles/e92664bc677b40769b7a05d102541bf0` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:41:51.125906 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8408d74-300f-42ad-869a-eff800cadb36 None admin] RBAC: Authorizing `identity:create_grant(project_id=421354d0cc9f4200b553561891fddc5d, group_id=8cc9f5e52d0844e7896878082629bf5d, role_id=e92664bc677b40769b7a05d102541bf0)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:41:51.127871 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8408d74-300f-42ad-869a-eff800cadb36 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:41:51.130340 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:41:51.136093 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6337e1-ac20-4284-a3a4-9c1aff923d35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:41:51.136805 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6337e1-ac20-4284-a3a4-9c1aff923d35 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:41:51.137085 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6337e1-ac20-4284-a3a4-9c1aff923d35 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:41:51.137358 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6337e1-ac20-4284-a3a4-9c1aff923d35 None admin] PATH_INFO: `/v3/groups/5a0deafc19234dd38c37724addae93ed` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:41:51.142559 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6337e1-ac20-4284-a3a4-9c1aff923d35 None admin] RBAC: Authorizing `identity:get_group(group_id=5a0deafc19234dd38c37724addae93ed)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:41:51.144013 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6337e1-ac20-4284-a3a4-9c1aff923d35 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:41:51.149746 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 209/413] 10.222.0.57 () {56 vars in 1180 bytes} [Fri Sep 16 07:41:50 2022] GET /identity/v3/groups/5a0deafc19234dd38c37724addae93ed => generated 229 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 07:41:51.150222 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 204/413] 10.222.0.57 () {58 vars in 1442 bytes} [Fri Sep 16 07:41:50 2022] PUT /identity/v3/projects/421354d0cc9f4200b553561891fddc5d/groups/8cc9f5e52d0844e7896878082629bf5d/roles/e92664bc677b40769b7a05d102541bf0 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 16 07:41:51.151266 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6337e1-ac20-4284-a3a4-9c1aff923d35 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:41:51.311824 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6337e1-ac20-4284-a3a4-9c1aff923d35 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:41:51.340675 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:41:51.354416 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3361669f-b3c4-4336-a84c-a55f30951bd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:41:51.355054 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3361669f-b3c4-4336-a84c-a55f30951bd3 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:41:51.355333 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3361669f-b3c4-4336-a84c-a55f30951bd3 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:41:51.355601 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3361669f-b3c4-4336-a84c-a55f30951bd3 None admin] PATH_INFO: `/v3/projects/ca665dd48e60491fbe57a7dec14fd437` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:41:51.356753 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3361669f-b3c4-4336-a84c-a55f30951bd3 None admin] RBAC: Authorizing `identity:get_project(project_id=ca665dd48e60491fbe57a7dec14fd437)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:41:51.358352 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3361669f-b3c4-4336-a84c-a55f30951bd3 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:41:51.360295 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 210/414] 10.222.0.57 () {56 vars in 1186 bytes} [Fri Sep 16 07:41:51 2022] GET /identity/v3/projects/ca665dd48e60491fbe57a7dec14fd437 => generated 344 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:41:51.365829 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8408d74-300f-42ad-869a-eff800cadb36 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:41:51.487808 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8408d74-300f-42ad-869a-eff800cadb36 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:41:51.524422 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8d780a-4d0c-4a88-9eb3-cae748e84405 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:41:51.525327 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8d780a-4d0c-4a88-9eb3-cae748e84405 None admin] REQUEST_METHOD: `PUT` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:41:51.525796 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8d780a-4d0c-4a88-9eb3-cae748e84405 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:41:51.526233 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8d780a-4d0c-4a88-9eb3-cae748e84405 None admin] PATH_INFO: `/v3/projects/ca665dd48e60491fbe57a7dec14fd437/groups/5a0deafc19234dd38c37724addae93ed/roles/567db03c91854ad9af1e9a87ec1bd275` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:41:51.528309 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8d780a-4d0c-4a88-9eb3-cae748e84405 None admin] RBAC: Authorizing `identity:create_grant(project_id=ca665dd48e60491fbe57a7dec14fd437, group_id=5a0deafc19234dd38c37724addae93ed, role_id=567db03c91854ad9af1e9a87ec1bd275)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:41:51.530497 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8d780a-4d0c-4a88-9eb3-cae748e84405 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:41:51.549854 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 205/415] 10.222.0.57 () {58 vars in 1442 bytes} [Fri Sep 16 07:41:51 2022] PUT /identity/v3/projects/ca665dd48e60491fbe57a7dec14fd437/groups/5a0deafc19234dd38c37724addae93ed/roles/567db03c91854ad9af1e9a87ec1bd275 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 07:41:51.876589 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6387078e-a918-4c6c-9f97-5b08b92fc6c8 None None] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:41:51.876969 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6387078e-a918-4c6c-9f97-5b08b92fc6c8 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:41:51.877171 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6387078e-a918-4c6c-9f97-5b08b92fc6c8 None None] PATH_INFO: `/` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:41:51.878774 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 211/416] 10.222.0.57 () {54 vars in 927 bytes} [Fri Sep 16 07:41:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 07:41:51.884181 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a3d7f1-12f0-4b04-bbf1-e142a2e9a798 None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:41:51.884469 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a3d7f1-12f0-4b04-bbf1-e142a2e9a798 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:41:51.884747 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a3d7f1-12f0-4b04-bbf1-e142a2e9a798 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:41:51.910479 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-a4a3d7f1-12f0-4b04-bbf1-e142a2e9a798 None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:41:51.911689 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-a4a3d7f1-12f0-4b04-bbf1-e142a2e9a798 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:41:51.992274 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:41:52.019680 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 206/417] 10.222.0.57 () {58 vars in 1024 bytes} [Fri Sep 16 07:41:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 07:41:52.251940 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225ab084-08e8-4c17-9672-f2aad69134c1 None None] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:41:52.252137 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225ab084-08e8-4c17-9672-f2aad69134c1 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:41:52.252421 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225ab084-08e8-4c17-9672-f2aad69134c1 None None] PATH_INFO: `/` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:41:52.254129 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 212/418] 10.222.0.57 () {54 vars in 927 bytes} [Fri Sep 16 07:41:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 07:41:52.259503 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce5e2d4-a4d7-49fa-b0db-985808b5b4cc None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:41:52.259957 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce5e2d4-a4d7-49fa-b0db-985808b5b4cc None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:41:52.260043 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce5e2d4-a4d7-49fa-b0db-985808b5b4cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:41:52.290014 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-bce5e2d4-a4d7-49fa-b0db-985808b5b4cc None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:41:52.291274 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-bce5e2d4-a4d7-49fa-b0db-985808b5b4cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:41:52.397675 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 207/419] 10.222.0.57 () {58 vars in 1024 bytes} [Fri Sep 16 07:41:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 07:41:52.419813 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225ab084-08e8-4c17-9672-f2aad69134c1 None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:41:52.559535 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225ab084-08e8-4c17-9672-f2aad69134c1 None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:41:52.609346 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe44469c-90c5-4d9d-bd71-e96369e2c79a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:41:52.610014 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe44469c-90c5-4d9d-bd71-e96369e2c79a None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:41:52.610297 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe44469c-90c5-4d9d-bd71-e96369e2c79a None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:41:52.610569 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe44469c-90c5-4d9d-bd71-e96369e2c79a None admin] PATH_INFO: `/v3/roles/member` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:41:52.627787 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe44469c-90c5-4d9d-bd71-e96369e2c79a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 07:41:52.633445 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application [None req-fe44469c-90c5-4d9d-bd71-e96369e2c79a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 16 07:41:52.633445 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 07:41:52.633445 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 07:41:52.633445 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 07:41:52.633445 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 07:41:52.633445 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 07:41:52.633445 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 07:41:52.633445 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 07:41:52.633445 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 07:41:52.633445 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 07:41:52.633445 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 07:41:52.633445 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 07:41:52.633445 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 07:41:52.633445 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 07:41:52.633445 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 07:41:52.633445 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 07:41:52.634380 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 07:41:52.634380 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 07:41:52.634380 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 07:41:52.634380 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 07:41:52.634380 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 07:41:52.634380 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 07:41:52.634380 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 07:41:52.634380 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 07:41:52.634380 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 07:41:52.634380 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 07:41:52.634380 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 07:41:52.634380 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application with Lock( Sep 16 07:41:52.634380 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 07:41:52.634380 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._enter() Sep 16 07:41:52.634380 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 07:41:52.634380 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 07:41:52.635193 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 07:41:52.635193 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.creator() Sep 16 07:41:52.635193 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 07:41:52.635193 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application created_value = creator( Sep 16 07:41:52.635193 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 07:41:52.635193 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 07:41:52.635193 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 07:41:52.635193 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 07:41:52.635193 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 07:41:52.635193 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 07:41:52.635193 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 16 07:41:52.635193 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Sep 16 07:41:52.635193 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 213/420] 10.222.0.57 () {56 vars in 1099 bytes} [Fri Sep 16 07:41:52 2022] GET /identity/v3/roles/member => generated 84 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 07:41:52.643112 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce5e2d4-a4d7-49fa-b0db-985808b5b4cc None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:41:52.728221 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe44469c-90c5-4d9d-bd71-e96369e2c79a None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:41:52.799318 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:41:52.823205 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce5e2d4-a4d7-49fa-b0db-985808b5b4cc None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:41:52.852490 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:41:52.883983 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe44469c-90c5-4d9d-bd71-e96369e2c79a None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:41:52.889279 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473e0aff-8fea-4955-a4e8-68f1857ae702 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:41:52.891018 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473e0aff-8fea-4955-a4e8-68f1857ae702 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:41:52.893093 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473e0aff-8fea-4955-a4e8-68f1857ae702 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:41:52.893589 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473e0aff-8fea-4955-a4e8-68f1857ae702 None admin] PATH_INFO: `/v3/roles` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:41:52.894525 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473e0aff-8fea-4955-a4e8-68f1857ae702 None admin] RBAC: Adding query filter params (name=member) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:41:52.895037 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473e0aff-8fea-4955-a4e8-68f1857ae702 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:41:52.896645 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473e0aff-8fea-4955-a4e8-68f1857ae702 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:41:52.906686 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 208/421] 10.222.0.57 () {56 vars in 1101 bytes} [Fri Sep 16 07:41:52 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:41:52.914971 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473e0aff-8fea-4955-a4e8-68f1857ae702 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:41:52.961329 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b834a16-845e-4088-8ea2-c613bfa34615 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:41:52.964634 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b834a16-845e-4088-8ea2-c613bfa34615 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:41:52.965230 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b834a16-845e-4088-8ea2-c613bfa34615 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:41:52.965711 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b834a16-845e-4088-8ea2-c613bfa34615 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:41:52.987425 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b834a16-845e-4088-8ea2-c613bfa34615 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 07:41:52.995617 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application [None req-5b834a16-845e-4088-8ea2-c613bfa34615 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 16 07:41:52.995617 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 07:41:52.995617 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 07:41:52.995617 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 07:41:52.995617 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 07:41:52.995617 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 07:41:52.995617 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 07:41:52.995617 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 07:41:52.995617 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 07:41:52.995617 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 07:41:52.995617 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 07:41:52.995617 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 07:41:52.995617 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 07:41:52.995617 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 07:41:52.995617 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 07:41:52.995617 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 07:41:52.996509 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 07:41:52.996509 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 07:41:52.996509 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 07:41:52.996509 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 07:41:52.996509 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 07:41:52.996509 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 07:41:52.996509 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 07:41:52.996509 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 07:41:52.996509 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 07:41:52.996509 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 07:41:52.996509 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 07:41:52.996509 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application with Lock( Sep 16 07:41:52.996509 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 07:41:52.996509 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._enter() Sep 16 07:41:52.996509 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 07:41:52.996509 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 07:41:52.997344 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 07:41:52.997344 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.creator() Sep 16 07:41:52.997344 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 07:41:52.997344 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application created_value = creator( Sep 16 07:41:52.997344 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 07:41:52.997344 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 07:41:52.997344 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 07:41:52.997344 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 07:41:52.997344 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 07:41:52.997344 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 07:41:52.997344 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 16 07:41:52.997344 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Sep 16 07:41:53.004251 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 214/422] 10.222.0.57 () {56 vars in 1114 bytes} [Fri Sep 16 07:41:52 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 07:41:53.013107 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b834a16-845e-4088-8ea2-c613bfa34615 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:41:53.104715 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473e0aff-8fea-4955-a4e8-68f1857ae702 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:41:53.186474 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe6eaa9-c30b-4939-83ba-ec6045deabcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:41:53.187100 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe6eaa9-c30b-4939-83ba-ec6045deabcd None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:41:53.187377 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe6eaa9-c30b-4939-83ba-ec6045deabcd None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:41:53.187642 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe6eaa9-c30b-4939-83ba-ec6045deabcd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:41:53.191368 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b834a16-845e-4088-8ea2-c613bfa34615 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:41:53.209230 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:41:53.230813 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a789b8cf-b8ea-4587-b5a3-09f93effd6e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:41:53.231429 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a789b8cf-b8ea-4587-b5a3-09f93effd6e9 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:41:53.231709 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a789b8cf-b8ea-4587-b5a3-09f93effd6e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:41:53.231980 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a789b8cf-b8ea-4587-b5a3-09f93effd6e9 None admin] PATH_INFO: `/v3/roles` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:41:53.233193 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a789b8cf-b8ea-4587-b5a3-09f93effd6e9 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:41:53.233495 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a789b8cf-b8ea-4587-b5a3-09f93effd6e9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:41:53.235095 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a789b8cf-b8ea-4587-b5a3-09f93effd6e9 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:41:53.243965 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 215/423] 10.222.0.57 () {56 vars in 1111 bytes} [Fri Sep 16 07:41:53 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:41:53.245396 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6091a729-c493-48a1-a977-8ecd1cae08c8 None None] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:41:53.245685 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6091a729-c493-48a1-a977-8ecd1cae08c8 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:41:53.245985 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6091a729-c493-48a1-a977-8ecd1cae08c8 None None] PATH_INFO: `/` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:41:53.247177 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 216/424] 10.222.0.57 () {54 vars in 927 bytes} [Fri Sep 16 07:41:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 07:41:53.253089 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6091a729-c493-48a1-a977-8ecd1cae08c8 None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:41:53.259226 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:41:53.288429 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe6eaa9-c30b-4939-83ba-ec6045deabcd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:41:53.291055 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe6eaa9-c30b-4939-83ba-ec6045deabcd None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:41:53.364241 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6091a729-c493-48a1-a977-8ecd1cae08c8 None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:41:53.399055 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 209/425] 10.222.0.57 () {58 vars in 1282 bytes} [Fri Sep 16 07:41:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 484 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 16 07:41:53.400511 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c445826-9fdd-4da9-9f38-0f15ffa30095 None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:41:53.400934 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c445826-9fdd-4da9-9f38-0f15ffa30095 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:41:53.401344 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c445826-9fdd-4da9-9f38-0f15ffa30095 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:41:53.405904 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222c18b1-1d67-47ea-89a4-3276f8439fae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:41:53.406478 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222c18b1-1d67-47ea-89a4-3276f8439fae None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:41:53.406755 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222c18b1-1d67-47ea-89a4-3276f8439fae None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:41:53.407023 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222c18b1-1d67-47ea-89a4-3276f8439fae None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:41:53.421506 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-7c445826-9fdd-4da9-9f38-0f15ffa30095 None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:41:53.423111 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-7c445826-9fdd-4da9-9f38-0f15ffa30095 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:41:53.456286 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:41:53.479486 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222c18b1-1d67-47ea-89a4-3276f8439fae None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:41:53.481040 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222c18b1-1d67-47ea-89a4-3276f8439fae None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:41:53.497112 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 210/426] 10.222.0.57 () {58 vars in 1024 bytes} [Fri Sep 16 07:41:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 07:41:53.498845 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c445826-9fdd-4da9-9f38-0f15ffa30095 None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:41:53.507771 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:41:53.593310 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 217/427] 10.222.0.57 () {58 vars in 1282 bytes} [Fri Sep 16 07:41:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 16 07:41:53.594821 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222c18b1-1d67-47ea-89a4-3276f8439fae None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:41:53.606005 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c445826-9fdd-4da9-9f38-0f15ffa30095 None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:41:53.647276 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ec7dee-0517-4c03-a35d-1cb796d52b88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:41:53.648258 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ec7dee-0517-4c03-a35d-1cb796d52b88 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:41:53.648832 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ec7dee-0517-4c03-a35d-1cb796d52b88 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:41:53.649317 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ec7dee-0517-4c03-a35d-1cb796d52b88 None admin] PATH_INFO: `/v3/projects/421354d0cc9f4200b553561891fddc5d` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:41:53.650709 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ec7dee-0517-4c03-a35d-1cb796d52b88 None admin] RBAC: Authorizing `identity:get_project(project_id=421354d0cc9f4200b553561891fddc5d)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:41:53.652545 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ec7dee-0517-4c03-a35d-1cb796d52b88 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:41:53.654433 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 211/428] 10.222.0.57 () {56 vars in 1186 bytes} [Fri Sep 16 07:41:53 2022] GET /identity/v3/projects/421354d0cc9f4200b553561891fddc5d => generated 302 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:41:53.660241 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ec7dee-0517-4c03-a35d-1cb796d52b88 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:41:53.694666 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:41:53.723828 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222c18b1-1d67-47ea-89a4-3276f8439fae None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:41:53.768180 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3993b02-9062-46bb-b882-03fbc6eee33a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:41:53.768833 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3993b02-9062-46bb-b882-03fbc6eee33a None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:41:53.769513 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3993b02-9062-46bb-b882-03fbc6eee33a None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:41:53.769815 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3993b02-9062-46bb-b882-03fbc6eee33a None admin] PATH_INFO: `/v3/projects/5324c5a353924497b2d5372a26cbe6fc` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:41:53.771144 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3993b02-9062-46bb-b882-03fbc6eee33a None admin] RBAC: Authorizing `identity:get_project(project_id=5324c5a353924497b2d5372a26cbe6fc)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:41:53.773014 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3993b02-9062-46bb-b882-03fbc6eee33a None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:41:53.778172 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 218/429] 10.222.0.57 () {56 vars in 1186 bytes} [Fri Sep 16 07:41:53 2022] GET /identity/v3/projects/5324c5a353924497b2d5372a26cbe6fc => generated 298 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 07:41:53.778172 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7b2b32-200b-4bd8-b83d-f787710a3e4b None None] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:41:53.778172 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7b2b32-200b-4bd8-b83d-f787710a3e4b None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:41:53.778172 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7b2b32-200b-4bd8-b83d-f787710a3e4b None None] PATH_INFO: `/` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:41:53.778172 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 219/430] 10.222.0.57 () {54 vars in 927 bytes} [Fri Sep 16 07:41:53 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 07:41:53.781085 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:41:53.782402 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7b2b32-200b-4bd8-b83d-f787710a3e4b None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:41:53.797999 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ec7dee-0517-4c03-a35d-1cb796d52b88 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:41:53.841087 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42799413-b8c1-474a-b269-69498a9e7f4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:41:53.842109 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42799413-b8c1-474a-b269-69498a9e7f4a None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:41:53.842529 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42799413-b8c1-474a-b269-69498a9e7f4a None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:41:53.843092 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42799413-b8c1-474a-b269-69498a9e7f4a None admin] PATH_INFO: `/v3/groups/8cc9f5e52d0844e7896878082629bf5d` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:41:53.844731 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42799413-b8c1-474a-b269-69498a9e7f4a None admin] RBAC: Authorizing `identity:get_group(group_id=8cc9f5e52d0844e7896878082629bf5d)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:41:53.846749 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42799413-b8c1-474a-b269-69498a9e7f4a None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:41:53.854015 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 212/431] 10.222.0.57 () {56 vars in 1180 bytes} [Fri Sep 16 07:41:53 2022] GET /identity/v3/groups/8cc9f5e52d0844e7896878082629bf5d => generated 226 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 07:41:53.855670 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27b5d0a-b040-46db-9fa0-28d3372be826 None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:41:53.856096 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27b5d0a-b040-46db-9fa0-28d3372be826 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:41:53.856524 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27b5d0a-b040-46db-9fa0-28d3372be826 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:41:53.882351 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-d27b5d0a-b040-46db-9fa0-28d3372be826 None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:41:53.883772 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-d27b5d0a-b040-46db-9fa0-28d3372be826 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:41:53.908514 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7b2b32-200b-4bd8-b83d-f787710a3e4b None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:41:53.946063 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d0122b-3c8c-4f38-bfea-5e02131d5250 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:41:53.946915 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d0122b-3c8c-4f38-bfea-5e02131d5250 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:41:53.947333 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d0122b-3c8c-4f38-bfea-5e02131d5250 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:41:53.947846 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d0122b-3c8c-4f38-bfea-5e02131d5250 None admin] PATH_INFO: `/v3/groups/8cc9f5e52d0844e7896878082629bf5d` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:41:53.949205 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d0122b-3c8c-4f38-bfea-5e02131d5250 None admin] RBAC: Authorizing `identity:get_group(group_id=8cc9f5e52d0844e7896878082629bf5d)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:41:53.950966 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d0122b-3c8c-4f38-bfea-5e02131d5250 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:41:53.957446 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 213/432] 10.222.0.57 () {58 vars in 1024 bytes} [Fri Sep 16 07:41:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 07:41:53.957446 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27b5d0a-b040-46db-9fa0-28d3372be826 None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:41:53.958046 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 220/433] 10.222.0.57 () {56 vars in 1180 bytes} [Fri Sep 16 07:41:53 2022] GET /identity/v3/groups/8cc9f5e52d0844e7896878082629bf5d => generated 226 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:41:53.959234 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d0122b-3c8c-4f38-bfea-5e02131d5250 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:41:53.979428 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:41:54.035547 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:41:54.067866 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27b5d0a-b040-46db-9fa0-28d3372be826 None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:41:54.082121 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d0122b-3c8c-4f38-bfea-5e02131d5250 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:41:54.115802 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbdb205-a5d2-46e0-b494-2b66a90c1627 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:41:54.116703 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbdb205-a5d2-46e0-b494-2b66a90c1627 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:41:54.117179 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbdb205-a5d2-46e0-b494-2b66a90c1627 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:41:54.117843 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbdb205-a5d2-46e0-b494-2b66a90c1627 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:41:54.118781 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbdb205-a5d2-46e0-b494-2b66a90c1627 None admin] RBAC: Adding query filter params (group.id=8cc9f5e52d0844e7896878082629bf5d, role.id=4818d38cf2564825b312e66c9eb24762, scope.project.id=421354d0cc9f4200b553561891fddc5d) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:41:54.118893 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71d71c1-a68c-42da-bfb9-c62fc853467c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:41:54.119457 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbdb205-a5d2-46e0-b494-2b66a90c1627 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:41:54.119558 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71d71c1-a68c-42da-bfb9-c62fc853467c None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:41:54.119766 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71d71c1-a68c-42da-bfb9-c62fc853467c None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:41:54.120034 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71d71c1-a68c-42da-bfb9-c62fc853467c None admin] PATH_INFO: `/v3/roles/member` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:41:54.121563 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbdb205-a5d2-46e0-b494-2b66a90c1627 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:41:54.128470 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 214/434] 10.222.0.57 () {56 vars in 1376 bytes} [Fri Sep 16 07:41:53 2022] GET /identity/v3/role_assignments?group.id=8cc9f5e52d0844e7896878082629bf5d&scope.project.id=421354d0cc9f4200b553561891fddc5d&role.id=4818d38cf2564825b312e66c9eb24762 => generated 611 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:41:54.129544 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbdb205-a5d2-46e0-b494-2b66a90c1627 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:41:54.137417 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71d71c1-a68c-42da-bfb9-c62fc853467c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 07:41:54.149803 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application [None req-a71d71c1-a68c-42da-bfb9-c62fc853467c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 16 07:41:54.149803 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 07:41:54.149803 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 07:41:54.149803 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 07:41:54.149803 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 07:41:54.149803 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 07:41:54.149803 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 07:41:54.149803 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 07:41:54.149803 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 07:41:54.149803 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 07:41:54.149803 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 07:41:54.149803 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 07:41:54.149803 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 07:41:54.149803 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 07:41:54.149803 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 07:41:54.149803 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 07:41:54.150783 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 07:41:54.150783 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 07:41:54.150783 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 07:41:54.150783 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 07:41:54.150783 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 07:41:54.150783 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 07:41:54.150783 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 07:41:54.150783 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 07:41:54.150783 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 07:41:54.150783 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 07:41:54.150783 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 07:41:54.150783 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application with Lock( Sep 16 07:41:54.150783 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 07:41:54.150783 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._enter() Sep 16 07:41:54.150783 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 07:41:54.150783 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 07:41:54.151573 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 07:41:54.151573 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.creator() Sep 16 07:41:54.151573 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 07:41:54.151573 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application created_value = creator( Sep 16 07:41:54.151573 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 07:41:54.151573 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 07:41:54.151573 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 07:41:54.151573 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 07:41:54.151573 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 07:41:54.151573 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 07:41:54.151573 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 16 07:41:54.151573 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Sep 16 07:41:54.151573 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 221/435] 10.222.0.57 () {56 vars in 1099 bytes} [Fri Sep 16 07:41:53 2022] GET /identity/v3/roles/member => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 07:41:54.157042 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71d71c1-a68c-42da-bfb9-c62fc853467c None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:41:54.250539 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbdb205-a5d2-46e0-b494-2b66a90c1627 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:41:54.290885 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f77754-b0ad-4675-ae50-96b62ef51ade None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:41:54.292488 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f77754-b0ad-4675-ae50-96b62ef51ade None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:41:54.293456 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f77754-b0ad-4675-ae50-96b62ef51ade None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:41:54.293956 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f77754-b0ad-4675-ae50-96b62ef51ade None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:41:54.295924 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f77754-b0ad-4675-ae50-96b62ef51ade None admin] RBAC: Adding query filter params (group.id=8cc9f5e52d0844e7896878082629bf5d, role.id=e92664bc677b40769b7a05d102541bf0, scope.project.id=5324c5a353924497b2d5372a26cbe6fc) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:41:54.296396 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f77754-b0ad-4675-ae50-96b62ef51ade None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:41:54.298465 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f77754-b0ad-4675-ae50-96b62ef51ade None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:41:54.305052 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:41:54.309787 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 215/436] 10.222.0.57 () {56 vars in 1376 bytes} [Fri Sep 16 07:41:54 2022] GET /identity/v3/role_assignments?group.id=8cc9f5e52d0844e7896878082629bf5d&scope.project.id=5324c5a353924497b2d5372a26cbe6fc&role.id=e92664bc677b40769b7a05d102541bf0 => generated 611 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:41:54.311631 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f77754-b0ad-4675-ae50-96b62ef51ade None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:41:54.324702 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:41:54.371745 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71d71c1-a68c-42da-bfb9-c62fc853467c None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:41:54.422653 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e52f88-81ed-478d-a980-69113fd27586 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:41:54.423286 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e52f88-81ed-478d-a980-69113fd27586 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:41:54.423564 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e52f88-81ed-478d-a980-69113fd27586 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:41:54.423835 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e52f88-81ed-478d-a980-69113fd27586 None admin] PATH_INFO: `/v3/roles` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:41:54.424533 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e52f88-81ed-478d-a980-69113fd27586 None admin] RBAC: Adding query filter params (name=member) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:41:54.424835 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e52f88-81ed-478d-a980-69113fd27586 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:41:54.426304 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e52f88-81ed-478d-a980-69113fd27586 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:41:54.439903 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 222/437] 10.222.0.57 () {56 vars in 1101 bytes} [Fri Sep 16 07:41:54 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 07:41:54.441296 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71daf599-a70d-457e-9713-a93dd6724759 None None] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:41:54.441578 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71daf599-a70d-457e-9713-a93dd6724759 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:41:54.441916 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71daf599-a70d-457e-9713-a93dd6724759 None None] PATH_INFO: `/` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:41:54.444041 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 223/438] 10.222.0.57 () {54 vars in 927 bytes} [Fri Sep 16 07:41:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 07:41:54.448884 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71daf599-a70d-457e-9713-a93dd6724759 None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:41:54.459113 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f77754-b0ad-4675-ae50-96b62ef51ade None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:41:54.501283 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78159d43-5a5a-428a-b24f-a11fd888b2cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:41:54.501870 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78159d43-5a5a-428a-b24f-a11fd888b2cf None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:41:54.502147 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78159d43-5a5a-428a-b24f-a11fd888b2cf None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:41:54.502448 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78159d43-5a5a-428a-b24f-a11fd888b2cf None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:41:54.515979 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78159d43-5a5a-428a-b24f-a11fd888b2cf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 07:41:54.521216 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application [None req-78159d43-5a5a-428a-b24f-a11fd888b2cf None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 16 07:41:54.521216 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 07:41:54.521216 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 07:41:54.521216 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 07:41:54.521216 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 07:41:54.521216 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 07:41:54.521216 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 07:41:54.521216 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 07:41:54.521216 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 07:41:54.521216 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 07:41:54.521216 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 07:41:54.521216 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 07:41:54.521216 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 07:41:54.521216 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 07:41:54.521216 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 07:41:54.521216 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 07:41:54.522179 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 07:41:54.522179 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 07:41:54.522179 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 07:41:54.522179 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 07:41:54.522179 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 07:41:54.522179 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 07:41:54.522179 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 07:41:54.522179 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 07:41:54.522179 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 07:41:54.522179 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 07:41:54.522179 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 07:41:54.522179 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application with Lock( Sep 16 07:41:54.522179 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 07:41:54.522179 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._enter() Sep 16 07:41:54.522179 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 07:41:54.522179 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 07:41:54.522971 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 07:41:54.522971 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.creator() Sep 16 07:41:54.522971 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 07:41:54.522971 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application created_value = creator( Sep 16 07:41:54.522971 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 07:41:54.522971 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 07:41:54.522971 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 07:41:54.522971 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 07:41:54.522971 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 07:41:54.522971 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 07:41:54.522971 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 16 07:41:54.522971 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Sep 16 07:41:54.522971 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 216/439] 10.222.0.57 () {56 vars in 1114 bytes} [Fri Sep 16 07:41:54 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 07:41:54.525546 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e71401-3c05-4883-a38e-e69d7ec1b001 None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:41:54.525546 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e71401-3c05-4883-a38e-e69d7ec1b001 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:41:54.525546 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e71401-3c05-4883-a38e-e69d7ec1b001 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:41:54.547206 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-72e71401-3c05-4883-a38e-e69d7ec1b001 None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:41:54.548384 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-72e71401-3c05-4883-a38e-e69d7ec1b001 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:41:54.574825 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71daf599-a70d-457e-9713-a93dd6724759 None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:41:54.609004 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:41:54.609178 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3cd5a2-a13f-45b0-9187-0b0bea2c86e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:41:54.609611 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3cd5a2-a13f-45b0-9187-0b0bea2c86e7 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:41:54.609926 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3cd5a2-a13f-45b0-9187-0b0bea2c86e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:41:54.610200 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3cd5a2-a13f-45b0-9187-0b0bea2c86e7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:41:54.613809 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:41:54.621528 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 217/440] 10.222.0.57 () {58 vars in 1024 bytes} [Fri Sep 16 07:41:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 07:41:54.622450 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e71401-3c05-4883-a38e-e69d7ec1b001 None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:41:54.686350 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3cd5a2-a13f-45b0-9187-0b0bea2c86e7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:41:54.687822 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3cd5a2-a13f-45b0-9187-0b0bea2c86e7 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:41:54.739704 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e71401-3c05-4883-a38e-e69d7ec1b001 None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:41:54.774647 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74142413-17c6-4cbf-9b7d-85d26de66e4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:41:54.775179 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74142413-17c6-4cbf-9b7d-85d26de66e4f None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:41:54.775459 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74142413-17c6-4cbf-9b7d-85d26de66e4f None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:41:54.775739 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74142413-17c6-4cbf-9b7d-85d26de66e4f None admin] PATH_INFO: `/v3/roles` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:41:54.776395 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74142413-17c6-4cbf-9b7d-85d26de66e4f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:41:54.776698 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74142413-17c6-4cbf-9b7d-85d26de66e4f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:41:54.778114 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74142413-17c6-4cbf-9b7d-85d26de66e4f None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:41:54.787921 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 218/441] 10.222.0.57 () {56 vars in 1111 bytes} [Fri Sep 16 07:41:54 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:41:54.793513 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74142413-17c6-4cbf-9b7d-85d26de66e4f None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:41:54.804024 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 224/442] 10.222.0.57 () {58 vars in 1282 bytes} [Fri Sep 16 07:41:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 16 07:41:54.805635 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3cd5a2-a13f-45b0-9187-0b0bea2c86e7 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:41:54.843324 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:41:54.847366 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:41:54.896804 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74142413-17c6-4cbf-9b7d-85d26de66e4f None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:41:54.915149 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3cd5a2-a13f-45b0-9187-0b0bea2c86e7 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:41:54.930054 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d978c5d-231c-4507-abb5-3984434486cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:41:54.930646 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d978c5d-231c-4507-abb5-3984434486cc None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:41:54.930919 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d978c5d-231c-4507-abb5-3984434486cc None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:41:54.931184 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d978c5d-231c-4507-abb5-3984434486cc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:41:54.954739 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d56097b-da15-448a-989f-37a2b0791994 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:41:54.955365 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d56097b-da15-448a-989f-37a2b0791994 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:41:54.955644 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d56097b-da15-448a-989f-37a2b0791994 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:41:54.955922 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d56097b-da15-448a-989f-37a2b0791994 None admin] PATH_INFO: `/v3/projects/5324c5a353924497b2d5372a26cbe6fc` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:41:54.957045 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d56097b-da15-448a-989f-37a2b0791994 None admin] RBAC: Authorizing `identity:get_project(project_id=5324c5a353924497b2d5372a26cbe6fc)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:41:54.963204 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d56097b-da15-448a-989f-37a2b0791994 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:41:54.963204 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 225/443] 10.222.0.57 () {56 vars in 1186 bytes} [Fri Sep 16 07:41:54 2022] GET /identity/v3/projects/5324c5a353924497b2d5372a26cbe6fc => generated 298 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:41:54.963204 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d56097b-da15-448a-989f-37a2b0791994 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:41:55.006202 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d978c5d-231c-4507-abb5-3984434486cc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:41:55.007901 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d978c5d-231c-4507-abb5-3984434486cc None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:41:55.059990 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d56097b-da15-448a-989f-37a2b0791994 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:41:55.062487 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:41:55.062612 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:41:55.104663 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf5d45b-61e8-459a-826e-46a4e987f9db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:41:55.105915 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf5d45b-61e8-459a-826e-46a4e987f9db None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:41:55.106151 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf5d45b-61e8-459a-826e-46a4e987f9db None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:41:55.106657 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf5d45b-61e8-459a-826e-46a4e987f9db None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:41:55.117389 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 219/444] 10.222.0.57 () {58 vars in 1282 bytes} [Fri Sep 16 07:41:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 16 07:41:55.118258 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d978c5d-231c-4507-abb5-3984434486cc None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:41:55.127262 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf5d45b-61e8-459a-826e-46a4e987f9db None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 07:41:55.134711 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application [None req-7bf5d45b-61e8-459a-826e-46a4e987f9db None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 16 07:41:55.134711 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 07:41:55.134711 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 07:41:55.134711 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 07:41:55.134711 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 07:41:55.134711 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 07:41:55.134711 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 07:41:55.134711 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 07:41:55.134711 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 07:41:55.134711 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 07:41:55.134711 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 07:41:55.134711 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 07:41:55.134711 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 07:41:55.134711 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 07:41:55.134711 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 07:41:55.134711 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 07:41:55.135735 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 07:41:55.135735 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 07:41:55.135735 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 07:41:55.135735 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 07:41:55.135735 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 07:41:55.135735 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 07:41:55.135735 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 07:41:55.135735 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 07:41:55.135735 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 07:41:55.135735 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 07:41:55.135735 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 07:41:55.135735 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application with Lock( Sep 16 07:41:55.135735 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 07:41:55.135735 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._enter() Sep 16 07:41:55.135735 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 07:41:55.135735 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 07:41:55.136716 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 07:41:55.136716 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.creator() Sep 16 07:41:55.136716 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 07:41:55.136716 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application created_value = creator( Sep 16 07:41:55.136716 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 07:41:55.136716 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 07:41:55.136716 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 07:41:55.136716 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 07:41:55.136716 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 07:41:55.136716 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 07:41:55.136716 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 16 07:41:55.136716 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Sep 16 07:41:55.136716 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 226/445] 10.222.0.57 () {56 vars in 1096 bytes} [Fri Sep 16 07:41:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 07:41:55.137571 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf5d45b-61e8-459a-826e-46a4e987f9db None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:41:55.234984 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d978c5d-231c-4507-abb5-3984434486cc None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:41:55.249421 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf5d45b-61e8-459a-826e-46a4e987f9db None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:41:55.272147 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84303da6-e304-4295-860e-c38deebc9ea0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:41:55.272774 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84303da6-e304-4295-860e-c38deebc9ea0 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:41:55.273047 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84303da6-e304-4295-860e-c38deebc9ea0 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:41:55.273319 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84303da6-e304-4295-860e-c38deebc9ea0 None admin] PATH_INFO: `/v3/groups/8cc9f5e52d0844e7896878082629bf5d` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:41:55.274453 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84303da6-e304-4295-860e-c38deebc9ea0 None admin] RBAC: Authorizing `identity:get_group(group_id=8cc9f5e52d0844e7896878082629bf5d)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:41:55.275905 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84303da6-e304-4295-860e-c38deebc9ea0 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:41:55.277452 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 220/446] 10.222.0.57 () {56 vars in 1180 bytes} [Fri Sep 16 07:41:55 2022] GET /identity/v3/groups/8cc9f5e52d0844e7896878082629bf5d => generated 226 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:41:55.278234 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84303da6-e304-4295-860e-c38deebc9ea0 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:41:55.285187 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d8e11d-49c4-40af-9f2a-108978700813 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:41:55.285842 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d8e11d-49c4-40af-9f2a-108978700813 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:41:55.286121 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d8e11d-49c4-40af-9f2a-108978700813 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:41:55.286392 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d8e11d-49c4-40af-9f2a-108978700813 None admin] PATH_INFO: `/v3/projects/421354d0cc9f4200b553561891fddc5d` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:41:55.287527 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d8e11d-49c4-40af-9f2a-108978700813 None admin] RBAC: Authorizing `identity:get_project(project_id=421354d0cc9f4200b553561891fddc5d)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:41:55.288950 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d8e11d-49c4-40af-9f2a-108978700813 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:41:55.291909 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 227/447] 10.222.0.57 () {56 vars in 1186 bytes} [Fri Sep 16 07:41:55 2022] GET /identity/v3/projects/421354d0cc9f4200b553561891fddc5d => generated 302 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:41:55.292691 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d8e11d-49c4-40af-9f2a-108978700813 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:41:55.304998 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:41:55.332229 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:41:55.393188 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84303da6-e304-4295-860e-c38deebc9ea0 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:41:55.413746 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d8e11d-49c4-40af-9f2a-108978700813 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:41:55.431087 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc132bdb-2f8b-42b9-8b3e-2bc25d0c73c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:41:55.431786 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc132bdb-2f8b-42b9-8b3e-2bc25d0c73c5 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:41:55.432152 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc132bdb-2f8b-42b9-8b3e-2bc25d0c73c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:41:55.432486 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc132bdb-2f8b-42b9-8b3e-2bc25d0c73c5 None admin] PATH_INFO: `/v3/roles` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:41:55.433208 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc132bdb-2f8b-42b9-8b3e-2bc25d0c73c5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:41:55.433569 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc132bdb-2f8b-42b9-8b3e-2bc25d0c73c5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:41:55.435091 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc132bdb-2f8b-42b9-8b3e-2bc25d0c73c5 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:41:55.444268 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 221/448] 10.222.0.57 () {56 vars in 1099 bytes} [Fri Sep 16 07:41:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:41:55.445068 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc132bdb-2f8b-42b9-8b3e-2bc25d0c73c5 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:41:55.450011 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0e666c-3c86-40a3-baf8-5182f4e3c4d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:41:55.450617 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0e666c-3c86-40a3-baf8-5182f4e3c4d9 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:41:55.451551 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0e666c-3c86-40a3-baf8-5182f4e3c4d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:41:55.452040 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0e666c-3c86-40a3-baf8-5182f4e3c4d9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:41:55.453037 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0e666c-3c86-40a3-baf8-5182f4e3c4d9 None admin] RBAC: Adding query filter params (group.id=8cc9f5e52d0844e7896878082629bf5d, role.id=4818d38cf2564825b312e66c9eb24762, scope.project.id=5324c5a353924497b2d5372a26cbe6fc) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:41:55.453340 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0e666c-3c86-40a3-baf8-5182f4e3c4d9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:41:55.455870 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0e666c-3c86-40a3-baf8-5182f4e3c4d9 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:41:55.464173 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 228/449] 10.222.0.57 () {56 vars in 1376 bytes} [Fri Sep 16 07:41:55 2022] GET /identity/v3/role_assignments?group.id=8cc9f5e52d0844e7896878082629bf5d&scope.project.id=5324c5a353924497b2d5372a26cbe6fc&role.id=4818d38cf2564825b312e66c9eb24762 => generated 611 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:41:55.464977 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0e666c-3c86-40a3-baf8-5182f4e3c4d9 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:41:55.554986 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:41:55.577238 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc132bdb-2f8b-42b9-8b3e-2bc25d0c73c5 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:41:55.584745 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:41:55.593445 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0e666c-3c86-40a3-baf8-5182f4e3c4d9 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:41:55.625895 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1ac184-270b-4f7b-9764-da2d48eb0f69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:41:55.626548 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1ac184-270b-4f7b-9764-da2d48eb0f69 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:41:55.626827 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1ac184-270b-4f7b-9764-da2d48eb0f69 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:41:55.627097 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1ac184-270b-4f7b-9764-da2d48eb0f69 None admin] PATH_INFO: `/v3/groups/8cc9f5e52d0844e7896878082629bf5d` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:41:55.628334 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1ac184-270b-4f7b-9764-da2d48eb0f69 None admin] RBAC: Authorizing `identity:get_group(group_id=8cc9f5e52d0844e7896878082629bf5d)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:41:55.629819 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1ac184-270b-4f7b-9764-da2d48eb0f69 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:41:55.631605 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 222/450] 10.222.0.57 () {56 vars in 1180 bytes} [Fri Sep 16 07:41:55 2022] GET /identity/v3/groups/8cc9f5e52d0844e7896878082629bf5d => generated 226 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:41:55.637950 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ea3886-ce84-40ab-9d9a-557c5426b95d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:41:55.638172 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1ac184-270b-4f7b-9764-da2d48eb0f69 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:41:55.639151 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ea3886-ce84-40ab-9d9a-557c5426b95d None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:41:55.639368 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ea3886-ce84-40ab-9d9a-557c5426b95d None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:41:55.639645 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ea3886-ce84-40ab-9d9a-557c5426b95d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:41:55.727765 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ea3886-ce84-40ab-9d9a-557c5426b95d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:41:55.729239 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ea3886-ce84-40ab-9d9a-557c5426b95d None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:41:55.774534 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1ac184-270b-4f7b-9764-da2d48eb0f69 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:41:55.819448 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1341c64c-f798-45ec-b49c-d8f04a071889 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:41:55.820056 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1341c64c-f798-45ec-b49c-d8f04a071889 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:41:55.820334 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1341c64c-f798-45ec-b49c-d8f04a071889 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:41:55.820601 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1341c64c-f798-45ec-b49c-d8f04a071889 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:41:55.821325 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1341c64c-f798-45ec-b49c-d8f04a071889 None admin] RBAC: Adding query filter params (group.id=8cc9f5e52d0844e7896878082629bf5d, role.id=e92664bc677b40769b7a05d102541bf0, scope.project.id=421354d0cc9f4200b553561891fddc5d) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:41:55.821627 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1341c64c-f798-45ec-b49c-d8f04a071889 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:41:55.823179 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1341c64c-f798-45ec-b49c-d8f04a071889 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:41:55.832747 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 223/451] 10.222.0.57 () {56 vars in 1376 bytes} [Fri Sep 16 07:41:55 2022] GET /identity/v3/role_assignments?group.id=8cc9f5e52d0844e7896878082629bf5d&scope.project.id=421354d0cc9f4200b553561891fddc5d&role.id=e92664bc677b40769b7a05d102541bf0 => generated 611 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 07:41:55.874626 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:41:55.882020 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 229/452] 10.222.0.57 () {58 vars in 1282 bytes} [Fri Sep 16 07:41:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 16 07:41:55.888057 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1341c64c-f798-45ec-b49c-d8f04a071889 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:41:55.910480 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:41:56.024335 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1341c64c-f798-45ec-b49c-d8f04a071889 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:41:56.062772 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cb9183-1688-4618-ba03-1615d9d096be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:41:56.063410 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cb9183-1688-4618-ba03-1615d9d096be None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:41:56.063687 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cb9183-1688-4618-ba03-1615d9d096be None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:41:56.063954 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cb9183-1688-4618-ba03-1615d9d096be None admin] PATH_INFO: `/v3/projects/ca665dd48e60491fbe57a7dec14fd437` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:41:56.065071 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03cb9183-1688-4618-ba03-1615d9d096be None admin] RBAC: Authorizing `identity:get_project(project_id=ca665dd48e60491fbe57a7dec14fd437)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:41:56.066641 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03cb9183-1688-4618-ba03-1615d9d096be None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:41:56.068475 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 224/453] 10.222.0.57 () {56 vars in 1186 bytes} [Fri Sep 16 07:41:55 2022] GET /identity/v3/projects/ca665dd48e60491fbe57a7dec14fd437 => generated 344 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:41:56.073914 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ea3886-ce84-40ab-9d9a-557c5426b95d None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:41:56.176960 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ea3886-ce84-40ab-9d9a-557c5426b95d None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:41:56.212141 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4e89f9-8dc3-428f-b408-8f7542084ac3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:41:56.212784 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4e89f9-8dc3-428f-b408-8f7542084ac3 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:41:56.213066 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4e89f9-8dc3-428f-b408-8f7542084ac3 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:41:56.213341 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4e89f9-8dc3-428f-b408-8f7542084ac3 None admin] PATH_INFO: `/v3/groups/5a0deafc19234dd38c37724addae93ed` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:41:56.214502 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4e89f9-8dc3-428f-b408-8f7542084ac3 None admin] RBAC: Authorizing `identity:get_group(group_id=5a0deafc19234dd38c37724addae93ed)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:41:56.215959 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4e89f9-8dc3-428f-b408-8f7542084ac3 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:41:56.217579 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 230/454] 10.222.0.57 () {56 vars in 1180 bytes} [Fri Sep 16 07:41:56 2022] GET /identity/v3/groups/5a0deafc19234dd38c37724addae93ed => generated 229 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:41:56.223494 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cb9183-1688-4618-ba03-1615d9d096be None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:41:56.308481 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:41:56.326901 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cb9183-1688-4618-ba03-1615d9d096be None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:41:56.361921 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db2f751-1d7b-462c-a7a7-005275b6623c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:41:56.362528 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db2f751-1d7b-462c-a7a7-005275b6623c None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:41:56.362809 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db2f751-1d7b-462c-a7a7-005275b6623c None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:41:56.363084 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db2f751-1d7b-462c-a7a7-005275b6623c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:41:56.363816 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db2f751-1d7b-462c-a7a7-005275b6623c None admin] RBAC: Adding query filter params (group.id=5a0deafc19234dd38c37724addae93ed, role.id=567db03c91854ad9af1e9a87ec1bd275, scope.project.id=ca665dd48e60491fbe57a7dec14fd437) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:41:56.364118 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db2f751-1d7b-462c-a7a7-005275b6623c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:41:56.365576 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db2f751-1d7b-462c-a7a7-005275b6623c None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:41:56.371690 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 225/455] 10.222.0.57 () {56 vars in 1376 bytes} [Fri Sep 16 07:41:56 2022] GET /identity/v3/role_assignments?group.id=5a0deafc19234dd38c37724addae93ed&scope.project.id=ca665dd48e60491fbe57a7dec14fd437&role.id=567db03c91854ad9af1e9a87ec1bd275 => generated 611 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:41:58.838507 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603980a8-3544-4179-a73e-9add5c7e28d4 None None] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:41:58.839055 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603980a8-3544-4179-a73e-9add5c7e28d4 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:41:58.839131 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603980a8-3544-4179-a73e-9add5c7e28d4 None None] PATH_INFO: `/` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:41:58.840724 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 231/456] 10.222.0.57 () {54 vars in 927 bytes} [Fri Sep 16 07:41:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 07:41:58.855331 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a79b5c-5c6a-4f8c-91d9-0101a21d0fef None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:41:58.855801 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a79b5c-5c6a-4f8c-91d9-0101a21d0fef None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:41:58.855901 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a79b5c-5c6a-4f8c-91d9-0101a21d0fef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:41:58.879452 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-03a79b5c-5c6a-4f8c-91d9-0101a21d0fef None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:41:58.880658 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-03a79b5c-5c6a-4f8c-91d9-0101a21d0fef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:41:58.982762 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 226/457] 10.222.0.57 () {58 vars in 1024 bytes} [Fri Sep 16 07:41:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 07:41:59.336721 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d370448-8e56-4f69-aa03-b1ee1b251a89 None None] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:41:59.337005 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d370448-8e56-4f69-aa03-b1ee1b251a89 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:41:59.337436 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d370448-8e56-4f69-aa03-b1ee1b251a89 None None] PATH_INFO: `/` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:41:59.339164 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 232/458] 10.222.0.57 () {54 vars in 927 bytes} [Fri Sep 16 07:41:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 07:41:59.344725 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0986986-8deb-48a1-9932-cd603f2a69ae None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:41:59.345190 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0986986-8deb-48a1-9932-cd603f2a69ae None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:41:59.345603 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0986986-8deb-48a1-9932-cd603f2a69ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:41:59.368463 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-c0986986-8deb-48a1-9932-cd603f2a69ae None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:41:59.369102 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f4ba12-85f3-4e69-a1b0-db291cbee9c8 None None] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:41:59.369626 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f4ba12-85f3-4e69-a1b0-db291cbee9c8 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:41:59.369899 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-c0986986-8deb-48a1-9932-cd603f2a69ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:41:59.370368 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f4ba12-85f3-4e69-a1b0-db291cbee9c8 None None] PATH_INFO: `/` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:41:59.372270 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 233/459] 10.222.0.57 () {54 vars in 927 bytes} [Fri Sep 16 07:41:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 07:41:59.379319 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50eb3163-e49e-4bdf-9905-2c2a2744062a None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:41:59.379891 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50eb3163-e49e-4bdf-9905-2c2a2744062a None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:41:59.380223 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50eb3163-e49e-4bdf-9905-2c2a2744062a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:41:59.412495 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-50eb3163-e49e-4bdf-9905-2c2a2744062a None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:41:59.413702 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-50eb3163-e49e-4bdf-9905-2c2a2744062a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:41:59.469886 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 227/460] 10.222.0.57 () {58 vars in 1024 bytes} [Fri Sep 16 07:41:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 07:41:59.471072 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0986986-8deb-48a1-9932-cd603f2a69ae None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:41:59.489660 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:41:59.507318 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:41:59.525203 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 234/461] 10.222.0.57 () {58 vars in 1024 bytes} [Fri Sep 16 07:41:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 07:41:59.603028 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0986986-8deb-48a1-9932-cd603f2a69ae None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:41:59.658521 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1568ac-dd88-46ab-bc5a-e188030f21c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:41:59.659073 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1568ac-dd88-46ab-bc5a-e188030f21c8 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:41:59.659351 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1568ac-dd88-46ab-bc5a-e188030f21c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:41:59.659619 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1568ac-dd88-46ab-bc5a-e188030f21c8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:41:59.673505 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1568ac-dd88-46ab-bc5a-e188030f21c8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:41:59.674995 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1568ac-dd88-46ab-bc5a-e188030f21c8 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:41:59.700247 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application [None req-2a1568ac-dd88-46ab-bc5a-e188030f21c8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 07:41:59.700247 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 07:41:59.700247 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 07:41:59.700247 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 07:41:59.700247 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 07:41:59.700247 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 07:41:59.700247 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 07:41:59.700247 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 07:41:59.700247 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 07:41:59.700247 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 07:41:59.700247 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 07:41:59.700247 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 07:41:59.700247 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 07:41:59.700247 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 07:41:59.700247 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 07:41:59.700247 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 07:41:59.701517 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 07:41:59.701517 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 07:41:59.701517 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 07:41:59.701517 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 07:41:59.701517 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 07:41:59.701517 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 07:41:59.701517 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 07:41:59.701517 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application with Lock( Sep 16 07:41:59.701517 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 07:41:59.701517 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._enter() Sep 16 07:41:59.701517 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 07:41:59.701517 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 07:41:59.701517 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 07:41:59.701517 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.creator() Sep 16 07:41:59.701517 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 07:41:59.701517 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application created_value = creator( Sep 16 07:41:59.701517 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 07:41:59.702425 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 07:41:59.702425 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 07:41:59.702425 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Sep 16 07:41:59.702425 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 228/462] 10.222.0.57 () {56 vars in 1108 bytes} [Fri Sep 16 07:41:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 07:41:59.709485 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50eb3163-e49e-4bdf-9905-2c2a2744062a None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:41:59.815056 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1568ac-dd88-46ab-bc5a-e188030f21c8 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:41:59.862663 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50eb3163-e49e-4bdf-9905-2c2a2744062a None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:41:59.891955 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:41:59.901611 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b6376e-46d0-46e8-97ae-18beb427ac1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:41:59.902381 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b6376e-46d0-46e8-97ae-18beb427ac1e None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:41:59.902763 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b6376e-46d0-46e8-97ae-18beb427ac1e None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:41:59.903136 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b6376e-46d0-46e8-97ae-18beb427ac1e None admin] PATH_INFO: `/v3/domains` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:41:59.904623 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b6376e-46d0-46e8-97ae-18beb427ac1e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:41:59.905070 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b6376e-46d0-46e8-97ae-18beb427ac1e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:41:59.906552 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b6376e-46d0-46e8-97ae-18beb427ac1e None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:41:59.921821 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 235/463] 10.222.0.57 () {56 vars in 1109 bytes} [Fri Sep 16 07:41:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:41:59.921821 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977e2d90-a291-4b56-b25d-ea09d9d3b34a None None] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:41:59.921821 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977e2d90-a291-4b56-b25d-ea09d9d3b34a None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:41:59.921821 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977e2d90-a291-4b56-b25d-ea09d9d3b34a None None] PATH_INFO: `/` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:41:59.921821 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 236/464] 10.222.0.57 () {54 vars in 927 bytes} [Fri Sep 16 07:41:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 07:41:59.924530 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977e2d90-a291-4b56-b25d-ea09d9d3b34a None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:41:59.945647 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1568ac-dd88-46ab-bc5a-e188030f21c8 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:41:59.986180 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:41:59.986424 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024ef748-f978-4310-9e8f-24ce6db374ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:41:59.987116 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024ef748-f978-4310-9e8f-24ce6db374ba None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:41:59.987399 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024ef748-f978-4310-9e8f-24ce6db374ba None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:41:59.988044 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024ef748-f978-4310-9e8f-24ce6db374ba None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:41:59.999419 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024ef748-f978-4310-9e8f-24ce6db374ba None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:42:00.000857 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024ef748-f978-4310-9e8f-24ce6db374ba None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:42:00.016403 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application [None req-024ef748-f978-4310-9e8f-24ce6db374ba None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 07:42:00.016403 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 07:42:00.016403 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 07:42:00.016403 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 07:42:00.016403 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 07:42:00.016403 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 07:42:00.016403 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 07:42:00.016403 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 07:42:00.016403 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 07:42:00.016403 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 07:42:00.016403 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 07:42:00.016403 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 07:42:00.016403 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 07:42:00.016403 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 07:42:00.016403 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 07:42:00.016403 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 07:42:00.017511 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 07:42:00.017511 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 07:42:00.017511 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 07:42:00.017511 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 07:42:00.017511 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 07:42:00.017511 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 07:42:00.017511 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 07:42:00.017511 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application with Lock( Sep 16 07:42:00.017511 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 07:42:00.017511 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._enter() Sep 16 07:42:00.017511 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 07:42:00.017511 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 07:42:00.017511 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 07:42:00.017511 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.creator() Sep 16 07:42:00.017511 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 07:42:00.017511 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application created_value = creator( Sep 16 07:42:00.017511 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 07:42:00.018685 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 07:42:00.018685 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 07:42:00.018685 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Sep 16 07:42:00.022490 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 229/465] 10.222.0.57 () {56 vars in 1108 bytes} [Fri Sep 16 07:41:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 16 07:42:00.023307 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024ef748-f978-4310-9e8f-24ce6db374ba None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:42:00.041560 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977e2d90-a291-4b56-b25d-ea09d9d3b34a None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:42:00.089135 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcee66a-3f8b-406c-9bc3-0dcac1ecb574 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:42:00.090016 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcee66a-3f8b-406c-9bc3-0dcac1ecb574 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:00.090125 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcee66a-3f8b-406c-9bc3-0dcac1ecb574 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:00.090372 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcee66a-3f8b-406c-9bc3-0dcac1ecb574 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:00.105825 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adcee66a-3f8b-406c-9bc3-0dcac1ecb574 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:42:00.111716 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adcee66a-3f8b-406c-9bc3-0dcac1ecb574 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:42:00.127163 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application [None req-adcee66a-3f8b-406c-9bc3-0dcac1ecb574 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 07:42:00.127163 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 07:42:00.127163 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 07:42:00.127163 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 07:42:00.127163 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 07:42:00.127163 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 07:42:00.127163 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 07:42:00.127163 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 07:42:00.127163 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 07:42:00.127163 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 07:42:00.127163 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 07:42:00.127163 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 07:42:00.127163 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 07:42:00.127163 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 07:42:00.127163 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 07:42:00.127163 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 07:42:00.128102 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 07:42:00.128102 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 07:42:00.128102 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 07:42:00.128102 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 07:42:00.128102 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 07:42:00.128102 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 07:42:00.128102 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 07:42:00.128102 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application with Lock( Sep 16 07:42:00.128102 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 07:42:00.128102 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._enter() Sep 16 07:42:00.128102 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 07:42:00.128102 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 07:42:00.128102 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 07:42:00.128102 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.creator() Sep 16 07:42:00.128102 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 07:42:00.128102 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application created_value = creator( Sep 16 07:42:00.128102 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 07:42:00.128948 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 07:42:00.128948 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 07:42:00.128948 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Sep 16 07:42:00.128948 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 237/466] 10.222.0.57 () {56 vars in 1108 bytes} [Fri Sep 16 07:41:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 16 07:42:00.129752 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992f2826-9dd1-446d-90c2-8d41b04fdb48 None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:00.130038 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992f2826-9dd1-446d-90c2-8d41b04fdb48 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:00.130310 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992f2826-9dd1-446d-90c2-8d41b04fdb48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:00.143311 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024ef748-f978-4310-9e8f-24ce6db374ba None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:42:00.149037 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-992f2826-9dd1-446d-90c2-8d41b04fdb48 None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:42:00.150251 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-992f2826-9dd1-446d-90c2-8d41b04fdb48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:42:00.156714 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:42:00.184137 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbb4502-5ece-457b-afbe-3e4f99454edc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:42:00.184661 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbb4502-5ece-457b-afbe-3e4f99454edc None admin] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:00.185516 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbb4502-5ece-457b-afbe-3e4f99454edc None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:00.185776 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbb4502-5ece-457b-afbe-3e4f99454edc None admin] PATH_INFO: `/v3/users` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:00.186508 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbb4502-5ece-457b-afbe-3e4f99454edc None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:42:00.187964 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbb4502-5ece-457b-afbe-3e4f99454edc None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:42:00.213005 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 230/467] 10.222.0.57 () {60 vars in 1132 bytes} [Fri Sep 16 07:42:00 2022] POST /identity/v3/users => generated 246 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 07:42:00.213905 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbb4502-5ece-457b-afbe-3e4f99454edc None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:42:00.236734 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 238/468] 10.222.0.57 () {58 vars in 1024 bytes} [Fri Sep 16 07:42:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 07:42:00.238099 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992f2826-9dd1-446d-90c2-8d41b04fdb48 None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:42:00.285639 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:42:00.332929 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbb4502-5ece-457b-afbe-3e4f99454edc None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:42:00.366483 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992f2826-9dd1-446d-90c2-8d41b04fdb48 None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:42:00.385352 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bae435a-489a-4a6a-8766-eba4b6b8f5f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:42:00.386094 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bae435a-489a-4a6a-8766-eba4b6b8f5f5 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:00.386381 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bae435a-489a-4a6a-8766-eba4b6b8f5f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:00.386655 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bae435a-489a-4a6a-8766-eba4b6b8f5f5 None admin] PATH_INFO: `/v3/domains` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:00.387318 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bae435a-489a-4a6a-8766-eba4b6b8f5f5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:42:00.387624 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bae435a-489a-4a6a-8766-eba4b6b8f5f5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:42:00.390042 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bae435a-489a-4a6a-8766-eba4b6b8f5f5 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:42:00.430101 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 231/469] 10.222.0.57 () {56 vars in 1109 bytes} [Fri Sep 16 07:42:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:42:00.436371 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bae435a-489a-4a6a-8766-eba4b6b8f5f5 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:42:00.458674 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb88eb98-33b1-48df-bc35-d56476d967c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:42:00.459350 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb88eb98-33b1-48df-bc35-d56476d967c5 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:00.459776 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb88eb98-33b1-48df-bc35-d56476d967c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:00.460147 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb88eb98-33b1-48df-bc35-d56476d967c5 None admin] PATH_INFO: `/v3/domains` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:00.460823 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb88eb98-33b1-48df-bc35-d56476d967c5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:42:00.461129 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb88eb98-33b1-48df-bc35-d56476d967c5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:42:00.462588 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb88eb98-33b1-48df-bc35-d56476d967c5 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:42:00.468218 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:42:00.481126 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 239/470] 10.222.0.57 () {56 vars in 1109 bytes} [Fri Sep 16 07:42:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:42:00.486604 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb88eb98-33b1-48df-bc35-d56476d967c5 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:42:00.549294 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bae435a-489a-4a6a-8766-eba4b6b8f5f5 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:42:00.594161 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:42:00.600225 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd35e70-48be-43a2-a1c4-a239361a89e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:42:00.600856 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd35e70-48be-43a2-a1c4-a239361a89e7 None admin] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:00.601133 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd35e70-48be-43a2-a1c4-a239361a89e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:00.601631 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd35e70-48be-43a2-a1c4-a239361a89e7 None admin] PATH_INFO: `/v3/users` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:00.602082 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd35e70-48be-43a2-a1c4-a239361a89e7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:42:00.603549 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd35e70-48be-43a2-a1c4-a239361a89e7 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:42:00.609987 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb88eb98-33b1-48df-bc35-d56476d967c5 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:42:00.632291 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 232/471] 10.222.0.57 () {60 vars in 1132 bytes} [Fri Sep 16 07:42:00 2022] POST /identity/v3/users => generated 248 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 16 07:42:00.633280 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd35e70-48be-43a2-a1c4-a239361a89e7 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:42:00.661959 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c24e83b-8cef-4d7d-a70e-40398db5f537 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:42:00.662838 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c24e83b-8cef-4d7d-a70e-40398db5f537 None admin] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:00.663030 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c24e83b-8cef-4d7d-a70e-40398db5f537 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:00.663448 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c24e83b-8cef-4d7d-a70e-40398db5f537 None admin] PATH_INFO: `/v3/users` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:00.664245 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c24e83b-8cef-4d7d-a70e-40398db5f537 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:42:00.665911 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c24e83b-8cef-4d7d-a70e-40398db5f537 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:42:00.697528 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 240/472] 10.222.0.57 () {60 vars in 1132 bytes} [Fri Sep 16 07:42:00 2022] POST /identity/v3/users => generated 248 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 16 07:42:00.727583 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7e2927-55fe-4772-9104-39a248bde4fb None None] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:00.727874 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7e2927-55fe-4772-9104-39a248bde4fb None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:00.728155 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7e2927-55fe-4772-9104-39a248bde4fb None None] PATH_INFO: `/` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:00.729959 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 241/473] 10.222.0.57 () {54 vars in 927 bytes} [Fri Sep 16 07:42:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 07:42:00.736349 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2307c04-6f52-46a6-9b43-ad2eab660b12 None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:00.736635 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2307c04-6f52-46a6-9b43-ad2eab660b12 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:00.736913 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2307c04-6f52-46a6-9b43-ad2eab660b12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:00.761358 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-a2307c04-6f52-46a6-9b43-ad2eab660b12 None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:42:00.762685 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-a2307c04-6f52-46a6-9b43-ad2eab660b12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:42:00.798307 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:42:00.842698 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd35e70-48be-43a2-a1c4-a239361a89e7 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:42:00.863335 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 242/474] 10.222.0.57 () {58 vars in 1024 bytes} [Fri Sep 16 07:42:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 16 07:42:00.885484 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0245f3-e777-4bea-8ac8-8bec3e09f53b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:42:00.886213 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0245f3-e777-4bea-8ac8-8bec3e09f53b None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:00.886493 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0245f3-e777-4bea-8ac8-8bec3e09f53b None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:00.886768 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0245f3-e777-4bea-8ac8-8bec3e09f53b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:00.900277 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0245f3-e777-4bea-8ac8-8bec3e09f53b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:42:00.901857 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0245f3-e777-4bea-8ac8-8bec3e09f53b None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:42:00.920085 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application [None req-1f0245f3-e777-4bea-8ac8-8bec3e09f53b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 07:42:00.920085 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 07:42:00.920085 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 07:42:00.920085 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 07:42:00.920085 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 07:42:00.920085 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 07:42:00.920085 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 07:42:00.920085 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 07:42:00.920085 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 07:42:00.920085 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 07:42:00.920085 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 07:42:00.920085 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 07:42:00.920085 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 07:42:00.920085 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 07:42:00.920085 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 07:42:00.920085 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 07:42:00.921044 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 07:42:00.921044 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 07:42:00.921044 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 07:42:00.921044 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 07:42:00.921044 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 07:42:00.921044 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 07:42:00.921044 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 07:42:00.921044 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application with Lock( Sep 16 07:42:00.921044 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 07:42:00.921044 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._enter() Sep 16 07:42:00.921044 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 07:42:00.921044 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 07:42:00.921044 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 07:42:00.921044 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.creator() Sep 16 07:42:00.921044 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 07:42:00.921044 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application created_value = creator( Sep 16 07:42:00.921044 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 07:42:00.921927 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 07:42:00.921927 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 07:42:00.921927 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Sep 16 07:42:00.921927 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 233/475] 10.222.0.57 () {56 vars in 1108 bytes} [Fri Sep 16 07:42:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 289 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 07:42:00.927619 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2307c04-6f52-46a6-9b43-ad2eab660b12 None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:42:01.021443 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:42:01.044161 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2307c04-6f52-46a6-9b43-ad2eab660b12 None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:42:01.086166 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7427555-69a3-4cc2-9d12-5c27a0b11323 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:42:01.087152 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7427555-69a3-4cc2-9d12-5c27a0b11323 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:01.087623 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7427555-69a3-4cc2-9d12-5c27a0b11323 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:01.087905 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7427555-69a3-4cc2-9d12-5c27a0b11323 None admin] PATH_INFO: `/v3/domains` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:01.088627 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7427555-69a3-4cc2-9d12-5c27a0b11323 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:42:01.088942 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7427555-69a3-4cc2-9d12-5c27a0b11323 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:42:01.090417 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7427555-69a3-4cc2-9d12-5c27a0b11323 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:42:01.105111 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 243/476] 10.222.0.57 () {56 vars in 1109 bytes} [Fri Sep 16 07:42:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:42:01.111708 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0245f3-e777-4bea-8ac8-8bec3e09f53b None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:42:01.192000 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7427555-69a3-4cc2-9d12-5c27a0b11323 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:42:01.252587 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0245f3-e777-4bea-8ac8-8bec3e09f53b None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:42:01.318573 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fb30b5-455d-4deb-baab-3b6a169dbab2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:42:01.319407 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fb30b5-455d-4deb-baab-3b6a169dbab2 None admin] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:01.319842 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fb30b5-455d-4deb-baab-3b6a169dbab2 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:01.320254 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fb30b5-455d-4deb-baab-3b6a169dbab2 None admin] PATH_INFO: `/v3/users` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:01.322355 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5fb30b5-455d-4deb-baab-3b6a169dbab2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:42:01.323960 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5fb30b5-455d-4deb-baab-3b6a169dbab2 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:42:01.338199 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:42:01.348687 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7427555-69a3-4cc2-9d12-5c27a0b11323 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:42:01.369854 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 234/477] 10.222.0.57 () {60 vars in 1132 bytes} [Fri Sep 16 07:42:01 2022] POST /identity/v3/users => generated 249 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 16 07:42:01.410430 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbafbaf-8266-4b58-93d6-b82030a62266 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:42:01.411297 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbafbaf-8266-4b58-93d6-b82030a62266 None admin] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:01.411721 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbafbaf-8266-4b58-93d6-b82030a62266 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:01.412191 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbafbaf-8266-4b58-93d6-b82030a62266 None admin] PATH_INFO: `/v3/roles` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:01.413132 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbafbaf-8266-4b58-93d6-b82030a62266 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:42:01.414693 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbafbaf-8266-4b58-93d6-b82030a62266 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:42:01.426470 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.sql.core [None req-1dbafbaf-8266-4b58-93d6-b82030a62266 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 16 07:42:01.426470 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Sep 16 07:42:01.426470 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [parameters: {'id': '622a54bdc7e147a88fc080fed27e5084', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Sep 16 07:42:01.426470 dv-cinder-740146-20-smb devstack@keystone.service[81430]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81430) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 16 07:42:01.447841 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application [None req-1dbafbaf-8266-4b58-93d6-b82030a62266 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Sep 16 07:42:01.447841 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 07:42:01.447841 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 16 07:42:01.447841 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 16 07:42:01.447841 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 16 07:42:01.447841 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 16 07:42:01.447841 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 16 07:42:01.447841 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application result = self._query(query) Sep 16 07:42:01.447841 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 16 07:42:01.447841 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application conn.query(q) Sep 16 07:42:01.447841 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 16 07:42:01.447841 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 16 07:42:01.447841 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 16 07:42:01.447841 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application result.read() Sep 16 07:42:01.447841 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 16 07:42:01.448954 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 16 07:42:01.448954 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 16 07:42:01.448954 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 16 07:42:01.448954 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 16 07:42:01.448954 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 16 07:42:01.448954 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 16 07:42:01.448954 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 16 07:42:01.448954 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 16 07:42:01.448954 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Sep 16 07:42:01.448954 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 16 07:42:01.448954 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Sep 16 07:42:01.448954 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 07:42:01.448954 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 16 07:42:01.448954 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 16 07:42:01.448954 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Sep 16 07:42:01.448954 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return ref.to_dict() Sep 16 07:42:01.448954 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 16 07:42:01.448954 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application next(self.gen) Sep 16 07:42:01.450096 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 16 07:42:01.450096 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application yield resource Sep 16 07:42:01.450096 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 16 07:42:01.450096 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application next(self.gen) Sep 16 07:42:01.450096 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 16 07:42:01.450096 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application self.session.rollback() Sep 16 07:42:01.450096 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 16 07:42:01.450096 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application self.force_reraise() Sep 16 07:42:01.450096 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 16 07:42:01.450096 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application raise self.value Sep 16 07:42:01.450096 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 16 07:42:01.450096 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 16 07:42:01.450096 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 16 07:42:01.450096 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application session.commit() Sep 16 07:42:01.450096 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 16 07:42:01.450096 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 16 07:42:01.450096 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 16 07:42:01.451588 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application self._prepare_impl() Sep 16 07:42:01.451588 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 16 07:42:01.451588 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application self.session.flush() Sep 16 07:42:01.451588 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 16 07:42:01.451588 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application self._flush(objects) Sep 16 07:42:01.451588 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 16 07:42:01.451588 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 16 07:42:01.451588 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 16 07:42:01.451588 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application compat.raise_( Sep 16 07:42:01.451588 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 16 07:42:01.451588 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application raise exception Sep 16 07:42:01.451588 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 16 07:42:01.451588 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application flush_context.execute() Sep 16 07:42:01.451588 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 16 07:42:01.451588 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application rec.execute(self) Sep 16 07:42:01.451588 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 16 07:42:01.451588 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 16 07:42:01.452537 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 16 07:42:01.452537 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 16 07:42:01.452537 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Sep 16 07:42:01.452537 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application c = connection._execute_20( Sep 16 07:42:01.452537 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 16 07:42:01.452537 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 16 07:42:01.452537 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 16 07:42:01.452537 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 16 07:42:01.452537 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 16 07:42:01.452537 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 16 07:42:01.452537 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 16 07:42:01.452537 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 16 07:42:01.452537 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 16 07:42:01.452537 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 16 07:42:01.452537 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 16 07:42:01.452537 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application raise exception Sep 16 07:42:01.453531 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 16 07:42:01.453531 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 16 07:42:01.453531 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 16 07:42:01.453531 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 16 07:42:01.453531 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 16 07:42:01.453531 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application result = self._query(query) Sep 16 07:42:01.453531 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 16 07:42:01.453531 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application conn.query(q) Sep 16 07:42:01.453531 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 16 07:42:01.453531 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 16 07:42:01.453531 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 16 07:42:01.453531 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application result.read() Sep 16 07:42:01.453531 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 16 07:42:01.453531 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 16 07:42:01.453531 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 16 07:42:01.453531 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 16 07:42:01.458727 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 16 07:42:01.458727 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 16 07:42:01.458727 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 16 07:42:01.458727 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 16 07:42:01.458727 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 16 07:42:01.458727 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Sep 16 07:42:01.458727 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application [parameters: {'id': '622a54bdc7e147a88fc080fed27e5084', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Sep 16 07:42:01.458727 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 16 07:42:01.458727 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Sep 16 07:42:01.458727 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 16 07:42:01.458727 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Sep 16 07:42:01.458727 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 07:42:01.458727 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 07:42:01.458727 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 07:42:01.458727 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 07:42:01.458727 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 07:42:01.459728 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 07:42:01.459728 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 07:42:01.459728 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 07:42:01.459728 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 07:42:01.459728 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 07:42:01.459728 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 07:42:01.459728 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Sep 16 07:42:01.459728 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Sep 16 07:42:01.459728 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 07:42:01.459728 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 07:42:01.459728 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Sep 16 07:42:01.459728 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Sep 16 07:42:01.459728 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 16 07:42:01.459728 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 16 07:42:01.459728 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Sep 16 07:42:01.459728 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Sep 16 07:42:01.463020 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 244/478] 10.222.0.57 () {60 vars in 1131 bytes} [Fri Sep 16 07:42:01 2022] POST /identity/v3/roles => generated 144 bytes in 271 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Sep 16 07:42:01.469935 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fb30b5-455d-4deb-baab-3b6a169dbab2 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:42:01.630413 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fb30b5-455d-4deb-baab-3b6a169dbab2 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:42:01.670324 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b38a4f5-e0f1-4b4c-a937-bd757609297b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:42:01.671189 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b38a4f5-e0f1-4b4c-a937-bd757609297b None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:01.671612 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b38a4f5-e0f1-4b4c-a937-bd757609297b None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:01.672027 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b38a4f5-e0f1-4b4c-a937-bd757609297b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:01.682950 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b38a4f5-e0f1-4b4c-a937-bd757609297b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 07:42:01.688984 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application [None req-5b38a4f5-e0f1-4b4c-a937-bd757609297b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 16 07:42:01.688984 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 07:42:01.688984 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 07:42:01.688984 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 07:42:01.688984 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 07:42:01.688984 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 07:42:01.688984 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 07:42:01.688984 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 07:42:01.688984 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 07:42:01.688984 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 07:42:01.688984 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 07:42:01.688984 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 07:42:01.688984 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 07:42:01.688984 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 07:42:01.688984 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 07:42:01.688984 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 07:42:01.690117 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 07:42:01.690117 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 07:42:01.690117 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 07:42:01.690117 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 07:42:01.690117 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 07:42:01.690117 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 07:42:01.690117 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 07:42:01.690117 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 07:42:01.690117 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 07:42:01.690117 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 07:42:01.690117 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 07:42:01.690117 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application with Lock( Sep 16 07:42:01.690117 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 07:42:01.690117 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._enter() Sep 16 07:42:01.690117 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 07:42:01.690117 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 07:42:01.690996 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 07:42:01.690996 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.creator() Sep 16 07:42:01.690996 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 07:42:01.690996 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application created_value = creator( Sep 16 07:42:01.690996 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 07:42:01.690996 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 07:42:01.690996 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 07:42:01.690996 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 07:42:01.690996 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 07:42:01.690996 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 07:42:01.690996 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 16 07:42:01.690996 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Sep 16 07:42:01.693134 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 235/479] 10.222.0.57 () {56 vars in 1114 bytes} [Fri Sep 16 07:42:01 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 07:42:01.698883 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbafbaf-8266-4b58-93d6-b82030a62266 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:42:01.711631 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:42:01.817103 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbafbaf-8266-4b58-93d6-b82030a62266 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:42:01.852253 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975c7760-7564-4f69-9e29-ad9029a0ca8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:42:01.852865 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975c7760-7564-4f69-9e29-ad9029a0ca8e None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:01.853204 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975c7760-7564-4f69-9e29-ad9029a0ca8e None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:01.853486 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975c7760-7564-4f69-9e29-ad9029a0ca8e None admin] PATH_INFO: `/v3/roles` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:01.854185 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975c7760-7564-4f69-9e29-ad9029a0ca8e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:42:01.854488 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975c7760-7564-4f69-9e29-ad9029a0ca8e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:42:01.855853 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975c7760-7564-4f69-9e29-ad9029a0ca8e None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:42:01.864916 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 245/480] 10.222.0.57 () {56 vars in 1111 bytes} [Fri Sep 16 07:42:01 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 07:42:02.930279 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb223c8e-aa63-42d2-8ef1-5cc91a0e34c9 None None] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:02.930830 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb223c8e-aa63-42d2-8ef1-5cc91a0e34c9 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:02.930830 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb223c8e-aa63-42d2-8ef1-5cc91a0e34c9 None None] PATH_INFO: `/` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:02.932414 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 236/481] 10.222.0.57 () {54 vars in 927 bytes} [Fri Sep 16 07:42:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 07:42:02.938800 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b8202e-fa2a-4469-bcf0-3b7ccb13f7b1 None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:02.939266 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b8202e-fa2a-4469-bcf0-3b7ccb13f7b1 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:02.939356 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b8202e-fa2a-4469-bcf0-3b7ccb13f7b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:02.957584 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-65b8202e-fa2a-4469-bcf0-3b7ccb13f7b1 None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:42:02.958812 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-65b8202e-fa2a-4469-bcf0-3b7ccb13f7b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:42:03.044654 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:42:03.050470 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 246/482] 10.222.0.57 () {58 vars in 1024 bytes} [Fri Sep 16 07:42:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 07:42:03.396751 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb223c8e-aa63-42d2-8ef1-5cc91a0e34c9 None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:42:03.454601 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:42:03.522628 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb223c8e-aa63-42d2-8ef1-5cc91a0e34c9 None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:42:03.536062 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a71cc1-e94c-44d0-a845-e330e459717c None None] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:03.536357 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a71cc1-e94c-44d0-a845-e330e459717c None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:03.536630 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a71cc1-e94c-44d0-a845-e330e459717c None None] PATH_INFO: `/` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:03.539416 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 247/483] 10.222.0.57 () {54 vars in 927 bytes} [Fri Sep 16 07:42:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 07:42:03.543321 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7046c25b-4e73-45ae-b759-58c62d9fe138 None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:03.543607 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7046c25b-4e73-45ae-b759-58c62d9fe138 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:03.543884 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7046c25b-4e73-45ae-b759-58c62d9fe138 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:03.562231 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-7046c25b-4e73-45ae-b759-58c62d9fe138 None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:42:03.563598 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-7046c25b-4e73-45ae-b759-58c62d9fe138 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:42:03.565294 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76eab74-ab74-4199-9df6-99d5a71d9f87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:42:03.565945 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76eab74-ab74-4199-9df6-99d5a71d9f87 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:03.566222 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76eab74-ab74-4199-9df6-99d5a71d9f87 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:03.566494 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76eab74-ab74-4199-9df6-99d5a71d9f87 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:03.589451 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76eab74-ab74-4199-9df6-99d5a71d9f87 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 07:42:03.598418 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application [None req-e76eab74-ab74-4199-9df6-99d5a71d9f87 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 16 07:42:03.598418 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 07:42:03.598418 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 07:42:03.598418 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 07:42:03.598418 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 07:42:03.598418 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 07:42:03.598418 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 07:42:03.598418 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 07:42:03.598418 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 07:42:03.598418 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 07:42:03.598418 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 07:42:03.598418 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 07:42:03.598418 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 07:42:03.598418 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 07:42:03.598418 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 07:42:03.598418 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 07:42:03.599310 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 07:42:03.599310 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 07:42:03.599310 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 07:42:03.599310 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 07:42:03.599310 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 07:42:03.599310 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 07:42:03.599310 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 07:42:03.599310 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 07:42:03.599310 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 07:42:03.599310 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 07:42:03.599310 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 07:42:03.599310 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application with Lock( Sep 16 07:42:03.599310 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 07:42:03.599310 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._enter() Sep 16 07:42:03.599310 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 07:42:03.599310 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 07:42:03.600131 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 07:42:03.600131 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.creator() Sep 16 07:42:03.600131 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 07:42:03.600131 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application created_value = creator( Sep 16 07:42:03.600131 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 07:42:03.600131 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 07:42:03.600131 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 07:42:03.600131 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 07:42:03.600131 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 07:42:03.600131 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 07:42:03.600131 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 16 07:42:03.600131 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Sep 16 07:42:03.605825 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 237/484] 10.222.0.57 () {56 vars in 1102 bytes} [Fri Sep 16 07:42:03 2022] GET /identity/v3/roles/service => generated 85 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 07:42:03.607692 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb74f91c-0ade-4927-915f-63a165595123 None None] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:03.607972 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb74f91c-0ade-4927-915f-63a165595123 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:03.608251 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb74f91c-0ade-4927-915f-63a165595123 None None] PATH_INFO: `/` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:03.609688 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 238/485] 10.222.0.57 () {54 vars in 927 bytes} [Fri Sep 16 07:42:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 16 07:42:03.610277 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb74f91c-0ade-4927-915f-63a165595123 None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:42:03.677889 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 248/486] 10.222.0.57 () {58 vars in 1024 bytes} [Fri Sep 16 07:42:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 16 07:42:03.677889 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5ccc32-7f51-4499-8c79-f7939c922c92 None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:03.677889 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5ccc32-7f51-4499-8c79-f7939c922c92 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:03.677889 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5ccc32-7f51-4499-8c79-f7939c922c92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:03.696392 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-9e5ccc32-7f51-4499-8c79-f7939c922c92 None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:42:03.697959 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-9e5ccc32-7f51-4499-8c79-f7939c922c92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:42:03.791998 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb74f91c-0ade-4927-915f-63a165595123 None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:42:03.809126 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 249/487] 10.222.0.57 () {58 vars in 1024 bytes} [Fri Sep 16 07:42:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 07:42:03.820537 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:42:03.836299 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271ee034-c6ac-47af-8cc5-28177a42054a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:42:03.836907 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271ee034-c6ac-47af-8cc5-28177a42054a None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:03.837179 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271ee034-c6ac-47af-8cc5-28177a42054a None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:03.837445 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271ee034-c6ac-47af-8cc5-28177a42054a None admin] PATH_INFO: `/v3/roles` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:03.838138 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271ee034-c6ac-47af-8cc5-28177a42054a None admin] RBAC: Adding query filter params (name=service) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:42:03.838434 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271ee034-c6ac-47af-8cc5-28177a42054a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:42:03.839807 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271ee034-c6ac-47af-8cc5-28177a42054a None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:42:03.849606 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 239/488] 10.222.0.57 () {56 vars in 1103 bytes} [Fri Sep 16 07:42:03 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:42:03.855269 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5ccc32-7f51-4499-8c79-f7939c922c92 None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:42:03.926514 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:42:03.981643 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5ccc32-7f51-4499-8c79-f7939c922c92 None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:42:04.032495 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57bf953-af78-489a-a5ca-a2f9c3921fb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:42:04.033193 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57bf953-af78-489a-a5ca-a2f9c3921fb5 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:04.033480 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57bf953-af78-489a-a5ca-a2f9c3921fb5 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:04.033757 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57bf953-af78-489a-a5ca-a2f9c3921fb5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:04.045415 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57bf953-af78-489a-a5ca-a2f9c3921fb5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:42:04.046872 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57bf953-af78-489a-a5ca-a2f9c3921fb5 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:42:04.049953 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271ee034-c6ac-47af-8cc5-28177a42054a None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:42:04.076131 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application [None req-c57bf953-af78-489a-a5ca-a2f9c3921fb5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 07:42:04.076131 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 07:42:04.076131 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 07:42:04.076131 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 07:42:04.076131 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 07:42:04.076131 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 07:42:04.076131 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 07:42:04.076131 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 07:42:04.076131 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 07:42:04.076131 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 07:42:04.076131 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 07:42:04.076131 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 07:42:04.076131 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 07:42:04.076131 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 07:42:04.076131 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 07:42:04.076131 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 07:42:04.077094 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 07:42:04.077094 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 07:42:04.077094 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 07:42:04.077094 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 07:42:04.077094 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 07:42:04.077094 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 07:42:04.077094 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 07:42:04.077094 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application with Lock( Sep 16 07:42:04.077094 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 07:42:04.077094 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._enter() Sep 16 07:42:04.077094 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 07:42:04.077094 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 07:42:04.077094 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 07:42:04.077094 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.creator() Sep 16 07:42:04.077094 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 07:42:04.077094 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application created_value = creator( Sep 16 07:42:04.077094 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 07:42:04.077983 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 07:42:04.077983 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 07:42:04.077983 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Sep 16 07:42:04.082041 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 250/489] 10.222.0.57 () {56 vars in 1108 bytes} [Fri Sep 16 07:42:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 07:42:04.083239 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57bf953-af78-489a-a5ca-a2f9c3921fb5 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:42:04.199602 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57bf953-af78-489a-a5ca-a2f9c3921fb5 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:42:04.212936 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:42:04.238441 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271ee034-c6ac-47af-8cc5-28177a42054a None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:42:04.243871 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16d7ecf-1b43-45fa-aad4-be3b420c3573 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:42:04.244478 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16d7ecf-1b43-45fa-aad4-be3b420c3573 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:04.244755 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16d7ecf-1b43-45fa-aad4-be3b420c3573 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:04.245024 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16d7ecf-1b43-45fa-aad4-be3b420c3573 None admin] PATH_INFO: `/v3/domains` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:04.245664 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16d7ecf-1b43-45fa-aad4-be3b420c3573 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:42:04.246007 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16d7ecf-1b43-45fa-aad4-be3b420c3573 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:42:04.247397 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16d7ecf-1b43-45fa-aad4-be3b420c3573 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:42:04.265825 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 251/490] 10.222.0.57 () {56 vars in 1109 bytes} [Fri Sep 16 07:42:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 07:42:04.267088 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16d7ecf-1b43-45fa-aad4-be3b420c3573 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:42:04.283236 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89d004b-baff-4eca-ac63-cb5b6885fcbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:42:04.284360 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89d004b-baff-4eca-ac63-cb5b6885fcbf None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:04.284938 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89d004b-baff-4eca-ac63-cb5b6885fcbf None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:04.285412 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89d004b-baff-4eca-ac63-cb5b6885fcbf None admin] PATH_INFO: `/v3/roles/service` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:04.298993 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89d004b-baff-4eca-ac63-cb5b6885fcbf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 07:42:04.305004 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application [None req-e89d004b-baff-4eca-ac63-cb5b6885fcbf None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 16 07:42:04.305004 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 07:42:04.305004 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 07:42:04.305004 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 07:42:04.305004 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 07:42:04.305004 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 07:42:04.305004 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 07:42:04.305004 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 07:42:04.305004 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 07:42:04.305004 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 07:42:04.305004 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 07:42:04.305004 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 07:42:04.305004 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 07:42:04.305004 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 07:42:04.305004 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 07:42:04.305004 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 07:42:04.305953 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 07:42:04.305953 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 07:42:04.305953 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 07:42:04.305953 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 07:42:04.305953 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 07:42:04.305953 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 07:42:04.305953 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 07:42:04.305953 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 07:42:04.305953 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 07:42:04.305953 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 07:42:04.305953 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 07:42:04.305953 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application with Lock( Sep 16 07:42:04.305953 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 07:42:04.305953 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._enter() Sep 16 07:42:04.305953 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 07:42:04.305953 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 07:42:04.306772 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 07:42:04.306772 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.creator() Sep 16 07:42:04.306772 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 07:42:04.306772 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application created_value = creator( Sep 16 07:42:04.306772 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 07:42:04.306772 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 07:42:04.306772 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 07:42:04.306772 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 07:42:04.306772 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 07:42:04.306772 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 07:42:04.306772 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 16 07:42:04.306772 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Sep 16 07:42:04.309410 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 240/491] 10.222.0.57 () {56 vars in 1102 bytes} [Fri Sep 16 07:42:04 2022] GET /identity/v3/roles/service => generated 85 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 07:42:04.310781 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89d004b-baff-4eca-ac63-cb5b6885fcbf None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:42:04.378129 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:42:04.394976 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16d7ecf-1b43-45fa-aad4-be3b420c3573 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:42:04.418006 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89d004b-baff-4eca-ac63-cb5b6885fcbf None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:42:04.437773 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca9c243-8eb3-451a-a42f-b9b511bc70b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:42:04.438386 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca9c243-8eb3-451a-a42f-b9b511bc70b2 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:04.438937 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca9c243-8eb3-451a-a42f-b9b511bc70b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:04.438937 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca9c243-8eb3-451a-a42f-b9b511bc70b2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:04.449147 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca9c243-8eb3-451a-a42f-b9b511bc70b2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 07:42:04.453209 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf8eca0-9ec6-4101-990f-7a2137413a7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:42:04.453863 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf8eca0-9ec6-4101-990f-7a2137413a7c None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:04.454145 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf8eca0-9ec6-4101-990f-7a2137413a7c None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:04.454418 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf8eca0-9ec6-4101-990f-7a2137413a7c None admin] PATH_INFO: `/v3/users/nova` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:04.454787 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application [None req-eca9c243-8eb3-451a-a42f-b9b511bc70b2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 16 07:42:04.454787 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 07:42:04.454787 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 07:42:04.454787 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 07:42:04.454787 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 07:42:04.454787 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 07:42:04.454787 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 07:42:04.454787 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 07:42:04.454787 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 07:42:04.454787 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 07:42:04.454787 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 07:42:04.454787 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 07:42:04.454787 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 07:42:04.454787 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 07:42:04.454787 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 07:42:04.454787 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 07:42:04.455636 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 07:42:04.455636 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 07:42:04.455636 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 07:42:04.455636 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 07:42:04.455636 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 07:42:04.455636 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 07:42:04.455636 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 07:42:04.455636 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 07:42:04.455636 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 07:42:04.455636 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 07:42:04.455636 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 07:42:04.455636 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application with Lock( Sep 16 07:42:04.455636 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 07:42:04.455636 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._enter() Sep 16 07:42:04.455636 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 07:42:04.455636 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 07:42:04.456416 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 07:42:04.456416 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.creator() Sep 16 07:42:04.456416 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 07:42:04.456416 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application created_value = creator( Sep 16 07:42:04.456416 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 07:42:04.456416 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 07:42:04.456416 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 07:42:04.456416 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 07:42:04.456416 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 07:42:04.456416 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 07:42:04.456416 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 16 07:42:04.456416 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Sep 16 07:42:04.456416 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 252/492] 10.222.0.57 () {56 vars in 1102 bytes} [Fri Sep 16 07:42:04 2022] GET /identity/v3/roles/service => generated 85 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 07:42:04.457088 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca9c243-8eb3-451a-a42f-b9b511bc70b2 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:42:04.466828 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf8eca0-9ec6-4101-990f-7a2137413a7c None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:42:04.468477 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf8eca0-9ec6-4101-990f-7a2137413a7c None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:42:04.482982 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application [None req-bdf8eca0-9ec6-4101-990f-7a2137413a7c None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 16 07:42:04.482982 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 07:42:04.482982 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 07:42:04.482982 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 07:42:04.482982 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 07:42:04.482982 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 07:42:04.482982 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 07:42:04.482982 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 07:42:04.482982 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 07:42:04.482982 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 07:42:04.482982 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 07:42:04.482982 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 07:42:04.482982 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 16 07:42:04.482982 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 16 07:42:04.482982 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 16 07:42:04.482982 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 16 07:42:04.483964 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 07:42:04.483964 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 07:42:04.483964 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 16 07:42:04.483964 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 07:42:04.483964 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 16 07:42:04.483964 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 07:42:04.483964 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 07:42:04.483964 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 07:42:04.483964 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 07:42:04.483964 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 07:42:04.483964 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 07:42:04.483964 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application with Lock( Sep 16 07:42:04.483964 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 07:42:04.483964 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._enter() Sep 16 07:42:04.483964 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 07:42:04.483964 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 07:42:04.483964 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 07:42:04.483964 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.creator() Sep 16 07:42:04.484835 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 07:42:04.484835 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application created_value = creator( Sep 16 07:42:04.484835 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 16 07:42:04.484835 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 16 07:42:04.484835 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 16 07:42:04.484835 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 16 07:42:04.484835 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 16 07:42:04.484835 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 16 07:42:04.484835 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 16 07:42:04.484835 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Sep 16 07:42:04.490975 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 241/493] 10.222.0.57 () {56 vars in 1093 bytes} [Fri Sep 16 07:42:04 2022] GET /identity/v3/users/nova => generated 82 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 07:42:04.491547 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:42:04.492304 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ddaa15-a96d-4666-b155-001c5ab66aa3 None None] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:04.492592 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ddaa15-a96d-4666-b155-001c5ab66aa3 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:04.492970 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ddaa15-a96d-4666-b155-001c5ab66aa3 None None] PATH_INFO: `/` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:04.495657 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 242/494] 10.222.0.57 () {54 vars in 927 bytes} [Fri Sep 16 07:42:04 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 07:42:04.498486 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ddaa15-a96d-4666-b155-001c5ab66aa3 None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:42:04.570642 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca9c243-8eb3-451a-a42f-b9b511bc70b2 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:42:04.599993 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:42:04.609523 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3642b6-264f-4a82-95e5-597bbfa61b6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:42:04.610113 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ddaa15-a96d-4666-b155-001c5ab66aa3 None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:42:04.610237 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3642b6-264f-4a82-95e5-597bbfa61b6c None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:04.610418 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3642b6-264f-4a82-95e5-597bbfa61b6c None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:04.610690 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3642b6-264f-4a82-95e5-597bbfa61b6c None admin] PATH_INFO: `/v3/roles` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:04.611350 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3642b6-264f-4a82-95e5-597bbfa61b6c None admin] RBAC: Adding query filter params (name=service) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:42:04.611657 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3642b6-264f-4a82-95e5-597bbfa61b6c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:42:04.613025 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3642b6-264f-4a82-95e5-597bbfa61b6c None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:42:04.621130 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 253/495] 10.222.0.57 () {56 vars in 1103 bytes} [Fri Sep 16 07:42:04 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:42:04.621961 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3642b6-264f-4a82-95e5-597bbfa61b6c None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:42:04.651651 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6090ad79-320f-428d-ad25-21166648a273 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:42:04.652260 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6090ad79-320f-428d-ad25-21166648a273 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:04.652539 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6090ad79-320f-428d-ad25-21166648a273 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:04.652810 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6090ad79-320f-428d-ad25-21166648a273 None admin] PATH_INFO: `/v3/roles` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:04.654101 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6090ad79-320f-428d-ad25-21166648a273 None admin] RBAC: Adding query filter params (name=service) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:42:04.654410 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6090ad79-320f-428d-ad25-21166648a273 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:42:04.655800 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6090ad79-320f-428d-ad25-21166648a273 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:42:04.668743 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 243/496] 10.222.0.57 () {56 vars in 1103 bytes} [Fri Sep 16 07:42:04 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:42:04.668743 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156e23ef-6f12-4584-a911-0b6e3a99751a None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:04.668743 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156e23ef-6f12-4584-a911-0b6e3a99751a None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:04.668743 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156e23ef-6f12-4584-a911-0b6e3a99751a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:04.686970 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-156e23ef-6f12-4584-a911-0b6e3a99751a None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:42:04.688874 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-156e23ef-6f12-4584-a911-0b6e3a99751a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:42:04.728045 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:42:04.738726 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3642b6-264f-4a82-95e5-597bbfa61b6c None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:42:04.773417 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 244/497] 10.222.0.57 () {58 vars in 1024 bytes} [Fri Sep 16 07:42:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 07:42:04.774287 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156e23ef-6f12-4584-a911-0b6e3a99751a None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:42:04.783429 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a1202a-21af-4bfe-9301-bba658380188 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:42:04.784146 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a1202a-21af-4bfe-9301-bba658380188 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:04.784525 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a1202a-21af-4bfe-9301-bba658380188 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:04.784911 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a1202a-21af-4bfe-9301-bba658380188 None admin] PATH_INFO: `/v3/users` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:04.785768 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a1202a-21af-4bfe-9301-bba658380188 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:42:04.786189 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a1202a-21af-4bfe-9301-bba658380188 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:42:04.787689 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a1202a-21af-4bfe-9301-bba658380188 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:42:04.829488 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 254/498] 10.222.0.57 () {56 vars in 1133 bytes} [Fri Sep 16 07:42:04 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:42:04.830397 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a1202a-21af-4bfe-9301-bba658380188 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:42:04.869902 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:42:04.891298 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156e23ef-6f12-4584-a911-0b6e3a99751a None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:42:04.927944 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0c8d88-94b0-47d3-95fb-0b1de8dc2dda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:42:04.928844 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0c8d88-94b0-47d3-95fb-0b1de8dc2dda None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:04.929198 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0c8d88-94b0-47d3-95fb-0b1de8dc2dda None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:04.929475 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0c8d88-94b0-47d3-95fb-0b1de8dc2dda None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:04.934027 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a1202a-21af-4bfe-9301-bba658380188 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:42:04.940231 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0c8d88-94b0-47d3-95fb-0b1de8dc2dda None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:42:04.941684 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0c8d88-94b0-47d3-95fb-0b1de8dc2dda None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:42:04.956460 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application [None req-ce0c8d88-94b0-47d3-95fb-0b1de8dc2dda None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 07:42:04.956460 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 07:42:04.956460 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 07:42:04.956460 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 07:42:04.956460 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 07:42:04.956460 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 07:42:04.956460 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 07:42:04.956460 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 07:42:04.956460 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 07:42:04.956460 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 07:42:04.956460 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 07:42:04.956460 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 07:42:04.956460 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 07:42:04.956460 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 07:42:04.956460 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 07:42:04.956460 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 07:42:04.957365 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 07:42:04.957365 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 07:42:04.957365 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 07:42:04.957365 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 07:42:04.957365 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 07:42:04.957365 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 07:42:04.957365 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 07:42:04.957365 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application with Lock( Sep 16 07:42:04.957365 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 07:42:04.957365 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._enter() Sep 16 07:42:04.957365 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 07:42:04.957365 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 07:42:04.957365 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 07:42:04.957365 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.creator() Sep 16 07:42:04.957365 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 07:42:04.957365 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application created_value = creator( Sep 16 07:42:04.957365 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 07:42:04.958588 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 07:42:04.958588 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 07:42:04.958588 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Sep 16 07:42:04.958588 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 245/499] 10.222.0.57 () {56 vars in 1108 bytes} [Fri Sep 16 07:42:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 07:42:04.958588 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0c8d88-94b0-47d3-95fb-0b1de8dc2dda None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:42:04.975694 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd999ac-c8ee-4a3f-8dfd-221d8506512e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:42:04.976326 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd999ac-c8ee-4a3f-8dfd-221d8506512e None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:04.976600 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd999ac-c8ee-4a3f-8dfd-221d8506512e None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:04.976868 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd999ac-c8ee-4a3f-8dfd-221d8506512e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:04.987589 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd999ac-c8ee-4a3f-8dfd-221d8506512e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:42:04.989501 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd999ac-c8ee-4a3f-8dfd-221d8506512e None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:42:05.004622 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application [None req-2bd999ac-c8ee-4a3f-8dfd-221d8506512e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 07:42:05.004622 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 07:42:05.004622 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 07:42:05.004622 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 07:42:05.004622 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 07:42:05.004622 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 07:42:05.004622 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 07:42:05.004622 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 07:42:05.004622 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 07:42:05.004622 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 07:42:05.004622 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 07:42:05.004622 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 07:42:05.004622 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 07:42:05.004622 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 07:42:05.004622 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 07:42:05.004622 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 07:42:05.005514 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 07:42:05.005514 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 07:42:05.005514 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 07:42:05.005514 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 07:42:05.005514 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 07:42:05.005514 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 07:42:05.005514 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 07:42:05.005514 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application with Lock( Sep 16 07:42:05.005514 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 07:42:05.005514 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._enter() Sep 16 07:42:05.005514 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 07:42:05.005514 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 07:42:05.005514 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 07:42:05.005514 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.creator() Sep 16 07:42:05.005514 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 07:42:05.005514 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application created_value = creator( Sep 16 07:42:05.005514 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 07:42:05.006957 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 07:42:05.006957 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 07:42:05.006957 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Sep 16 07:42:05.006957 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 255/500] 10.222.0.57 () {56 vars in 1108 bytes} [Fri Sep 16 07:42:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 07:42:05.007170 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15372086-08ed-4ed8-9c02-fe807c63d24d None None] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:05.007463 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15372086-08ed-4ed8-9c02-fe807c63d24d None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:05.007695 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15372086-08ed-4ed8-9c02-fe807c63d24d None None] PATH_INFO: `/` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:05.009048 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 256/501] 10.222.0.57 () {54 vars in 927 bytes} [Fri Sep 16 07:42:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 07:42:05.014513 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15372086-08ed-4ed8-9c02-fe807c63d24d None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:42:05.017194 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:42:05.069461 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0c8d88-94b0-47d3-95fb-0b1de8dc2dda None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:42:05.108355 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0bbbb8-e55e-4632-b3bb-640f1588b167 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:42:05.108961 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0bbbb8-e55e-4632-b3bb-640f1588b167 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:05.109240 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0bbbb8-e55e-4632-b3bb-640f1588b167 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:05.109508 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0bbbb8-e55e-4632-b3bb-640f1588b167 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:05.113614 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:42:05.121908 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15372086-08ed-4ed8-9c02-fe807c63d24d None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:42:05.155015 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0701586b-c640-4767-8c17-80aac8df2183 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:42:05.155612 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0701586b-c640-4767-8c17-80aac8df2183 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:05.155890 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0701586b-c640-4767-8c17-80aac8df2183 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:05.156155 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0701586b-c640-4767-8c17-80aac8df2183 None admin] PATH_INFO: `/v3/domains` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:05.156792 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0701586b-c640-4767-8c17-80aac8df2183 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:42:05.157093 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0701586b-c640-4767-8c17-80aac8df2183 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:42:05.158495 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0701586b-c640-4767-8c17-80aac8df2183 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:42:05.170544 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 257/502] 10.222.0.57 () {56 vars in 1109 bytes} [Fri Sep 16 07:42:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:42:05.171348 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0701586b-c640-4767-8c17-80aac8df2183 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:42:05.183260 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0bbbb8-e55e-4632-b3bb-640f1588b167 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:42:05.184875 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0bbbb8-e55e-4632-b3bb-640f1588b167 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:42:05.233613 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:42:05.271556 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0701586b-c640-4767-8c17-80aac8df2183 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:42:05.281470 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 246/503] 10.222.0.57 () {58 vars in 1282 bytes} [Fri Sep 16 07:42:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 16 07:42:05.282867 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47fc6b5-5ae8-4fe1-8f72-17785658c60c None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:05.283155 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47fc6b5-5ae8-4fe1-8f72-17785658c60c None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:05.283428 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47fc6b5-5ae8-4fe1-8f72-17785658c60c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:05.301418 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-a47fc6b5-5ae8-4fe1-8f72-17785658c60c None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:42:05.302674 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-a47fc6b5-5ae8-4fe1-8f72-17785658c60c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:42:05.309941 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811d8eea-2858-4153-8de6-7d22332ec011 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:42:05.310513 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811d8eea-2858-4153-8de6-7d22332ec011 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:05.310789 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811d8eea-2858-4153-8de6-7d22332ec011 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:05.311060 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811d8eea-2858-4153-8de6-7d22332ec011 None admin] PATH_INFO: `/v3/domains` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:05.311691 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811d8eea-2858-4153-8de6-7d22332ec011 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:42:05.311990 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811d8eea-2858-4153-8de6-7d22332ec011 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:42:05.313332 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811d8eea-2858-4153-8de6-7d22332ec011 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:42:05.324141 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 258/504] 10.222.0.57 () {56 vars in 1109 bytes} [Fri Sep 16 07:42:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:42:05.324854 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811d8eea-2858-4153-8de6-7d22332ec011 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:42:05.331877 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:42:05.370008 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 247/505] 10.222.0.57 () {58 vars in 1024 bytes} [Fri Sep 16 07:42:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 07:42:05.370831 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47fc6b5-5ae8-4fe1-8f72-17785658c60c None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:42:05.429518 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811d8eea-2858-4153-8de6-7d22332ec011 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:42:05.453253 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:42:05.465833 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7b79c5-f127-42e2-bca3-7c546ecf4b39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:42:05.466458 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7b79c5-f127-42e2-bca3-7c546ecf4b39 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:05.466737 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7b79c5-f127-42e2-bca3-7c546ecf4b39 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:05.467018 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7b79c5-f127-42e2-bca3-7c546ecf4b39 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:05.477380 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7b79c5-f127-42e2-bca3-7c546ecf4b39 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 07:42:05.483319 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application [None req-ab7b79c5-f127-42e2-bca3-7c546ecf4b39 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 16 07:42:05.483319 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 07:42:05.483319 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 07:42:05.483319 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 07:42:05.483319 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 07:42:05.483319 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 07:42:05.483319 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 07:42:05.483319 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 07:42:05.483319 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 07:42:05.483319 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 07:42:05.483319 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 07:42:05.483319 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 07:42:05.483319 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 07:42:05.483319 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 07:42:05.483319 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 07:42:05.483319 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 07:42:05.484221 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 07:42:05.484221 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 07:42:05.484221 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 07:42:05.484221 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 07:42:05.484221 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 07:42:05.484221 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 07:42:05.484221 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 07:42:05.484221 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 07:42:05.484221 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 07:42:05.484221 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 07:42:05.484221 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 07:42:05.484221 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application with Lock( Sep 16 07:42:05.484221 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 07:42:05.484221 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._enter() Sep 16 07:42:05.484221 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 07:42:05.484221 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 07:42:05.485030 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 07:42:05.485030 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.creator() Sep 16 07:42:05.485030 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 07:42:05.485030 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application created_value = creator( Sep 16 07:42:05.485030 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 07:42:05.485030 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 07:42:05.485030 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 07:42:05.485030 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 07:42:05.485030 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 07:42:05.485030 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 07:42:05.485030 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 16 07:42:05.485030 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Sep 16 07:42:05.485030 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 259/506] 10.222.0.57 () {56 vars in 1102 bytes} [Fri Sep 16 07:42:05 2022] GET /identity/v3/roles/service => generated 85 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 07:42:05.486170 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7b79c5-f127-42e2-bca3-7c546ecf4b39 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:42:05.486237 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47fc6b5-5ae8-4fe1-8f72-17785658c60c None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:42:05.524832 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98672134-a842-4e7c-82b6-12d0ddcd039b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:42:05.525458 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98672134-a842-4e7c-82b6-12d0ddcd039b None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:05.525754 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98672134-a842-4e7c-82b6-12d0ddcd039b None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:05.526037 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98672134-a842-4e7c-82b6-12d0ddcd039b None admin] PATH_INFO: `/v3/users/glance` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:05.533396 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98672134-a842-4e7c-82b6-12d0ddcd039b None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:42:05.534890 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98672134-a842-4e7c-82b6-12d0ddcd039b None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:42:05.547815 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application [None req-98672134-a842-4e7c-82b6-12d0ddcd039b None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 16 07:42:05.547815 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 07:42:05.547815 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 07:42:05.547815 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 07:42:05.547815 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 07:42:05.547815 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 07:42:05.547815 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 07:42:05.547815 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 07:42:05.547815 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 07:42:05.547815 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 07:42:05.547815 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 07:42:05.547815 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 07:42:05.547815 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 16 07:42:05.547815 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 16 07:42:05.547815 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 16 07:42:05.547815 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 16 07:42:05.548760 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 07:42:05.548760 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 07:42:05.548760 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 16 07:42:05.548760 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 07:42:05.548760 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 16 07:42:05.548760 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 07:42:05.548760 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 07:42:05.548760 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 07:42:05.548760 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 07:42:05.548760 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 07:42:05.548760 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 07:42:05.548760 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application with Lock( Sep 16 07:42:05.548760 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 07:42:05.548760 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._enter() Sep 16 07:42:05.548760 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 07:42:05.548760 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 07:42:05.548760 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 07:42:05.548760 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.creator() Sep 16 07:42:05.549658 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 07:42:05.549658 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application created_value = creator( Sep 16 07:42:05.549658 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 16 07:42:05.549658 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 16 07:42:05.549658 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 16 07:42:05.549658 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 16 07:42:05.549658 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 16 07:42:05.549658 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 16 07:42:05.549658 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 16 07:42:05.549658 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Sep 16 07:42:05.549658 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 248/507] 10.222.0.57 () {56 vars in 1099 bytes} [Fri Sep 16 07:42:05 2022] GET /identity/v3/users/glance => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 07:42:05.549658 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98672134-a842-4e7c-82b6-12d0ddcd039b None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:42:05.583024 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:42:05.603007 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7b79c5-f127-42e2-bca3-7c546ecf4b39 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:42:05.639679 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6000d4b5-f630-4df4-9ce2-82acacdd870b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:42:05.640308 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6000d4b5-f630-4df4-9ce2-82acacdd870b None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:05.640590 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6000d4b5-f630-4df4-9ce2-82acacdd870b None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:05.640863 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6000d4b5-f630-4df4-9ce2-82acacdd870b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:05.651196 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6000d4b5-f630-4df4-9ce2-82acacdd870b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:42:05.652639 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6000d4b5-f630-4df4-9ce2-82acacdd870b None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:42:05.657902 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98672134-a842-4e7c-82b6-12d0ddcd039b None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:42:05.666762 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application [None req-6000d4b5-f630-4df4-9ce2-82acacdd870b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 07:42:05.666762 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 07:42:05.666762 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 07:42:05.666762 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 07:42:05.666762 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 07:42:05.666762 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 07:42:05.666762 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 07:42:05.666762 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 07:42:05.666762 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 07:42:05.666762 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 07:42:05.666762 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 07:42:05.666762 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 07:42:05.666762 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 07:42:05.666762 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 07:42:05.666762 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 07:42:05.666762 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 07:42:05.667843 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 07:42:05.667843 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 07:42:05.667843 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 07:42:05.667843 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 07:42:05.667843 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 07:42:05.667843 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 07:42:05.667843 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 07:42:05.667843 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application with Lock( Sep 16 07:42:05.667843 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 07:42:05.667843 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._enter() Sep 16 07:42:05.667843 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 07:42:05.667843 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 07:42:05.667843 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 07:42:05.667843 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.creator() Sep 16 07:42:05.667843 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 07:42:05.667843 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application created_value = creator( Sep 16 07:42:05.667843 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 07:42:05.668705 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 07:42:05.668705 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 07:42:05.668705 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Sep 16 07:42:05.668705 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 260/508] 10.222.0.57 () {56 vars in 1108 bytes} [Fri Sep 16 07:42:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 07:42:05.668705 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6000d4b5-f630-4df4-9ce2-82acacdd870b None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:42:05.697273 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fbdb14-c613-4b17-8770-e3cf7810e327 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:42:05.697927 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fbdb14-c613-4b17-8770-e3cf7810e327 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:05.698206 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fbdb14-c613-4b17-8770-e3cf7810e327 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:05.698477 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fbdb14-c613-4b17-8770-e3cf7810e327 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:05.703934 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:42:05.705896 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fbdb14-c613-4b17-8770-e3cf7810e327 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:42:05.707413 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fbdb14-c613-4b17-8770-e3cf7810e327 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:42:05.718687 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application [None req-f5fbdb14-c613-4b17-8770-e3cf7810e327 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 16 07:42:05.718687 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 07:42:05.718687 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 07:42:05.718687 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 07:42:05.718687 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 07:42:05.718687 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 07:42:05.718687 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 07:42:05.718687 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 07:42:05.718687 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 07:42:05.718687 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 07:42:05.718687 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 07:42:05.718687 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 07:42:05.718687 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 16 07:42:05.718687 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 16 07:42:05.718687 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 16 07:42:05.718687 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 16 07:42:05.719736 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 07:42:05.719736 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 07:42:05.719736 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 16 07:42:05.719736 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 07:42:05.719736 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 16 07:42:05.719736 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 07:42:05.719736 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 07:42:05.719736 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 07:42:05.719736 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 07:42:05.719736 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 07:42:05.719736 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 07:42:05.719736 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application with Lock( Sep 16 07:42:05.719736 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 07:42:05.719736 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._enter() Sep 16 07:42:05.719736 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 07:42:05.719736 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 07:42:05.719736 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 07:42:05.719736 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.creator() Sep 16 07:42:05.720830 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 07:42:05.720830 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application created_value = creator( Sep 16 07:42:05.720830 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 16 07:42:05.720830 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 16 07:42:05.720830 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 16 07:42:05.720830 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 16 07:42:05.720830 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 16 07:42:05.720830 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 16 07:42:05.720830 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 16 07:42:05.720830 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Sep 16 07:42:05.720830 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 249/509] 10.222.0.57 () {56 vars in 1099 bytes} [Fri Sep 16 07:42:05 2022] GET /identity/v3/users/cinder => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 07:42:05.720830 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fbdb14-c613-4b17-8770-e3cf7810e327 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:42:05.775546 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6000d4b5-f630-4df4-9ce2-82acacdd870b None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:42:05.803600 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:42:05.808975 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2aadac-6ab3-47d4-b3e8-cc3ec217852f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:42:05.809704 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2aadac-6ab3-47d4-b3e8-cc3ec217852f None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:05.810008 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2aadac-6ab3-47d4-b3e8-cc3ec217852f None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:05.810291 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2aadac-6ab3-47d4-b3e8-cc3ec217852f None admin] PATH_INFO: `/v3/roles` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:05.811011 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2aadac-6ab3-47d4-b3e8-cc3ec217852f None admin] RBAC: Adding query filter params (name=service) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:42:05.811312 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2aadac-6ab3-47d4-b3e8-cc3ec217852f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:42:05.812692 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2aadac-6ab3-47d4-b3e8-cc3ec217852f None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:42:05.819528 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fbdb14-c613-4b17-8770-e3cf7810e327 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:42:05.820557 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 261/510] 10.222.0.57 () {56 vars in 1103 bytes} [Fri Sep 16 07:42:05 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:42:05.821578 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2aadac-6ab3-47d4-b3e8-cc3ec217852f None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:42:05.862160 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643f3153-1244-4b7f-8500-21e3ec089450 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:42:05.862773 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643f3153-1244-4b7f-8500-21e3ec089450 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:05.863051 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643f3153-1244-4b7f-8500-21e3ec089450 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:05.863321 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643f3153-1244-4b7f-8500-21e3ec089450 None admin] PATH_INFO: `/v3/users` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:05.864047 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643f3153-1244-4b7f-8500-21e3ec089450 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:42:05.864353 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643f3153-1244-4b7f-8500-21e3ec089450 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:42:05.865810 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643f3153-1244-4b7f-8500-21e3ec089450 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:42:05.901867 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 250/511] 10.222.0.57 () {56 vars in 1137 bytes} [Fri Sep 16 07:42:05 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:42:05.902697 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643f3153-1244-4b7f-8500-21e3ec089450 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:42:05.922614 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:42:05.929229 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2aadac-6ab3-47d4-b3e8-cc3ec217852f None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:42:05.961850 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb18654b-3f8f-4624-8978-2599af9eaaa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:42:05.962468 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb18654b-3f8f-4624-8978-2599af9eaaa5 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:05.962744 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb18654b-3f8f-4624-8978-2599af9eaaa5 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:05.963010 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb18654b-3f8f-4624-8978-2599af9eaaa5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:05.974961 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb18654b-3f8f-4624-8978-2599af9eaaa5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:42:05.976407 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb18654b-3f8f-4624-8978-2599af9eaaa5 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:42:05.990865 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application [None req-fb18654b-3f8f-4624-8978-2599af9eaaa5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 07:42:05.990865 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 07:42:05.990865 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 07:42:05.990865 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 07:42:05.990865 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 07:42:05.990865 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 07:42:05.990865 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 07:42:05.990865 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 07:42:05.990865 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 07:42:05.990865 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 07:42:05.990865 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 07:42:05.990865 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 07:42:05.990865 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 07:42:05.990865 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 07:42:05.990865 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 07:42:05.990865 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 07:42:05.992257 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 07:42:05.992257 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 07:42:05.992257 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 07:42:05.992257 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 07:42:05.992257 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 07:42:05.992257 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 07:42:05.992257 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 07:42:05.992257 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application with Lock( Sep 16 07:42:05.992257 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 07:42:05.992257 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._enter() Sep 16 07:42:05.992257 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 07:42:05.992257 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 07:42:05.992257 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 07:42:05.992257 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.creator() Sep 16 07:42:05.992257 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 07:42:05.992257 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application created_value = creator( Sep 16 07:42:05.992257 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 07:42:05.993120 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 07:42:05.993120 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 07:42:05.993120 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Sep 16 07:42:05.993120 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 262/512] 10.222.0.57 () {56 vars in 1108 bytes} [Fri Sep 16 07:42:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 07:42:05.993120 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb18654b-3f8f-4624-8978-2599af9eaaa5 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:42:06.002003 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643f3153-1244-4b7f-8500-21e3ec089450 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:42:06.035656 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8055d18c-3468-4748-aabc-48aa3b104497 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:42:06.036272 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8055d18c-3468-4748-aabc-48aa3b104497 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:06.036579 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8055d18c-3468-4748-aabc-48aa3b104497 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:06.036879 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8055d18c-3468-4748-aabc-48aa3b104497 None admin] PATH_INFO: `/v3/domains` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:06.037536 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8055d18c-3468-4748-aabc-48aa3b104497 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:42:06.037896 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8055d18c-3468-4748-aabc-48aa3b104497 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:42:06.039304 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8055d18c-3468-4748-aabc-48aa3b104497 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:42:06.050250 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 251/513] 10.222.0.57 () {56 vars in 1109 bytes} [Fri Sep 16 07:42:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:42:06.051033 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8055d18c-3468-4748-aabc-48aa3b104497 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:42:06.055703 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:42:06.095376 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb18654b-3f8f-4624-8978-2599af9eaaa5 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:42:06.130634 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fc6431-6522-4e6a-81f2-9d4e25ca8d12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:42:06.131169 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fc6431-6522-4e6a-81f2-9d4e25ca8d12 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:06.131702 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fc6431-6522-4e6a-81f2-9d4e25ca8d12 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:06.131974 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fc6431-6522-4e6a-81f2-9d4e25ca8d12 None admin] PATH_INFO: `/v3/users` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:06.132696 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fc6431-6522-4e6a-81f2-9d4e25ca8d12 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:42:06.133006 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fc6431-6522-4e6a-81f2-9d4e25ca8d12 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:42:06.134459 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fc6431-6522-4e6a-81f2-9d4e25ca8d12 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:42:06.152324 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 263/514] 10.222.0.57 () {56 vars in 1137 bytes} [Fri Sep 16 07:42:05 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:42:06.152474 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8055d18c-3468-4748-aabc-48aa3b104497 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:42:06.153131 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fc6431-6522-4e6a-81f2-9d4e25ca8d12 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:42:06.161250 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:42:06.189609 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3904f756-9c1c-4ab8-8536-a7e433f730e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:42:06.190258 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3904f756-9c1c-4ab8-8536-a7e433f730e4 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:06.190535 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3904f756-9c1c-4ab8-8536-a7e433f730e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:06.190799 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3904f756-9c1c-4ab8-8536-a7e433f730e4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:06.200921 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3904f756-9c1c-4ab8-8536-a7e433f730e4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:42:06.202394 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3904f756-9c1c-4ab8-8536-a7e433f730e4 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:42:06.216170 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application [None req-3904f756-9c1c-4ab8-8536-a7e433f730e4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 07:42:06.216170 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 07:42:06.216170 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 07:42:06.216170 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 07:42:06.216170 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 07:42:06.216170 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 07:42:06.216170 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 07:42:06.216170 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 07:42:06.216170 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 07:42:06.216170 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 07:42:06.216170 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 07:42:06.216170 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 07:42:06.216170 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 07:42:06.216170 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 07:42:06.216170 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 07:42:06.216170 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 07:42:06.217077 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 07:42:06.217077 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 07:42:06.217077 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 07:42:06.217077 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 07:42:06.217077 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 07:42:06.217077 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 07:42:06.217077 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 07:42:06.217077 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application with Lock( Sep 16 07:42:06.217077 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 07:42:06.217077 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._enter() Sep 16 07:42:06.217077 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 07:42:06.217077 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 07:42:06.217077 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 07:42:06.217077 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.creator() Sep 16 07:42:06.217077 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 07:42:06.217077 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application created_value = creator( Sep 16 07:42:06.217077 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 07:42:06.217965 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 07:42:06.217965 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 07:42:06.217965 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Sep 16 07:42:06.217965 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 252/515] 10.222.0.57 () {56 vars in 1108 bytes} [Fri Sep 16 07:42:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 07:42:06.218195 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3904f756-9c1c-4ab8-8536-a7e433f730e4 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:42:06.256644 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fc6431-6522-4e6a-81f2-9d4e25ca8d12 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:42:06.273161 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:42:06.291045 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e8cc3e-e684-44a9-883c-6a82d083552e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:42:06.291640 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e8cc3e-e684-44a9-883c-6a82d083552e None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:06.291917 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e8cc3e-e684-44a9-883c-6a82d083552e None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:06.292187 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e8cc3e-e684-44a9-883c-6a82d083552e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:06.317543 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3904f756-9c1c-4ab8-8536-a7e433f730e4 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:42:06.351605 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0183c0-7f94-4f01-9158-e0bfbb0593aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:42:06.352196 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0183c0-7f94-4f01-9158-e0bfbb0593aa None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:06.352473 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0183c0-7f94-4f01-9158-e0bfbb0593aa None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:06.352747 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0183c0-7f94-4f01-9158-e0bfbb0593aa None admin] PATH_INFO: `/v3/domains` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:06.353380 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0183c0-7f94-4f01-9158-e0bfbb0593aa None admin] RBAC: Adding query filter params (name=Default) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:42:06.353683 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0183c0-7f94-4f01-9158-e0bfbb0593aa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:42:06.355071 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0183c0-7f94-4f01-9158-e0bfbb0593aa None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:42:06.360725 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e8cc3e-e684-44a9-883c-6a82d083552e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:42:06.362197 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e8cc3e-e684-44a9-883c-6a82d083552e None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:42:06.367073 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 253/516] 10.222.0.57 () {56 vars in 1109 bytes} [Fri Sep 16 07:42:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:42:06.367676 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0183c0-7f94-4f01-9158-e0bfbb0593aa None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:42:06.369623 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:42:06.463522 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 264/517] 10.222.0.57 () {58 vars in 1282 bytes} [Fri Sep 16 07:42:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 16 07:42:06.464329 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0183c0-7f94-4f01-9158-e0bfbb0593aa None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:42:06.464563 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e8cc3e-e684-44a9-883c-6a82d083552e None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:42:06.483880 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:42:06.501173 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af964f9-1dec-4660-bac2-07ce8c334d9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:42:06.501826 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af964f9-1dec-4660-bac2-07ce8c334d9c None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:06.502106 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af964f9-1dec-4660-bac2-07ce8c334d9c None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:06.502377 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af964f9-1dec-4660-bac2-07ce8c334d9c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:06.509153 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af964f9-1dec-4660-bac2-07ce8c334d9c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:42:06.510654 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af964f9-1dec-4660-bac2-07ce8c334d9c None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:42:06.522906 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application [None req-3af964f9-1dec-4660-bac2-07ce8c334d9c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 07:42:06.522906 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 07:42:06.522906 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 07:42:06.522906 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 07:42:06.522906 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 07:42:06.522906 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 07:42:06.522906 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 07:42:06.522906 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 07:42:06.522906 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 07:42:06.522906 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 07:42:06.522906 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 07:42:06.522906 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 07:42:06.522906 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 16 07:42:06.522906 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 16 07:42:06.522906 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 16 07:42:06.523786 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 16 07:42:06.523786 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 07:42:06.523786 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 07:42:06.523786 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 07:42:06.523786 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 07:42:06.523786 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 07:42:06.523786 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 07:42:06.523786 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 07:42:06.523786 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application with Lock( Sep 16 07:42:06.523786 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 07:42:06.523786 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._enter() Sep 16 07:42:06.523786 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 07:42:06.523786 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 07:42:06.523786 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 07:42:06.523786 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.creator() Sep 16 07:42:06.523786 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 07:42:06.523786 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application created_value = creator( Sep 16 07:42:06.524754 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 16 07:42:06.524754 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 16 07:42:06.524754 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 16 07:42:06.524754 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 16 07:42:06.524754 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 16 07:42:06.524754 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 16 07:42:06.524754 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 07:42:06.524754 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Sep 16 07:42:06.524754 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 254/518] 10.222.0.57 () {56 vars in 1111 bytes} [Fri Sep 16 07:42:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 07:42:06.525782 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af964f9-1dec-4660-bac2-07ce8c334d9c None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:42:06.571205 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e8cc3e-e684-44a9-883c-6a82d083552e None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:42:06.578489 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:42:06.606114 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05ce70e-2e94-49b7-bdfc-0dde52e13719 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:42:06.607622 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05ce70e-2e94-49b7-bdfc-0dde52e13719 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:06.607896 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05ce70e-2e94-49b7-bdfc-0dde52e13719 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:06.608167 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05ce70e-2e94-49b7-bdfc-0dde52e13719 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:06.625272 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af964f9-1dec-4660-bac2-07ce8c334d9c None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:42:06.657739 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a32ab87-5ed1-4b97-b0a0-f522d3f93cb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:42:06.658356 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a32ab87-5ed1-4b97-b0a0-f522d3f93cb4 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:06.658633 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a32ab87-5ed1-4b97-b0a0-f522d3f93cb4 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:06.658905 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a32ab87-5ed1-4b97-b0a0-f522d3f93cb4 None admin] PATH_INFO: `/v3/domains` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:06.659534 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a32ab87-5ed1-4b97-b0a0-f522d3f93cb4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:42:06.659833 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a32ab87-5ed1-4b97-b0a0-f522d3f93cb4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:42:06.661194 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a32ab87-5ed1-4b97-b0a0-f522d3f93cb4 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:42:06.672461 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 255/519] 10.222.0.57 () {56 vars in 1109 bytes} [Fri Sep 16 07:42:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:42:06.673007 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05ce70e-2e94-49b7-bdfc-0dde52e13719 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:42:06.673224 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a32ab87-5ed1-4b97-b0a0-f522d3f93cb4 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:42:06.674560 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05ce70e-2e94-49b7-bdfc-0dde52e13719 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:42:06.708382 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:42:06.773409 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a32ab87-5ed1-4b97-b0a0-f522d3f93cb4 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:42:06.774043 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 265/520] 10.222.0.57 () {58 vars in 1282 bytes} [Fri Sep 16 07:42:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 16 07:42:06.775031 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05ce70e-2e94-49b7-bdfc-0dde52e13719 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:42:06.784330 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:42:06.806417 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276b3458-a2a3-496e-9c9e-7dde0274b9bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:42:06.807024 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276b3458-a2a3-496e-9c9e-7dde0274b9bb None admin] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:06.807306 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276b3458-a2a3-496e-9c9e-7dde0274b9bb None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:06.807575 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276b3458-a2a3-496e-9c9e-7dde0274b9bb None admin] PATH_INFO: `/v3/users` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:06.808211 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276b3458-a2a3-496e-9c9e-7dde0274b9bb None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:42:06.810187 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276b3458-a2a3-496e-9c9e-7dde0274b9bb None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:42:06.831215 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 256/521] 10.222.0.57 () {60 vars in 1132 bytes} [Fri Sep 16 07:42:06 2022] POST /identity/v3/users => generated 247 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 07:42:06.832015 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276b3458-a2a3-496e-9c9e-7dde0274b9bb None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:42:06.901596 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05ce70e-2e94-49b7-bdfc-0dde52e13719 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:42:06.941561 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5fa53c-86f2-4c6b-a600-446292e119ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:42:06.942242 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5fa53c-86f2-4c6b-a600-446292e119ca None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:06.942520 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5fa53c-86f2-4c6b-a600-446292e119ca None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:06.942793 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5fa53c-86f2-4c6b-a600-446292e119ca None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:06.942912 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:42:06.954726 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276b3458-a2a3-496e-9c9e-7dde0274b9bb None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:42:06.955952 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5fa53c-86f2-4c6b-a600-446292e119ca None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:42:06.957431 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5fa53c-86f2-4c6b-a600-446292e119ca None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:42:06.973802 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application [None req-9d5fa53c-86f2-4c6b-a600-446292e119ca None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 07:42:06.973802 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 07:42:06.973802 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 07:42:06.973802 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 07:42:06.973802 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 07:42:06.973802 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 07:42:06.973802 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 07:42:06.973802 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 07:42:06.973802 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 07:42:06.973802 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 07:42:06.973802 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 07:42:06.973802 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 07:42:06.973802 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 07:42:06.973802 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 07:42:06.973802 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 07:42:06.973802 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 07:42:06.974779 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 07:42:06.974779 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 07:42:06.974779 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 07:42:06.974779 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 07:42:06.974779 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 07:42:06.974779 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 07:42:06.974779 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 07:42:06.974779 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application with Lock( Sep 16 07:42:06.974779 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 07:42:06.974779 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._enter() Sep 16 07:42:06.974779 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 07:42:06.974779 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 07:42:06.974779 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 07:42:06.974779 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.creator() Sep 16 07:42:06.974779 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 07:42:06.974779 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application created_value = creator( Sep 16 07:42:06.974779 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 07:42:06.975622 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 07:42:06.975622 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 07:42:06.975622 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Sep 16 07:42:06.975622 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 266/522] 10.222.0.57 () {56 vars in 1108 bytes} [Fri Sep 16 07:42:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 07:42:06.975861 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5fa53c-86f2-4c6b-a600-446292e119ca None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:42:07.002527 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eebd454-973f-40f3-b1dc-210867991dc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:42:07.003185 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eebd454-973f-40f3-b1dc-210867991dc7 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:07.003490 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eebd454-973f-40f3-b1dc-210867991dc7 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:07.003756 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eebd454-973f-40f3-b1dc-210867991dc7 None admin] PATH_INFO: `/v3/projects` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:07.004488 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eebd454-973f-40f3-b1dc-210867991dc7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:42:07.004794 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eebd454-973f-40f3-b1dc-210867991dc7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:42:07.006625 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eebd454-973f-40f3-b1dc-210867991dc7 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:42:07.026279 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 257/523] 10.222.0.57 () {56 vars in 1148 bytes} [Fri Sep 16 07:42:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:42:07.027129 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eebd454-973f-40f3-b1dc-210867991dc7 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:42:07.052851 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:42:07.113005 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5fa53c-86f2-4c6b-a600-446292e119ca None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:42:07.134725 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eebd454-973f-40f3-b1dc-210867991dc7 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:42:07.149000 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef349f4-b9fa-474b-a954-c4e1d8aa4b8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:42:07.149879 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef349f4-b9fa-474b-a954-c4e1d8aa4b8f None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:07.150313 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef349f4-b9fa-474b-a954-c4e1d8aa4b8f None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:07.150584 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef349f4-b9fa-474b-a954-c4e1d8aa4b8f None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:07.158223 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef349f4-b9fa-474b-a954-c4e1d8aa4b8f None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:42:07.159658 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef349f4-b9fa-474b-a954-c4e1d8aa4b8f None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:42:07.171633 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13babc93-21f7-440f-be07-9cfc63dfdc26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:42:07.172263 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13babc93-21f7-440f-be07-9cfc63dfdc26 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:07.172540 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13babc93-21f7-440f-be07-9cfc63dfdc26 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:07.172667 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application [None req-3ef349f4-b9fa-474b-a954-c4e1d8aa4b8f None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 16 07:42:07.172667 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 07:42:07.172667 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 07:42:07.172667 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 07:42:07.172667 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 07:42:07.172667 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 07:42:07.172667 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 07:42:07.172667 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 07:42:07.172667 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 07:42:07.172667 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 07:42:07.172667 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 07:42:07.172667 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 07:42:07.172667 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 16 07:42:07.172667 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 16 07:42:07.172667 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 16 07:42:07.172667 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 16 07:42:07.173474 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 07:42:07.173474 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 07:42:07.173474 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 16 07:42:07.173474 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 07:42:07.173474 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 16 07:42:07.173474 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 07:42:07.173474 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 07:42:07.173474 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 07:42:07.173474 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 07:42:07.173474 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 07:42:07.173474 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 07:42:07.173474 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application with Lock( Sep 16 07:42:07.173474 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 07:42:07.173474 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._enter() Sep 16 07:42:07.173474 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 07:42:07.173474 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 07:42:07.173474 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 07:42:07.173474 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.creator() Sep 16 07:42:07.174395 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 07:42:07.174395 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application created_value = creator( Sep 16 07:42:07.174395 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 16 07:42:07.174395 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 16 07:42:07.174395 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 16 07:42:07.174395 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 16 07:42:07.174395 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 16 07:42:07.174395 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 16 07:42:07.174395 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 16 07:42:07.174395 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Sep 16 07:42:07.174975 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13babc93-21f7-440f-be07-9cfc63dfdc26 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:07.175041 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 267/524] 10.222.0.57 () {56 vars in 1102 bytes} [Fri Sep 16 07:42:06 2022] GET /identity/v3/users/neutron => generated 85 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 07:42:07.175041 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef349f4-b9fa-474b-a954-c4e1d8aa4b8f None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:42:07.187101 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13babc93-21f7-440f-be07-9cfc63dfdc26 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:42:07.188560 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13babc93-21f7-440f-be07-9cfc63dfdc26 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:42:07.204599 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application [None req-13babc93-21f7-440f-be07-9cfc63dfdc26 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 07:42:07.204599 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 07:42:07.204599 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 07:42:07.204599 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 07:42:07.204599 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 07:42:07.204599 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 07:42:07.204599 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 07:42:07.204599 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 07:42:07.204599 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 07:42:07.204599 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 07:42:07.204599 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 07:42:07.204599 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 07:42:07.204599 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 07:42:07.204599 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 07:42:07.204599 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 07:42:07.204599 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 07:42:07.205775 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 07:42:07.205775 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 07:42:07.205775 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 07:42:07.205775 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 07:42:07.205775 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 07:42:07.205775 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 07:42:07.205775 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 07:42:07.205775 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application with Lock( Sep 16 07:42:07.205775 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 07:42:07.205775 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._enter() Sep 16 07:42:07.205775 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 07:42:07.205775 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 07:42:07.205775 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 07:42:07.205775 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.creator() Sep 16 07:42:07.205775 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 07:42:07.205775 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application created_value = creator( Sep 16 07:42:07.205775 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 07:42:07.206841 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 07:42:07.206841 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 07:42:07.206841 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Sep 16 07:42:07.210540 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 258/525] 10.222.0.57 () {56 vars in 1108 bytes} [Fri Sep 16 07:42:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 07:42:07.211239 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13babc93-21f7-440f-be07-9cfc63dfdc26 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:42:07.216134 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:42:07.283507 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef349f4-b9fa-474b-a954-c4e1d8aa4b8f None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:42:07.301517 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:42:07.320686 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d2e0c4-1546-4490-8e8a-dbd269dfadc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:42:07.320877 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13babc93-21f7-440f-be07-9cfc63dfdc26 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:42:07.321314 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d2e0c4-1546-4490-8e8a-dbd269dfadc2 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:07.321594 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d2e0c4-1546-4490-8e8a-dbd269dfadc2 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:07.321895 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d2e0c4-1546-4490-8e8a-dbd269dfadc2 None admin] PATH_INFO: `/v3/domains` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:07.322541 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d2e0c4-1546-4490-8e8a-dbd269dfadc2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:42:07.322900 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d2e0c4-1546-4490-8e8a-dbd269dfadc2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:42:07.324283 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d2e0c4-1546-4490-8e8a-dbd269dfadc2 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:42:07.336408 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 268/526] 10.222.0.57 () {56 vars in 1109 bytes} [Fri Sep 16 07:42:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:42:07.337211 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d2e0c4-1546-4490-8e8a-dbd269dfadc2 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:42:07.362267 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c653ffec-d4d8-4340-b357-a905ceea4232 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:42:07.362872 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c653ffec-d4d8-4340-b357-a905ceea4232 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:07.363149 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c653ffec-d4d8-4340-b357-a905ceea4232 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:07.363418 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c653ffec-d4d8-4340-b357-a905ceea4232 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:07.364132 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c653ffec-d4d8-4340-b357-a905ceea4232 None admin] RBAC: Adding query filter params (role.id=f59220af7e7f4a8dbc30ba6325c7827c, scope.project.id=4735f453c0c24cc4a1c14e9ac84a0b46, user.id=9bec4d9b08514461a1bf63c6b88f53b2) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:42:07.364436 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c653ffec-d4d8-4340-b357-a905ceea4232 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:42:07.365911 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c653ffec-d4d8-4340-b357-a905ceea4232 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:42:07.381770 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 259/527] 10.222.0.57 () {56 vars in 1374 bytes} [Fri Sep 16 07:42:07 2022] GET /identity/v3/role_assignments?user.id=9bec4d9b08514461a1bf63c6b88f53b2&scope.project.id=4735f453c0c24cc4a1c14e9ac84a0b46&role.id=f59220af7e7f4a8dbc30ba6325c7827c => generated 259 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:42:07.381770 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c653ffec-d4d8-4340-b357-a905ceea4232 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:42:07.468684 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:42:07.479718 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d2e0c4-1546-4490-8e8a-dbd269dfadc2 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:42:07.509909 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c653ffec-d4d8-4340-b357-a905ceea4232 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:42:07.541010 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fd29a3-1825-4c5d-a603-c39c26c3cd45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:42:07.542115 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fd29a3-1825-4c5d-a603-c39c26c3cd45 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:07.542460 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fd29a3-1825-4c5d-a603-c39c26c3cd45 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:07.542953 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fd29a3-1825-4c5d-a603-c39c26c3cd45 None admin] PATH_INFO: `/v3/users` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:07.543860 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2fd29a3-1825-4c5d-a603-c39c26c3cd45 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:42:07.544172 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2fd29a3-1825-4c5d-a603-c39c26c3cd45 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:42:07.546386 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2fd29a3-1825-4c5d-a603-c39c26c3cd45 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:42:07.550618 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5829d7ea-2f1b-4e24-a047-fea8bbcd2070 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:42:07.551370 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5829d7ea-2f1b-4e24-a047-fea8bbcd2070 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:07.551749 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5829d7ea-2f1b-4e24-a047-fea8bbcd2070 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:07.552115 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5829d7ea-2f1b-4e24-a047-fea8bbcd2070 None admin] PATH_INFO: `/v3/domains` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:07.552926 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5829d7ea-2f1b-4e24-a047-fea8bbcd2070 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:42:07.553326 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5829d7ea-2f1b-4e24-a047-fea8bbcd2070 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:42:07.554878 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5829d7ea-2f1b-4e24-a047-fea8bbcd2070 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:42:07.569401 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 260/528] 10.222.0.57 () {56 vars in 1109 bytes} [Fri Sep 16 07:42:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:42:07.569583 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 269/529] 10.222.0.57 () {56 vars in 1139 bytes} [Fri Sep 16 07:42:07 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:42:07.570378 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5829d7ea-2f1b-4e24-a047-fea8bbcd2070 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:42:07.576870 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fd29a3-1825-4c5d-a603-c39c26c3cd45 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:42:07.626783 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:42:07.687963 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5829d7ea-2f1b-4e24-a047-fea8bbcd2070 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:42:07.717815 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:42:07.718743 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fd29a3-1825-4c5d-a603-c39c26c3cd45 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:42:07.729271 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891ee696-8c9a-4f42-a9dc-58c1d754d9ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:42:07.730278 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891ee696-8c9a-4f42-a9dc-58c1d754d9ea None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:07.731218 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891ee696-8c9a-4f42-a9dc-58c1d754d9ea None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:07.732220 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891ee696-8c9a-4f42-a9dc-58c1d754d9ea None admin] PATH_INFO: `/v3/projects/service` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:07.741959 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891ee696-8c9a-4f42-a9dc-58c1d754d9ea None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:42:07.744315 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891ee696-8c9a-4f42-a9dc-58c1d754d9ea None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:42:07.758422 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c93f2b4-6a64-49c0-8f4b-25f0a32e0f0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:42:07.759114 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c93f2b4-6a64-49c0-8f4b-25f0a32e0f0d None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:07.759464 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c93f2b4-6a64-49c0-8f4b-25f0a32e0f0d None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:07.759803 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c93f2b4-6a64-49c0-8f4b-25f0a32e0f0d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:07.762039 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application [None req-891ee696-8c9a-4f42-a9dc-58c1d754d9ea None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 07:42:07.762039 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 07:42:07.762039 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 07:42:07.762039 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 07:42:07.762039 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 07:42:07.762039 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 07:42:07.762039 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 07:42:07.762039 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 07:42:07.762039 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 07:42:07.762039 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 07:42:07.762039 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 07:42:07.762039 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 07:42:07.762039 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 16 07:42:07.762039 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 16 07:42:07.762039 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 16 07:42:07.763194 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 16 07:42:07.763194 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 07:42:07.763194 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 07:42:07.763194 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 07:42:07.763194 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 07:42:07.763194 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 07:42:07.763194 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 07:42:07.763194 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 07:42:07.763194 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application with Lock( Sep 16 07:42:07.763194 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 07:42:07.763194 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._enter() Sep 16 07:42:07.763194 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 07:42:07.763194 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 07:42:07.763194 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 07:42:07.763194 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.creator() Sep 16 07:42:07.763194 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 07:42:07.763194 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application created_value = creator( Sep 16 07:42:07.764055 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 16 07:42:07.764055 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 16 07:42:07.764055 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 16 07:42:07.764055 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 16 07:42:07.764055 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 16 07:42:07.764055 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 16 07:42:07.764055 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 07:42:07.764055 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Sep 16 07:42:07.766547 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 261/530] 10.222.0.57 () {56 vars in 1111 bytes} [Fri Sep 16 07:42:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 07:42:07.767494 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891ee696-8c9a-4f42-a9dc-58c1d754d9ea None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:42:07.858178 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c93f2b4-6a64-49c0-8f4b-25f0a32e0f0d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:42:07.860197 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c93f2b4-6a64-49c0-8f4b-25f0a32e0f0d None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:42:07.880146 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891ee696-8c9a-4f42-a9dc-58c1d754d9ea None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:42:07.906690 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:42:07.922768 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7850c714-3e46-458b-be09-12a046d98e0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:42:07.923404 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7850c714-3e46-458b-be09-12a046d98e0a None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:07.923689 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7850c714-3e46-458b-be09-12a046d98e0a None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:07.923965 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7850c714-3e46-458b-be09-12a046d98e0a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:07.933259 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7850c714-3e46-458b-be09-12a046d98e0a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:42:07.935744 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7850c714-3e46-458b-be09-12a046d98e0a None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:42:07.952379 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application [None req-7850c714-3e46-458b-be09-12a046d98e0a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 07:42:07.952379 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 07:42:07.952379 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 07:42:07.952379 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 07:42:07.952379 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 07:42:07.952379 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 07:42:07.952379 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 07:42:07.952379 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 07:42:07.952379 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 07:42:07.952379 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 07:42:07.952379 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 07:42:07.952379 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 07:42:07.952379 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 16 07:42:07.952379 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 16 07:42:07.952379 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 16 07:42:07.953244 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 16 07:42:07.953244 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 07:42:07.953244 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 07:42:07.953244 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 07:42:07.953244 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 07:42:07.953244 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 07:42:07.953244 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 07:42:07.953244 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 07:42:07.953244 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application with Lock( Sep 16 07:42:07.953244 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 07:42:07.953244 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._enter() Sep 16 07:42:07.953244 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 07:42:07.953244 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 07:42:07.953244 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 07:42:07.953244 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.creator() Sep 16 07:42:07.953244 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 07:42:07.953244 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application created_value = creator( Sep 16 07:42:07.954163 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 16 07:42:07.954163 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 16 07:42:07.954163 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 16 07:42:07.954163 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 16 07:42:07.954163 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 16 07:42:07.954163 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 16 07:42:07.954163 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 07:42:07.954163 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Sep 16 07:42:07.954163 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 262/531] 10.222.0.57 () {56 vars in 1111 bytes} [Fri Sep 16 07:42:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 07:42:07.954634 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7850c714-3e46-458b-be09-12a046d98e0a None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:42:08.000211 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 270/532] 10.222.0.57 () {58 vars in 1282 bytes} [Fri Sep 16 07:42:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 16 07:42:08.001689 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c93f2b4-6a64-49c0-8f4b-25f0a32e0f0d None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:42:08.013706 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:42:08.074413 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7850c714-3e46-458b-be09-12a046d98e0a None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:42:08.126798 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4527c8-37db-4aef-892c-801646115df5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:42:08.127240 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4527c8-37db-4aef-892c-801646115df5 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:08.127519 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4527c8-37db-4aef-892c-801646115df5 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:08.127830 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4527c8-37db-4aef-892c-801646115df5 None admin] PATH_INFO: `/v3/projects` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:08.128517 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4527c8-37db-4aef-892c-801646115df5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:42:08.128823 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4527c8-37db-4aef-892c-801646115df5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:42:08.130280 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4527c8-37db-4aef-892c-801646115df5 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:42:08.138667 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c93f2b4-6a64-49c0-8f4b-25f0a32e0f0d None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:42:08.147884 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 263/533] 10.222.0.57 () {56 vars in 1148 bytes} [Fri Sep 16 07:42:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:42:08.149030 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4527c8-37db-4aef-892c-801646115df5 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:42:08.186156 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6aca24f-4f93-48ef-8294-df934160cbd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:42:08.187823 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6aca24f-4f93-48ef-8294-df934160cbd3 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:08.187823 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6aca24f-4f93-48ef-8294-df934160cbd3 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:08.188124 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6aca24f-4f93-48ef-8294-df934160cbd3 None admin] PATH_INFO: `/v3/projects` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:08.188789 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6aca24f-4f93-48ef-8294-df934160cbd3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:42:08.189093 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6aca24f-4f93-48ef-8294-df934160cbd3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:42:08.190607 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6aca24f-4f93-48ef-8294-df934160cbd3 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:42:08.195241 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:42:08.214032 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 271/534] 10.222.0.57 () {56 vars in 1148 bytes} [Fri Sep 16 07:42:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:42:08.214978 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6aca24f-4f93-48ef-8294-df934160cbd3 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:42:08.279905 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4527c8-37db-4aef-892c-801646115df5 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:42:08.295472 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:42:08.329479 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6aca24f-4f93-48ef-8294-df934160cbd3 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:42:08.333694 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e68893-ecb3-49a5-9816-6accff0a5834 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:42:08.334537 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e68893-ecb3-49a5-9816-6accff0a5834 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:08.335001 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e68893-ecb3-49a5-9816-6accff0a5834 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:08.335415 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e68893-ecb3-49a5-9816-6accff0a5834 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:08.350112 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e68893-ecb3-49a5-9816-6accff0a5834 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:42:08.352629 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e68893-ecb3-49a5-9816-6accff0a5834 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:42:08.366177 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac99858e-07c2-43ad-9e4d-66fe68b44956 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:42:08.366881 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac99858e-07c2-43ad-9e4d-66fe68b44956 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:08.367251 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac99858e-07c2-43ad-9e4d-66fe68b44956 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:08.367635 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac99858e-07c2-43ad-9e4d-66fe68b44956 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:08.368452 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac99858e-07c2-43ad-9e4d-66fe68b44956 None admin] RBAC: Adding query filter params (role.id=f59220af7e7f4a8dbc30ba6325c7827c, scope.project.id=4735f453c0c24cc4a1c14e9ac84a0b46, user.id=ceecb2c2fe9842e3b228848e00fd11ed) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:42:08.368856 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac99858e-07c2-43ad-9e4d-66fe68b44956 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:42:08.370392 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac99858e-07c2-43ad-9e4d-66fe68b44956 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:42:08.374417 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application [None req-a8e68893-ecb3-49a5-9816-6accff0a5834 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 07:42:08.374417 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 07:42:08.374417 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 07:42:08.374417 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 07:42:08.374417 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 07:42:08.374417 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 07:42:08.374417 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 07:42:08.374417 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 07:42:08.374417 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 07:42:08.374417 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 07:42:08.374417 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 07:42:08.374417 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 07:42:08.374417 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 07:42:08.374417 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 07:42:08.374417 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 07:42:08.374417 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 07:42:08.375490 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 07:42:08.375490 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 07:42:08.375490 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 07:42:08.375490 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 07:42:08.375490 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 07:42:08.375490 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 07:42:08.375490 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 07:42:08.375490 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application with Lock( Sep 16 07:42:08.375490 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 07:42:08.375490 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._enter() Sep 16 07:42:08.375490 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 07:42:08.375490 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 07:42:08.375490 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 07:42:08.375490 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.creator() Sep 16 07:42:08.375490 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 07:42:08.375490 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application created_value = creator( Sep 16 07:42:08.375490 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 07:42:08.376534 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 07:42:08.376534 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 07:42:08.376534 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Sep 16 07:42:08.382647 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 272/535] 10.222.0.57 () {56 vars in 1374 bytes} [Fri Sep 16 07:42:08 2022] GET /identity/v3/role_assignments?user.id=ceecb2c2fe9842e3b228848e00fd11ed&scope.project.id=4735f453c0c24cc4a1c14e9ac84a0b46&role.id=f59220af7e7f4a8dbc30ba6325c7827c => generated 259 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:42:08.383060 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 264/536] 10.222.0.57 () {56 vars in 1108 bytes} [Fri Sep 16 07:42:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 07:42:08.383247 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac99858e-07c2-43ad-9e4d-66fe68b44956 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:42:08.384178 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e68893-ecb3-49a5-9816-6accff0a5834 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:42:08.500377 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:42:08.554365 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac99858e-07c2-43ad-9e4d-66fe68b44956 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:42:08.556552 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e68893-ecb3-49a5-9816-6accff0a5834 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:42:08.595239 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96747569-f8f2-4faf-b5fa-6322c8b9f8c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:42:08.596101 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96747569-f8f2-4faf-b5fa-6322c8b9f8c0 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:08.596966 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96747569-f8f2-4faf-b5fa-6322c8b9f8c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:08.597421 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96747569-f8f2-4faf-b5fa-6322c8b9f8c0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:08.598364 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96747569-f8f2-4faf-b5fa-6322c8b9f8c0 None admin] RBAC: Adding query filter params (role.id=f59220af7e7f4a8dbc30ba6325c7827c, scope.project.id=4735f453c0c24cc4a1c14e9ac84a0b46, user.id=6544bf6be4c24454a013ca110c43cef2) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:42:08.598850 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96747569-f8f2-4faf-b5fa-6322c8b9f8c0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:42:08.600967 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96747569-f8f2-4faf-b5fa-6322c8b9f8c0 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:42:08.608485 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 273/537] 10.222.0.57 () {56 vars in 1374 bytes} [Fri Sep 16 07:42:08 2022] GET /identity/v3/role_assignments?user.id=6544bf6be4c24454a013ca110c43cef2&scope.project.id=4735f453c0c24cc4a1c14e9ac84a0b46&role.id=f59220af7e7f4a8dbc30ba6325c7827c => generated 259 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:42:08.644114 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53cd68c-4f68-4964-891d-e037e269586a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:42:08.644684 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53cd68c-4f68-4964-891d-e037e269586a None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:08.644951 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53cd68c-4f68-4964-891d-e037e269586a None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:08.645222 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53cd68c-4f68-4964-891d-e037e269586a None admin] PATH_INFO: `/v3/domains` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:08.645902 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53cd68c-4f68-4964-891d-e037e269586a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:42:08.646275 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53cd68c-4f68-4964-891d-e037e269586a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:42:08.647726 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53cd68c-4f68-4964-891d-e037e269586a None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:42:08.667362 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 265/538] 10.222.0.57 () {56 vars in 1109 bytes} [Fri Sep 16 07:42:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:42:08.673809 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96747569-f8f2-4faf-b5fa-6322c8b9f8c0 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:42:08.814954 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96747569-f8f2-4faf-b5fa-6322c8b9f8c0 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:42:08.846431 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:42:08.861121 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f25b8e-bc12-45c4-8e43-be00f64a265d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:42:08.862126 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f25b8e-bc12-45c4-8e43-be00f64a265d None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:08.862624 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f25b8e-bc12-45c4-8e43-be00f64a265d None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:08.863103 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f25b8e-bc12-45c4-8e43-be00f64a265d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:08.876283 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f25b8e-bc12-45c4-8e43-be00f64a265d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:42:08.878132 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f25b8e-bc12-45c4-8e43-be00f64a265d None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:42:08.891367 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application [None req-a1f25b8e-bc12-45c4-8e43-be00f64a265d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 07:42:08.891367 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 07:42:08.891367 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 07:42:08.891367 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 07:42:08.891367 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 07:42:08.891367 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 07:42:08.891367 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 07:42:08.891367 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 07:42:08.891367 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 07:42:08.891367 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 07:42:08.891367 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 07:42:08.891367 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 07:42:08.891367 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 16 07:42:08.891367 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 16 07:42:08.891367 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 16 07:42:08.892284 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 16 07:42:08.892284 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 07:42:08.892284 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 07:42:08.892284 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 07:42:08.892284 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 07:42:08.892284 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 07:42:08.892284 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 07:42:08.892284 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 07:42:08.892284 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application with Lock( Sep 16 07:42:08.892284 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 07:42:08.892284 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._enter() Sep 16 07:42:08.892284 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 07:42:08.892284 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 07:42:08.892284 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 07:42:08.892284 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.creator() Sep 16 07:42:08.892284 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 07:42:08.892284 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application created_value = creator( Sep 16 07:42:08.893109 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 16 07:42:08.893109 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 16 07:42:08.893109 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 16 07:42:08.893109 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 16 07:42:08.893109 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 16 07:42:08.893109 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 16 07:42:08.893109 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 07:42:08.893109 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Sep 16 07:42:08.895650 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 274/539] 10.222.0.57 () {56 vars in 1111 bytes} [Fri Sep 16 07:42:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 07:42:08.901627 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53cd68c-4f68-4964-891d-e037e269586a None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:42:08.925864 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:42:09.010281 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53cd68c-4f68-4964-891d-e037e269586a None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:42:09.047018 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831b561b-f9a9-4010-83bd-e93309d80b2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:42:09.047650 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831b561b-f9a9-4010-83bd-e93309d80b2b None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:09.047913 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831b561b-f9a9-4010-83bd-e93309d80b2b None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:09.048185 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831b561b-f9a9-4010-83bd-e93309d80b2b None admin] PATH_INFO: `/v3/projects` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:09.048880 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831b561b-f9a9-4010-83bd-e93309d80b2b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:42:09.049181 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831b561b-f9a9-4010-83bd-e93309d80b2b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:42:09.050641 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831b561b-f9a9-4010-83bd-e93309d80b2b None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:42:09.063871 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 266/540] 10.222.0.57 () {56 vars in 1148 bytes} [Fri Sep 16 07:42:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:42:09.069751 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f25b8e-bc12-45c4-8e43-be00f64a265d None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:42:09.182789 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f25b8e-bc12-45c4-8e43-be00f64a265d None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:42:09.219189 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb20f1ab-fc04-4315-b910-c6e48bbd39d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:42:09.219793 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb20f1ab-fc04-4315-b910-c6e48bbd39d5 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:09.220071 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb20f1ab-fc04-4315-b910-c6e48bbd39d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:09.220343 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb20f1ab-fc04-4315-b910-c6e48bbd39d5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:09.221068 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb20f1ab-fc04-4315-b910-c6e48bbd39d5 None admin] RBAC: Adding query filter params (role.id=f59220af7e7f4a8dbc30ba6325c7827c, scope.project.id=4735f453c0c24cc4a1c14e9ac84a0b46, user.id=1062e457207a41e4ba4f0a0c4bf36f1d) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:42:09.221378 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb20f1ab-fc04-4315-b910-c6e48bbd39d5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:42:09.222922 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb20f1ab-fc04-4315-b910-c6e48bbd39d5 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:42:09.229167 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 275/541] 10.222.0.57 () {56 vars in 1374 bytes} [Fri Sep 16 07:42:09 2022] GET /identity/v3/role_assignments?user.id=1062e457207a41e4ba4f0a0c4bf36f1d&scope.project.id=4735f453c0c24cc4a1c14e9ac84a0b46&role.id=f59220af7e7f4a8dbc30ba6325c7827c => generated 259 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:42:09.294752 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feaf8f3d-4efd-46ad-bf38-ded1f3ca996f None None] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:09.295697 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feaf8f3d-4efd-46ad-bf38-ded1f3ca996f None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:09.296164 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feaf8f3d-4efd-46ad-bf38-ded1f3ca996f None None] PATH_INFO: `/` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:09.298047 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 267/542] 10.222.0.57 () {54 vars in 927 bytes} [Fri Sep 16 07:42:09 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 07:42:09.304098 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5561dd9-634b-4ca7-8bcf-1e4e368b90e5 None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:09.304389 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5561dd9-634b-4ca7-8bcf-1e4e368b90e5 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:09.304654 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5561dd9-634b-4ca7-8bcf-1e4e368b90e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:09.334913 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-c5561dd9-634b-4ca7-8bcf-1e4e368b90e5 None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:42:09.336156 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-c5561dd9-634b-4ca7-8bcf-1e4e368b90e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:42:09.396488 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:42:09.425300 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 276/543] 10.222.0.57 () {58 vars in 1024 bytes} [Fri Sep 16 07:42:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 07:42:09.846189 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a13804d-8d34-47d2-9452-4dc9080fd297 None None] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:09.846570 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a13804d-8d34-47d2-9452-4dc9080fd297 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:09.846745 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a13804d-8d34-47d2-9452-4dc9080fd297 None None] PATH_INFO: `/` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:09.848329 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 268/544] 10.222.0.57 () {54 vars in 927 bytes} [Fri Sep 16 07:42:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 07:42:09.853476 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800780ce-028b-442a-86d3-153453ea683e None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:09.853785 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800780ce-028b-442a-86d3-153453ea683e None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:09.854069 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800780ce-028b-442a-86d3-153453ea683e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:09.859238 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a13804d-8d34-47d2-9452-4dc9080fd297 None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:42:09.881747 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-800780ce-028b-442a-86d3-153453ea683e None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:42:09.881747 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-800780ce-028b-442a-86d3-153453ea683e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:42:09.964006 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 277/545] 10.222.0.57 () {58 vars in 1024 bytes} [Fri Sep 16 07:42:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 07:42:10.014094 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:42:10.058420 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a13804d-8d34-47d2-9452-4dc9080fd297 None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:42:10.120795 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c95456b-abfc-4a16-95ba-8a0726c039f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:42:10.121418 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c95456b-abfc-4a16-95ba-8a0726c039f7 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:10.121737 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c95456b-abfc-4a16-95ba-8a0726c039f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:10.122135 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c95456b-abfc-4a16-95ba-8a0726c039f7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:10.141027 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c95456b-abfc-4a16-95ba-8a0726c039f7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 07:42:10.145804 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application [None req-8c95456b-abfc-4a16-95ba-8a0726c039f7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 16 07:42:10.145804 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 07:42:10.145804 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 07:42:10.145804 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 07:42:10.145804 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 07:42:10.145804 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 07:42:10.145804 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 07:42:10.145804 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 07:42:10.145804 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 07:42:10.145804 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 07:42:10.145804 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 07:42:10.145804 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 07:42:10.145804 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 07:42:10.145804 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 07:42:10.145804 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 07:42:10.145804 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 07:42:10.146695 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 07:42:10.146695 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 07:42:10.146695 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 07:42:10.146695 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 07:42:10.146695 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 07:42:10.146695 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 07:42:10.146695 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 07:42:10.146695 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 07:42:10.146695 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 07:42:10.146695 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 07:42:10.146695 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 07:42:10.146695 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application with Lock( Sep 16 07:42:10.146695 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 07:42:10.146695 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._enter() Sep 16 07:42:10.146695 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 07:42:10.146695 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 07:42:10.147491 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 07:42:10.147491 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.creator() Sep 16 07:42:10.147491 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 07:42:10.147491 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application created_value = creator( Sep 16 07:42:10.147491 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 07:42:10.147491 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 07:42:10.147491 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 07:42:10.147491 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 07:42:10.147491 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 07:42:10.147491 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 07:42:10.147491 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 16 07:42:10.147491 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Sep 16 07:42:10.147491 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 269/546] 10.222.0.57 () {56 vars in 1102 bytes} [Fri Sep 16 07:42:09 2022] GET /identity/v3/roles/service => generated 85 bytes in 288 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 16 07:42:10.154749 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800780ce-028b-442a-86d3-153453ea683e None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:42:10.264560 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800780ce-028b-442a-86d3-153453ea683e None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:42:10.275072 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:42:10.301955 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8915a403-081a-4f62-a159-3af47753d074 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:42:10.302569 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8915a403-081a-4f62-a159-3af47753d074 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:10.302844 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8915a403-081a-4f62-a159-3af47753d074 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:10.303111 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8915a403-081a-4f62-a159-3af47753d074 None admin] PATH_INFO: `/v3/roles` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:10.303771 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8915a403-081a-4f62-a159-3af47753d074 None admin] RBAC: Adding query filter params (name=service) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:42:10.304068 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8915a403-081a-4f62-a159-3af47753d074 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:42:10.305436 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8915a403-081a-4f62-a159-3af47753d074 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:42:10.314732 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 278/547] 10.222.0.57 () {56 vars in 1103 bytes} [Fri Sep 16 07:42:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:42:10.322989 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c95456b-abfc-4a16-95ba-8a0726c039f7 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:42:10.402595 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8915a403-081a-4f62-a159-3af47753d074 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:42:10.520258 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8915a403-081a-4f62-a159-3af47753d074 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:42:10.555819 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2908589-a448-4773-b22d-75f69b313fcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:42:10.556447 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2908589-a448-4773-b22d-75f69b313fcf None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:10.556726 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2908589-a448-4773-b22d-75f69b313fcf None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:10.556908 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c95456b-abfc-4a16-95ba-8a0726c039f7 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:42:10.557023 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2908589-a448-4773-b22d-75f69b313fcf None admin] PATH_INFO: `/v3/roles/service` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:10.568901 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2908589-a448-4773-b22d-75f69b313fcf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 07:42:10.575505 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application [None req-d2908589-a448-4773-b22d-75f69b313fcf None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 16 07:42:10.575505 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 07:42:10.575505 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 07:42:10.575505 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 07:42:10.575505 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 07:42:10.575505 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 07:42:10.575505 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 07:42:10.575505 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 07:42:10.575505 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 07:42:10.575505 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 07:42:10.575505 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 07:42:10.575505 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 07:42:10.575505 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 07:42:10.575505 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 07:42:10.575505 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 07:42:10.575505 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 07:42:10.576666 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 07:42:10.576666 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 07:42:10.576666 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 07:42:10.576666 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 07:42:10.576666 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 07:42:10.576666 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 07:42:10.576666 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 07:42:10.576666 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 07:42:10.576666 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 07:42:10.576666 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 07:42:10.576666 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 07:42:10.576666 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application with Lock( Sep 16 07:42:10.576666 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 07:42:10.576666 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._enter() Sep 16 07:42:10.576666 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 07:42:10.576666 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 07:42:10.577456 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 07:42:10.577456 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.creator() Sep 16 07:42:10.577456 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 07:42:10.577456 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application created_value = creator( Sep 16 07:42:10.577456 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 07:42:10.577456 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 07:42:10.577456 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 07:42:10.577456 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 07:42:10.577456 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 07:42:10.577456 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 07:42:10.577456 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 16 07:42:10.577456 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Sep 16 07:42:10.577456 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 279/548] 10.222.0.57 () {56 vars in 1102 bytes} [Fri Sep 16 07:42:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 07:42:10.586077 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2908589-a448-4773-b22d-75f69b313fcf None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:42:10.620482 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:42:10.651835 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4407c943-241a-4b4b-8794-650ae4cbccce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:42:10.652782 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4407c943-241a-4b4b-8794-650ae4cbccce None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:10.653318 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4407c943-241a-4b4b-8794-650ae4cbccce None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:10.653670 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4407c943-241a-4b4b-8794-650ae4cbccce None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:10.679347 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:42:10.690498 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4407c943-241a-4b4b-8794-650ae4cbccce None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:42:10.692126 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4407c943-241a-4b4b-8794-650ae4cbccce None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:42:10.697807 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2908589-a448-4773-b22d-75f69b313fcf None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:42:10.722603 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application [None req-4407c943-241a-4b4b-8794-650ae4cbccce None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 07:42:10.722603 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 07:42:10.722603 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 07:42:10.722603 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 07:42:10.722603 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 07:42:10.722603 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 07:42:10.722603 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 07:42:10.722603 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 07:42:10.722603 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 07:42:10.722603 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 07:42:10.722603 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 07:42:10.722603 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 07:42:10.722603 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 07:42:10.722603 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 07:42:10.722603 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 07:42:10.722603 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 07:42:10.724169 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 07:42:10.724169 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 07:42:10.724169 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 07:42:10.724169 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 07:42:10.724169 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 07:42:10.724169 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 07:42:10.724169 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 07:42:10.724169 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application with Lock( Sep 16 07:42:10.724169 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 07:42:10.724169 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._enter() Sep 16 07:42:10.724169 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 07:42:10.724169 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 07:42:10.724169 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 07:42:10.724169 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.creator() Sep 16 07:42:10.724169 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 07:42:10.724169 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application created_value = creator( Sep 16 07:42:10.724169 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 07:42:10.725129 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 07:42:10.725129 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 07:42:10.725129 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Sep 16 07:42:10.725129 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 270/549] 10.222.0.57 () {56 vars in 1108 bytes} [Fri Sep 16 07:42:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 401 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 07:42:10.729106 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4407c943-241a-4b4b-8794-650ae4cbccce None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:42:10.739963 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b83a474-25d6-4666-8e34-e002d7f88403 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:42:10.740894 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b83a474-25d6-4666-8e34-e002d7f88403 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:10.741393 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b83a474-25d6-4666-8e34-e002d7f88403 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:10.741960 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b83a474-25d6-4666-8e34-e002d7f88403 None admin] PATH_INFO: `/v3/roles` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:10.742894 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b83a474-25d6-4666-8e34-e002d7f88403 None admin] RBAC: Adding query filter params (name=service) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:42:10.743409 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b83a474-25d6-4666-8e34-e002d7f88403 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:42:10.744988 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b83a474-25d6-4666-8e34-e002d7f88403 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:42:10.757634 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 280/550] 10.222.0.57 () {56 vars in 1103 bytes} [Fri Sep 16 07:42:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 07:42:10.767225 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b83a474-25d6-4666-8e34-e002d7f88403 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:42:10.934543 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:42:10.936442 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b83a474-25d6-4666-8e34-e002d7f88403 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:42:10.940923 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4407c943-241a-4b4b-8794-650ae4cbccce None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:42:11.004091 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44e9fc7-579b-4446-bb35-137e16d3fa7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:42:11.004724 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44e9fc7-579b-4446-bb35-137e16d3fa7a None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:11.004998 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44e9fc7-579b-4446-bb35-137e16d3fa7a None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:11.005265 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44e9fc7-579b-4446-bb35-137e16d3fa7a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:11.015565 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688da6e3-a3c2-41b4-934d-ae583f8b35c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:42:11.016177 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688da6e3-a3c2-41b4-934d-ae583f8b35c0 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:11.016447 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688da6e3-a3c2-41b4-934d-ae583f8b35c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:11.016710 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688da6e3-a3c2-41b4-934d-ae583f8b35c0 None admin] PATH_INFO: `/v3/domains` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:11.017348 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688da6e3-a3c2-41b4-934d-ae583f8b35c0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:42:11.017645 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688da6e3-a3c2-41b4-934d-ae583f8b35c0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:42:11.019404 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688da6e3-a3c2-41b4-934d-ae583f8b35c0 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:42:11.021960 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44e9fc7-579b-4446-bb35-137e16d3fa7a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:42:11.023692 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44e9fc7-579b-4446-bb35-137e16d3fa7a None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:42:11.032476 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 271/551] 10.222.0.57 () {56 vars in 1109 bytes} [Fri Sep 16 07:42:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:42:11.037398 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7968aeff-023f-49bc-bceb-02d3e015a988 None None] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:11.037678 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7968aeff-023f-49bc-bceb-02d3e015a988 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:11.037973 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7968aeff-023f-49bc-bceb-02d3e015a988 None None] PATH_INFO: `/` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:11.039198 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 272/552] 10.222.0.57 () {54 vars in 927 bytes} [Fri Sep 16 07:42:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 07:42:11.040694 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7968aeff-023f-49bc-bceb-02d3e015a988 None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:42:11.046291 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application [None req-d44e9fc7-579b-4446-bb35-137e16d3fa7a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 07:42:11.046291 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 07:42:11.046291 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 07:42:11.046291 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 07:42:11.046291 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 07:42:11.046291 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 07:42:11.046291 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 07:42:11.046291 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 07:42:11.046291 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 07:42:11.046291 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 07:42:11.046291 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 07:42:11.046291 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 07:42:11.046291 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 07:42:11.046291 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 07:42:11.046291 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 07:42:11.046291 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 07:42:11.047315 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 07:42:11.047315 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 07:42:11.047315 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 07:42:11.047315 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 07:42:11.047315 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 07:42:11.047315 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 07:42:11.047315 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 07:42:11.047315 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application with Lock( Sep 16 07:42:11.047315 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 07:42:11.047315 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._enter() Sep 16 07:42:11.047315 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 07:42:11.047315 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 07:42:11.047315 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 07:42:11.047315 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.creator() Sep 16 07:42:11.047315 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 07:42:11.047315 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application created_value = creator( Sep 16 07:42:11.047315 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 07:42:11.048172 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 07:42:11.048172 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 07:42:11.048172 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Sep 16 07:42:11.050299 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 281/553] 10.222.0.57 () {56 vars in 1108 bytes} [Fri Sep 16 07:42:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 07:42:11.051826 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4950e5c7-a1aa-46de-8c75-46d674e5a273 None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:11.052322 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4950e5c7-a1aa-46de-8c75-46d674e5a273 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:11.052801 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4950e5c7-a1aa-46de-8c75-46d674e5a273 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:11.071899 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-4950e5c7-a1aa-46de-8c75-46d674e5a273 None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:42:11.073466 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-4950e5c7-a1aa-46de-8c75-46d674e5a273 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:42:11.110075 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:42:11.145605 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 282/554] 10.222.0.57 () {58 vars in 1024 bytes} [Fri Sep 16 07:42:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 16 07:42:11.146706 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4950e5c7-a1aa-46de-8c75-46d674e5a273 None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:42:11.162289 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7968aeff-023f-49bc-bceb-02d3e015a988 None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:42:11.219120 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1396c0b4-f65f-43b4-ac53-21fe678fa6e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:42:11.220036 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1396c0b4-f65f-43b4-ac53-21fe678fa6e3 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:11.220455 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1396c0b4-f65f-43b4-ac53-21fe678fa6e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:11.220864 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1396c0b4-f65f-43b4-ac53-21fe678fa6e3 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:11.224745 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:42:11.231949 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1396c0b4-f65f-43b4-ac53-21fe678fa6e3 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:42:11.241745 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1396c0b4-f65f-43b4-ac53-21fe678fa6e3 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:42:11.252368 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4950e5c7-a1aa-46de-8c75-46d674e5a273 None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:42:11.258875 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application [None req-1396c0b4-f65f-43b4-ac53-21fe678fa6e3 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 16 07:42:11.258875 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 07:42:11.258875 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 07:42:11.258875 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 07:42:11.258875 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 07:42:11.258875 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 07:42:11.258875 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 07:42:11.258875 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 07:42:11.258875 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 07:42:11.258875 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 07:42:11.258875 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 07:42:11.258875 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 07:42:11.258875 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 16 07:42:11.258875 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 16 07:42:11.258875 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 16 07:42:11.258875 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 16 07:42:11.259867 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 07:42:11.259867 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 07:42:11.259867 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 16 07:42:11.259867 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 07:42:11.259867 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 16 07:42:11.259867 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 07:42:11.259867 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 07:42:11.259867 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 07:42:11.259867 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 07:42:11.259867 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 07:42:11.259867 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 07:42:11.259867 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application with Lock( Sep 16 07:42:11.259867 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 07:42:11.259867 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._enter() Sep 16 07:42:11.259867 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 07:42:11.259867 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 07:42:11.259867 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 07:42:11.259867 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.creator() Sep 16 07:42:11.260771 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 07:42:11.260771 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application created_value = creator( Sep 16 07:42:11.260771 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 16 07:42:11.260771 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 16 07:42:11.260771 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 16 07:42:11.260771 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 16 07:42:11.260771 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 16 07:42:11.260771 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 16 07:42:11.260771 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 16 07:42:11.260771 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Sep 16 07:42:11.271377 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 273/555] 10.222.0.57 () {56 vars in 1096 bytes} [Fri Sep 16 07:42:11 2022] GET /identity/v3/users/swift => generated 83 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 16 07:42:11.277146 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1396c0b4-f65f-43b4-ac53-21fe678fa6e3 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:42:11.294205 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8c2753-a14a-4c5c-bdb6-a9dc2116a756 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:42:11.294205 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8c2753-a14a-4c5c-bdb6-a9dc2116a756 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:11.294205 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8c2753-a14a-4c5c-bdb6-a9dc2116a756 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:11.294205 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8c2753-a14a-4c5c-bdb6-a9dc2116a756 None admin] PATH_INFO: `/v3/domains` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:11.294909 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8c2753-a14a-4c5c-bdb6-a9dc2116a756 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:42:11.294909 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8c2753-a14a-4c5c-bdb6-a9dc2116a756 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:42:11.294909 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8c2753-a14a-4c5c-bdb6-a9dc2116a756 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:42:11.310802 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 283/556] 10.222.0.57 () {56 vars in 1109 bytes} [Fri Sep 16 07:42:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:42:11.314041 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8c2753-a14a-4c5c-bdb6-a9dc2116a756 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:42:11.462615 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8c2753-a14a-4c5c-bdb6-a9dc2116a756 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:42:11.464356 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1396c0b4-f65f-43b4-ac53-21fe678fa6e3 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:42:11.479139 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:42:11.507513 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d60ecdd-e381-4f15-a489-d88f8a4dd196 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:42:11.508120 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d60ecdd-e381-4f15-a489-d88f8a4dd196 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:11.508399 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d60ecdd-e381-4f15-a489-d88f8a4dd196 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:11.508669 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d60ecdd-e381-4f15-a489-d88f8a4dd196 None admin] PATH_INFO: `/v3/users` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:11.509395 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d60ecdd-e381-4f15-a489-d88f8a4dd196 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:42:11.509700 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d60ecdd-e381-4f15-a489-d88f8a4dd196 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:42:11.511147 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d60ecdd-e381-4f15-a489-d88f8a4dd196 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:42:11.518109 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7211dd5-2ecb-4d3d-9858-2657a8a6b08e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:42:11.519354 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7211dd5-2ecb-4d3d-9858-2657a8a6b08e None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:11.519848 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7211dd5-2ecb-4d3d-9858-2657a8a6b08e None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:11.520318 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7211dd5-2ecb-4d3d-9858-2657a8a6b08e None admin] PATH_INFO: `/v3/users/nova` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:11.524846 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:42:11.531324 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 274/557] 10.222.0.57 () {56 vars in 1135 bytes} [Fri Sep 16 07:42:11 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:42:11.531717 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7211dd5-2ecb-4d3d-9858-2657a8a6b08e None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:42:11.532819 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d60ecdd-e381-4f15-a489-d88f8a4dd196 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:42:11.533007 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7211dd5-2ecb-4d3d-9858-2657a8a6b08e None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:42:11.549289 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application [None req-f7211dd5-2ecb-4d3d-9858-2657a8a6b08e None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 16 07:42:11.549289 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 07:42:11.549289 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 07:42:11.549289 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 07:42:11.549289 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 07:42:11.549289 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 07:42:11.549289 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 07:42:11.549289 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 07:42:11.549289 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 07:42:11.549289 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 07:42:11.549289 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 07:42:11.549289 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 07:42:11.549289 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 16 07:42:11.549289 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 16 07:42:11.549289 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 16 07:42:11.549289 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 16 07:42:11.551295 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 07:42:11.551295 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 07:42:11.551295 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 16 07:42:11.551295 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 07:42:11.551295 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 16 07:42:11.551295 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 07:42:11.551295 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 07:42:11.551295 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 07:42:11.551295 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 07:42:11.551295 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 07:42:11.551295 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 07:42:11.551295 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application with Lock( Sep 16 07:42:11.551295 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 07:42:11.551295 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._enter() Sep 16 07:42:11.551295 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 07:42:11.551295 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 07:42:11.551295 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 07:42:11.551295 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.creator() Sep 16 07:42:11.552465 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 07:42:11.552465 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application created_value = creator( Sep 16 07:42:11.552465 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 16 07:42:11.552465 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 16 07:42:11.552465 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 16 07:42:11.552465 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 16 07:42:11.552465 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 16 07:42:11.552465 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 16 07:42:11.552465 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 16 07:42:11.552465 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Sep 16 07:42:11.552465 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 284/558] 10.222.0.57 () {56 vars in 1093 bytes} [Fri Sep 16 07:42:11 2022] GET /identity/v3/users/nova => generated 82 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 07:42:11.552465 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab88af0b-fc5f-411e-a0fb-5118a0e9dbff None None] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:11.552465 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab88af0b-fc5f-411e-a0fb-5118a0e9dbff None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:11.553177 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab88af0b-fc5f-411e-a0fb-5118a0e9dbff None None] PATH_INFO: `/` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:11.558164 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 285/559] 10.222.0.57 () {54 vars in 927 bytes} [Fri Sep 16 07:42:11 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 07:42:11.558164 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab88af0b-fc5f-411e-a0fb-5118a0e9dbff None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:42:11.651564 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d60ecdd-e381-4f15-a489-d88f8a4dd196 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:42:11.661883 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab88af0b-fc5f-411e-a0fb-5118a0e9dbff None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:42:11.687738 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a986f6-3913-455f-aa09-d28baab202cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:42:11.688361 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a986f6-3913-455f-aa09-d28baab202cd None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:11.688637 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a986f6-3913-455f-aa09-d28baab202cd None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:11.688906 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a986f6-3913-455f-aa09-d28baab202cd None admin] PATH_INFO: `/v3/roles/service` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:11.699175 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a986f6-3913-455f-aa09-d28baab202cd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 07:42:11.704704 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application [None req-f8a986f6-3913-455f-aa09-d28baab202cd None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 16 07:42:11.704704 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 07:42:11.704704 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 07:42:11.704704 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 07:42:11.704704 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 07:42:11.704704 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 07:42:11.704704 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 07:42:11.704704 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 07:42:11.704704 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 07:42:11.704704 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 07:42:11.704704 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 07:42:11.704704 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 07:42:11.704704 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 07:42:11.704704 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 07:42:11.704704 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 07:42:11.704704 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 07:42:11.705684 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 07:42:11.705684 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 07:42:11.705684 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 07:42:11.705684 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 07:42:11.705684 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 07:42:11.705684 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 07:42:11.705684 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 07:42:11.705684 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 07:42:11.705684 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 07:42:11.705684 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 07:42:11.705684 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 07:42:11.705684 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application with Lock( Sep 16 07:42:11.705684 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 07:42:11.705684 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._enter() Sep 16 07:42:11.705684 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 07:42:11.705684 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 07:42:11.706548 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 07:42:11.706548 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.creator() Sep 16 07:42:11.706548 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 07:42:11.706548 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application created_value = creator( Sep 16 07:42:11.706548 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 07:42:11.706548 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 07:42:11.706548 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 07:42:11.706548 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 07:42:11.706548 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 07:42:11.706548 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 07:42:11.706548 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 16 07:42:11.706548 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Sep 16 07:42:11.706548 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 275/560] 10.222.0.57 () {56 vars in 1102 bytes} [Fri Sep 16 07:42:11 2022] GET /identity/v3/roles/service => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 07:42:11.706548 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a986f6-3913-455f-aa09-d28baab202cd None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:42:11.707849 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648fe481-01ea-4c6f-b6ea-83bccd9600fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:42:11.708623 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648fe481-01ea-4c6f-b6ea-83bccd9600fa None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:11.709037 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648fe481-01ea-4c6f-b6ea-83bccd9600fa None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:11.709446 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648fe481-01ea-4c6f-b6ea-83bccd9600fa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:11.740106 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:42:11.776050 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:42:11.786046 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648fe481-01ea-4c6f-b6ea-83bccd9600fa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:42:11.787551 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648fe481-01ea-4c6f-b6ea-83bccd9600fa None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:42:11.823513 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a986f6-3913-455f-aa09-d28baab202cd None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:42:11.859398 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ed45c9-8341-4784-982d-57569fbaca67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:42:11.860110 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ed45c9-8341-4784-982d-57569fbaca67 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:11.860405 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ed45c9-8341-4784-982d-57569fbaca67 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:11.860756 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ed45c9-8341-4784-982d-57569fbaca67 None admin] PATH_INFO: `/v3/users` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:11.861465 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ed45c9-8341-4784-982d-57569fbaca67 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:42:11.861792 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ed45c9-8341-4784-982d-57569fbaca67 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:42:11.863199 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ed45c9-8341-4784-982d-57569fbaca67 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:42:11.888409 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 276/561] 10.222.0.57 () {56 vars in 1133 bytes} [Fri Sep 16 07:42:11 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:42:11.888409 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c58814d-6f06-497a-8dc9-cadd76dcf27b None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:11.888409 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c58814d-6f06-497a-8dc9-cadd76dcf27b None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:11.888409 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c58814d-6f06-497a-8dc9-cadd76dcf27b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:11.905271 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-6c58814d-6f06-497a-8dc9-cadd76dcf27b None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:42:11.906779 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-6c58814d-6f06-497a-8dc9-cadd76dcf27b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:42:11.921714 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 286/562] 10.222.0.57 () {58 vars in 1282 bytes} [Fri Sep 16 07:42:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 16 07:42:11.921714 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648fe481-01ea-4c6f-b6ea-83bccd9600fa None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:42:11.979340 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 277/563] 10.222.0.57 () {58 vars in 1024 bytes} [Fri Sep 16 07:42:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 07:42:11.980179 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c58814d-6f06-497a-8dc9-cadd76dcf27b None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:42:11.999442 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:42:12.019421 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:42:12.027008 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648fe481-01ea-4c6f-b6ea-83bccd9600fa None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:42:12.065363 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba8fd1d-2628-49c4-906a-f578df93fdfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:42:12.065992 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba8fd1d-2628-49c4-906a-f578df93fdfa None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:12.066270 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba8fd1d-2628-49c4-906a-f578df93fdfa None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:12.066539 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba8fd1d-2628-49c4-906a-f578df93fdfa None admin] PATH_INFO: `/v3/roles` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:12.067197 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba8fd1d-2628-49c4-906a-f578df93fdfa None admin] RBAC: Adding query filter params (name=service) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:42:12.067513 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba8fd1d-2628-49c4-906a-f578df93fdfa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:42:12.068884 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba8fd1d-2628-49c4-906a-f578df93fdfa None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:42:12.077750 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 287/564] 10.222.0.57 () {56 vars in 1103 bytes} [Fri Sep 16 07:42:11 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:42:12.078806 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efc0ad9-9d97-4ea8-b6eb-21051e749f32 None None] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:12.079093 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efc0ad9-9d97-4ea8-b6eb-21051e749f32 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:12.079366 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efc0ad9-9d97-4ea8-b6eb-21051e749f32 None None] PATH_INFO: `/` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:12.081630 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 288/565] 10.222.0.57 () {54 vars in 927 bytes} [Fri Sep 16 07:42:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 07:42:12.081630 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efc0ad9-9d97-4ea8-b6eb-21051e749f32 None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:42:12.100540 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c58814d-6f06-497a-8dc9-cadd76dcf27b None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:42:12.140668 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfa26dc-2dac-4477-8980-d1aa32edb910 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:42:12.141295 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfa26dc-2dac-4477-8980-d1aa32edb910 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:12.141572 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfa26dc-2dac-4477-8980-d1aa32edb910 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:12.141871 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfa26dc-2dac-4477-8980-d1aa32edb910 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:12.152431 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfa26dc-2dac-4477-8980-d1aa32edb910 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:42:12.154518 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfa26dc-2dac-4477-8980-d1aa32edb910 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:42:12.170609 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application [None req-9dfa26dc-2dac-4477-8980-d1aa32edb910 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 07:42:12.170609 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 07:42:12.170609 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 07:42:12.170609 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 07:42:12.170609 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 07:42:12.170609 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 07:42:12.170609 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 07:42:12.170609 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 07:42:12.170609 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 07:42:12.170609 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 07:42:12.170609 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 07:42:12.170609 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 07:42:12.170609 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 07:42:12.170609 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 07:42:12.170609 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 07:42:12.170609 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 07:42:12.171630 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 07:42:12.171630 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 07:42:12.171630 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 07:42:12.171630 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 07:42:12.171630 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 07:42:12.171630 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 07:42:12.171630 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 07:42:12.171630 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application with Lock( Sep 16 07:42:12.171630 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 07:42:12.171630 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._enter() Sep 16 07:42:12.171630 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 07:42:12.171630 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 07:42:12.171630 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 07:42:12.171630 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.creator() Sep 16 07:42:12.171630 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 07:42:12.171630 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application created_value = creator( Sep 16 07:42:12.171630 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 07:42:12.177141 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 07:42:12.177141 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 07:42:12.177141 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Sep 16 07:42:12.177141 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 278/566] 10.222.0.57 () {56 vars in 1108 bytes} [Fri Sep 16 07:42:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 07:42:12.177141 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfa26dc-2dac-4477-8980-d1aa32edb910 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:42:12.206780 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efc0ad9-9d97-4ea8-b6eb-21051e749f32 None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:42:12.241553 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86cfa6c-cf43-40ba-a953-5aebaf186744 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:42:12.242250 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86cfa6c-cf43-40ba-a953-5aebaf186744 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:12.242642 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86cfa6c-cf43-40ba-a953-5aebaf186744 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:12.242910 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86cfa6c-cf43-40ba-a953-5aebaf186744 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:12.245554 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:42:12.256564 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86cfa6c-cf43-40ba-a953-5aebaf186744 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:42:12.257967 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86cfa6c-cf43-40ba-a953-5aebaf186744 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:42:12.272368 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application [None req-f86cfa6c-cf43-40ba-a953-5aebaf186744 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 07:42:12.272368 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 07:42:12.272368 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 07:42:12.272368 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 07:42:12.272368 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 07:42:12.272368 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 07:42:12.272368 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 07:42:12.272368 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 07:42:12.272368 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 07:42:12.272368 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 07:42:12.272368 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 07:42:12.272368 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 07:42:12.272368 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 07:42:12.272368 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 07:42:12.272368 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 07:42:12.272368 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 07:42:12.273373 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 07:42:12.273373 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 07:42:12.273373 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 07:42:12.273373 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 07:42:12.273373 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 07:42:12.273373 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 07:42:12.273373 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 07:42:12.273373 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application with Lock( Sep 16 07:42:12.273373 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 07:42:12.273373 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._enter() Sep 16 07:42:12.273373 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 07:42:12.273373 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 07:42:12.273373 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 07:42:12.273373 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.creator() Sep 16 07:42:12.273373 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 07:42:12.273373 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application created_value = creator( Sep 16 07:42:12.273373 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 07:42:12.274819 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 07:42:12.274819 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 07:42:12.274819 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Sep 16 07:42:12.274819 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 289/567] 10.222.0.57 () {56 vars in 1108 bytes} [Fri Sep 16 07:42:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 07:42:12.274819 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596524e5-30f1-4628-9793-eda50d8844c1 None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:12.275167 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596524e5-30f1-4628-9793-eda50d8844c1 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:12.275270 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596524e5-30f1-4628-9793-eda50d8844c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:12.281698 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfa26dc-2dac-4477-8980-d1aa32edb910 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:42:12.292362 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-596524e5-30f1-4628-9793-eda50d8844c1 None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:42:12.294213 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-596524e5-30f1-4628-9793-eda50d8844c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:42:12.296234 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:42:12.315814 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d9b421-ff01-473a-8ce0-48db0078aa97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:42:12.316436 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d9b421-ff01-473a-8ce0-48db0078aa97 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:12.316714 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d9b421-ff01-473a-8ce0-48db0078aa97 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:12.316986 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d9b421-ff01-473a-8ce0-48db0078aa97 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:12.327200 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d9b421-ff01-473a-8ce0-48db0078aa97 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:42:12.328629 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d9b421-ff01-473a-8ce0-48db0078aa97 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:42:12.342558 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application [None req-56d9b421-ff01-473a-8ce0-48db0078aa97 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 07:42:12.342558 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 07:42:12.342558 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 07:42:12.342558 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 07:42:12.342558 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 07:42:12.342558 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 07:42:12.342558 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 07:42:12.342558 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 07:42:12.342558 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 07:42:12.342558 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 07:42:12.342558 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 07:42:12.342558 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 07:42:12.342558 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 07:42:12.342558 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 07:42:12.342558 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 07:42:12.342558 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 07:42:12.343636 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 07:42:12.343636 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 07:42:12.343636 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 07:42:12.343636 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 07:42:12.343636 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 07:42:12.343636 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 07:42:12.343636 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 07:42:12.343636 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application with Lock( Sep 16 07:42:12.343636 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 07:42:12.343636 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._enter() Sep 16 07:42:12.343636 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 07:42:12.343636 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 07:42:12.343636 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 07:42:12.343636 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.creator() Sep 16 07:42:12.343636 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 07:42:12.343636 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application created_value = creator( Sep 16 07:42:12.343636 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 07:42:12.344525 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 07:42:12.344525 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 07:42:12.344525 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Sep 16 07:42:12.344525 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 279/568] 10.222.0.57 () {56 vars in 1108 bytes} [Fri Sep 16 07:42:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 07:42:12.344525 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d9b421-ff01-473a-8ce0-48db0078aa97 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:42:12.362586 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 290/569] 10.222.0.57 () {58 vars in 1024 bytes} [Fri Sep 16 07:42:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 07:42:12.363496 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596524e5-30f1-4628-9793-eda50d8844c1 None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:42:12.452769 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d9b421-ff01-473a-8ce0-48db0078aa97 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:42:12.459683 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596524e5-30f1-4628-9793-eda50d8844c1 None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:42:12.476826 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:42:12.490407 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a32bf5-9f54-4134-8105-6f6513ab2fb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:42:12.491114 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a32bf5-9f54-4134-8105-6f6513ab2fb6 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:12.491393 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a32bf5-9f54-4134-8105-6f6513ab2fb6 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:12.491665 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a32bf5-9f54-4134-8105-6f6513ab2fb6 None admin] PATH_INFO: `/v3/domains` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:12.492299 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a32bf5-9f54-4134-8105-6f6513ab2fb6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:42:12.492601 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a32bf5-9f54-4134-8105-6f6513ab2fb6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:42:12.493991 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a32bf5-9f54-4134-8105-6f6513ab2fb6 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:42:12.495684 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec36de0-700d-40b5-ac50-3cb37ad1777b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:42:12.496315 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec36de0-700d-40b5-ac50-3cb37ad1777b None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:12.497231 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec36de0-700d-40b5-ac50-3cb37ad1777b None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:12.497513 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec36de0-700d-40b5-ac50-3cb37ad1777b None admin] PATH_INFO: `/v3/roles/service` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:12.504509 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:42:12.507931 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 280/570] 10.222.0.57 () {56 vars in 1109 bytes} [Fri Sep 16 07:42:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:42:12.508678 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a32bf5-9f54-4134-8105-6f6513ab2fb6 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:42:12.514227 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec36de0-700d-40b5-ac50-3cb37ad1777b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 07:42:12.520086 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application [None req-6ec36de0-700d-40b5-ac50-3cb37ad1777b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 16 07:42:12.520086 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 07:42:12.520086 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 07:42:12.520086 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 07:42:12.520086 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 07:42:12.520086 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 07:42:12.520086 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 07:42:12.520086 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 07:42:12.520086 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 07:42:12.520086 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 07:42:12.520086 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 07:42:12.520086 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 07:42:12.520086 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 07:42:12.520086 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 07:42:12.520086 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 07:42:12.520086 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 07:42:12.521015 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 07:42:12.521015 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 07:42:12.521015 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 07:42:12.521015 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 07:42:12.521015 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 07:42:12.521015 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 07:42:12.521015 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 07:42:12.521015 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 07:42:12.521015 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 07:42:12.521015 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 07:42:12.521015 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 07:42:12.521015 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application with Lock( Sep 16 07:42:12.521015 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 07:42:12.521015 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._enter() Sep 16 07:42:12.521015 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 07:42:12.521015 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 07:42:12.521884 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 07:42:12.521884 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.creator() Sep 16 07:42:12.521884 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 07:42:12.521884 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application created_value = creator( Sep 16 07:42:12.521884 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 07:42:12.521884 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 07:42:12.521884 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 07:42:12.521884 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 07:42:12.521884 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 07:42:12.521884 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 07:42:12.521884 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 16 07:42:12.521884 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Sep 16 07:42:12.522518 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 291/571] 10.222.0.57 () {56 vars in 1102 bytes} [Fri Sep 16 07:42:12 2022] GET /identity/v3/roles/service => generated 85 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 07:42:12.523320 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec36de0-700d-40b5-ac50-3cb37ad1777b None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:42:12.618388 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a32bf5-9f54-4134-8105-6f6513ab2fb6 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:42:12.636545 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec36de0-700d-40b5-ac50-3cb37ad1777b None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:42:12.652332 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b394fda9-84b4-4798-a3ac-46a04512d9a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:42:12.653450 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b394fda9-84b4-4798-a3ac-46a04512d9a2 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:12.653749 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b394fda9-84b4-4798-a3ac-46a04512d9a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:12.654201 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b394fda9-84b4-4798-a3ac-46a04512d9a2 None admin] PATH_INFO: `/v3/domains` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:12.654832 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b394fda9-84b4-4798-a3ac-46a04512d9a2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:42:12.655130 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b394fda9-84b4-4798-a3ac-46a04512d9a2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:42:12.656489 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b394fda9-84b4-4798-a3ac-46a04512d9a2 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:42:12.667337 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 281/572] 10.222.0.57 () {56 vars in 1109 bytes} [Fri Sep 16 07:42:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:42:12.668119 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b394fda9-84b4-4798-a3ac-46a04512d9a2 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:42:12.671205 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400983fa-9a57-4abb-ae3b-8273f6665d8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:42:12.671809 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400983fa-9a57-4abb-ae3b-8273f6665d8c None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:12.672073 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400983fa-9a57-4abb-ae3b-8273f6665d8c None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:12.672344 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400983fa-9a57-4abb-ae3b-8273f6665d8c None admin] PATH_INFO: `/v3/domains` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:12.673121 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400983fa-9a57-4abb-ae3b-8273f6665d8c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:42:12.673426 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400983fa-9a57-4abb-ae3b-8273f6665d8c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:42:12.674813 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400983fa-9a57-4abb-ae3b-8273f6665d8c None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:42:12.686146 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 292/573] 10.222.0.57 () {56 vars in 1109 bytes} [Fri Sep 16 07:42:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:42:12.687003 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400983fa-9a57-4abb-ae3b-8273f6665d8c None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:42:12.716546 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:42:12.743832 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:42:12.773968 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b394fda9-84b4-4798-a3ac-46a04512d9a2 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:42:12.785018 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400983fa-9a57-4abb-ae3b-8273f6665d8c None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:42:12.807026 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333f84f5-1b21-44f6-9263-7c737f65ae93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:42:12.807649 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333f84f5-1b21-44f6-9263-7c737f65ae93 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:12.807926 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333f84f5-1b21-44f6-9263-7c737f65ae93 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:12.808195 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333f84f5-1b21-44f6-9263-7c737f65ae93 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:12.814915 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333f84f5-1b21-44f6-9263-7c737f65ae93 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:42:12.816347 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333f84f5-1b21-44f6-9263-7c737f65ae93 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:42:12.818654 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7658b7-ced2-4544-8899-9aa39fd4e601 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:42:12.819249 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7658b7-ced2-4544-8899-9aa39fd4e601 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:12.819527 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7658b7-ced2-4544-8899-9aa39fd4e601 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:12.819796 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7658b7-ced2-4544-8899-9aa39fd4e601 None admin] PATH_INFO: `/v3/roles` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:12.820441 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7658b7-ced2-4544-8899-9aa39fd4e601 None admin] RBAC: Adding query filter params (name=service) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:42:12.820741 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7658b7-ced2-4544-8899-9aa39fd4e601 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:42:12.822110 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7658b7-ced2-4544-8899-9aa39fd4e601 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:42:12.827504 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application [None req-333f84f5-1b21-44f6-9263-7c737f65ae93 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 07:42:12.827504 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 07:42:12.827504 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 07:42:12.827504 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 07:42:12.827504 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 07:42:12.827504 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 07:42:12.827504 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 07:42:12.827504 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 07:42:12.827504 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 07:42:12.827504 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 07:42:12.827504 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 07:42:12.827504 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 07:42:12.827504 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 16 07:42:12.827504 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 16 07:42:12.827504 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 16 07:42:12.828344 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 16 07:42:12.828344 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 07:42:12.828344 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 07:42:12.828344 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 07:42:12.828344 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 07:42:12.828344 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 07:42:12.828344 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 07:42:12.828344 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 07:42:12.828344 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application with Lock( Sep 16 07:42:12.828344 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 07:42:12.828344 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._enter() Sep 16 07:42:12.828344 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 07:42:12.828344 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 07:42:12.828344 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 07:42:12.828344 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.creator() Sep 16 07:42:12.828344 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 07:42:12.828344 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application created_value = creator( Sep 16 07:42:12.829213 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 16 07:42:12.829213 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 16 07:42:12.829213 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 16 07:42:12.829213 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 16 07:42:12.829213 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 16 07:42:12.829213 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 16 07:42:12.829213 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 07:42:12.829213 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Sep 16 07:42:12.829213 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 282/574] 10.222.0.57 () {56 vars in 1111 bytes} [Fri Sep 16 07:42:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 07:42:12.829862 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333f84f5-1b21-44f6-9263-7c737f65ae93 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:42:12.830321 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 293/575] 10.222.0.57 () {56 vars in 1103 bytes} [Fri Sep 16 07:42:12 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:42:12.830793 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7658b7-ced2-4544-8899-9aa39fd4e601 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:42:12.928081 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7658b7-ced2-4544-8899-9aa39fd4e601 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:42:12.929200 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333f84f5-1b21-44f6-9263-7c737f65ae93 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:42:12.930725 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:42:12.948539 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:42:12.963409 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8a30b9-030b-4a0e-82f8-8044b2bcc8aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:42:12.964031 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8a30b9-030b-4a0e-82f8-8044b2bcc8aa None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:12.964309 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8a30b9-030b-4a0e-82f8-8044b2bcc8aa None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:12.964417 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c1e3de-2835-4aa2-81a1-6e2c2e561bc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:42:12.964578 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8a30b9-030b-4a0e-82f8-8044b2bcc8aa None admin] PATH_INFO: `/v3/projects/service` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:12.964968 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c1e3de-2835-4aa2-81a1-6e2c2e561bc7 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:12.965245 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c1e3de-2835-4aa2-81a1-6e2c2e561bc7 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:12.966147 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c1e3de-2835-4aa2-81a1-6e2c2e561bc7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:12.971663 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8a30b9-030b-4a0e-82f8-8044b2bcc8aa None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:42:12.973099 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8a30b9-030b-4a0e-82f8-8044b2bcc8aa None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:42:12.976072 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c1e3de-2835-4aa2-81a1-6e2c2e561bc7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 07:42:12.981417 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application [None req-93c1e3de-2835-4aa2-81a1-6e2c2e561bc7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 16 07:42:12.981417 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 07:42:12.981417 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 07:42:12.981417 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 07:42:12.981417 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 07:42:12.981417 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 07:42:12.981417 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 07:42:12.981417 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 07:42:12.981417 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 07:42:12.981417 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 07:42:12.981417 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 07:42:12.981417 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 07:42:12.981417 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 07:42:12.981417 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 07:42:12.981417 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 07:42:12.981417 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 07:42:12.985834 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 07:42:12.985834 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 07:42:12.985834 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 07:42:12.985834 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 07:42:12.985834 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 07:42:12.985834 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 07:42:12.985834 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 07:42:12.985834 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 07:42:12.985834 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 07:42:12.985834 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 07:42:12.985834 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 07:42:12.985834 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application with Lock( Sep 16 07:42:12.985834 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 07:42:12.985834 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._enter() Sep 16 07:42:12.985834 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 07:42:12.985834 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 07:42:12.986748 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 07:42:12.986748 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.creator() Sep 16 07:42:12.986748 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 07:42:12.986748 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application created_value = creator( Sep 16 07:42:12.986748 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 07:42:12.986748 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 07:42:12.986748 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 07:42:12.986748 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 07:42:12.986748 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 07:42:12.986748 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 07:42:12.986748 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 16 07:42:12.986748 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Sep 16 07:42:12.986748 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 283/576] 10.222.0.57 () {56 vars in 1102 bytes} [Fri Sep 16 07:42:12 2022] GET /identity/v3/roles/service => generated 85 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 07:42:12.986748 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c1e3de-2835-4aa2-81a1-6e2c2e561bc7 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:42:12.987510 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application [None req-8c8a30b9-030b-4a0e-82f8-8044b2bcc8aa None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 07:42:12.987510 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 07:42:12.987510 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 07:42:12.987510 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 07:42:12.987510 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 07:42:12.987510 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 07:42:12.987510 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 07:42:12.987510 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 07:42:12.987510 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 07:42:12.987510 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 07:42:12.987510 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 07:42:12.987510 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 07:42:12.987510 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 16 07:42:12.987510 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 16 07:42:12.987510 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 16 07:42:12.988380 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 16 07:42:12.988380 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 07:42:12.988380 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 07:42:12.988380 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 07:42:12.988380 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 07:42:12.988380 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 07:42:12.988380 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 07:42:12.988380 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 07:42:12.988380 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application with Lock( Sep 16 07:42:12.988380 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 07:42:12.988380 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._enter() Sep 16 07:42:12.988380 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 07:42:12.988380 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 07:42:12.988380 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 07:42:12.988380 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.creator() Sep 16 07:42:12.988380 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 07:42:12.988380 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application created_value = creator( Sep 16 07:42:12.989457 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 16 07:42:12.989457 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 16 07:42:12.989457 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 16 07:42:12.989457 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 16 07:42:12.989457 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 16 07:42:12.989457 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 16 07:42:12.989457 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 07:42:12.989457 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Sep 16 07:42:12.989457 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 294/577] 10.222.0.57 () {56 vars in 1111 bytes} [Fri Sep 16 07:42:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 07:42:12.989457 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8a30b9-030b-4a0e-82f8-8044b2bcc8aa None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:42:13.085613 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c1e3de-2835-4aa2-81a1-6e2c2e561bc7 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:42:13.088979 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8a30b9-030b-4a0e-82f8-8044b2bcc8aa None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:42:13.122821 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d61406c-9e12-4c9e-a40b-3b5370834074 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:42:13.122980 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b06e650-c2f0-41fa-848e-c2afd60e6eba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:42:13.123422 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d61406c-9e12-4c9e-a40b-3b5370834074 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:13.123595 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b06e650-c2f0-41fa-848e-c2afd60e6eba None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:13.123707 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d61406c-9e12-4c9e-a40b-3b5370834074 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:13.123877 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b06e650-c2f0-41fa-848e-c2afd60e6eba None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:13.123977 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d61406c-9e12-4c9e-a40b-3b5370834074 None admin] PATH_INFO: `/v3/projects` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:13.124152 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b06e650-c2f0-41fa-848e-c2afd60e6eba None admin] PATH_INFO: `/v3/users/glance` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:13.124615 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d61406c-9e12-4c9e-a40b-3b5370834074 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:42:13.124915 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d61406c-9e12-4c9e-a40b-3b5370834074 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:42:13.126354 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d61406c-9e12-4c9e-a40b-3b5370834074 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:42:13.132719 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b06e650-c2f0-41fa-848e-c2afd60e6eba None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:42:13.134188 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b06e650-c2f0-41fa-848e-c2afd60e6eba None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:42:13.138662 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 295/578] 10.222.0.57 () {56 vars in 1148 bytes} [Fri Sep 16 07:42:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:42:13.139446 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d61406c-9e12-4c9e-a40b-3b5370834074 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:42:13.145698 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application [None req-5b06e650-c2f0-41fa-848e-c2afd60e6eba None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 16 07:42:13.145698 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 07:42:13.145698 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 07:42:13.145698 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 07:42:13.145698 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 07:42:13.145698 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 07:42:13.145698 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 07:42:13.145698 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 07:42:13.145698 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 07:42:13.145698 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 07:42:13.145698 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 07:42:13.145698 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 07:42:13.145698 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 16 07:42:13.145698 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 16 07:42:13.145698 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 16 07:42:13.145698 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 16 07:42:13.146698 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 07:42:13.146698 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 07:42:13.146698 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 16 07:42:13.146698 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 07:42:13.146698 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 16 07:42:13.146698 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 07:42:13.146698 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 07:42:13.146698 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 07:42:13.146698 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 07:42:13.146698 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 07:42:13.146698 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 07:42:13.146698 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application with Lock( Sep 16 07:42:13.146698 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 07:42:13.146698 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._enter() Sep 16 07:42:13.146698 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 07:42:13.146698 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 07:42:13.146698 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 07:42:13.146698 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.creator() Sep 16 07:42:13.147642 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 07:42:13.147642 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application created_value = creator( Sep 16 07:42:13.147642 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 16 07:42:13.147642 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 16 07:42:13.147642 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 16 07:42:13.147642 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 16 07:42:13.147642 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 16 07:42:13.147642 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 16 07:42:13.147642 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 16 07:42:13.147642 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Sep 16 07:42:13.147642 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 284/579] 10.222.0.57 () {56 vars in 1099 bytes} [Fri Sep 16 07:42:12 2022] GET /identity/v3/users/glance => generated 84 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 07:42:13.147642 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b06e650-c2f0-41fa-848e-c2afd60e6eba None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:42:13.176075 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:42:13.185121 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:42:13.242658 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d61406c-9e12-4c9e-a40b-3b5370834074 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:42:13.250190 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b06e650-c2f0-41fa-848e-c2afd60e6eba None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:42:13.275979 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8b0264-e207-4242-a5c2-2cabb9b916a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:42:13.276596 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8b0264-e207-4242-a5c2-2cabb9b916a2 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:13.276870 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8b0264-e207-4242-a5c2-2cabb9b916a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:13.277139 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8b0264-e207-4242-a5c2-2cabb9b916a2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:13.284193 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297cdb73-a3cb-4edf-87e1-755fec7cfb90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:42:13.284795 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297cdb73-a3cb-4edf-87e1-755fec7cfb90 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:13.285073 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297cdb73-a3cb-4edf-87e1-755fec7cfb90 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:13.285347 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297cdb73-a3cb-4edf-87e1-755fec7cfb90 None admin] PATH_INFO: `/v3/roles` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:13.286029 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297cdb73-a3cb-4edf-87e1-755fec7cfb90 None admin] RBAC: Adding query filter params (name=service) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:42:13.286330 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297cdb73-a3cb-4edf-87e1-755fec7cfb90 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:42:13.287452 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8b0264-e207-4242-a5c2-2cabb9b916a2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:42:13.287694 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297cdb73-a3cb-4edf-87e1-755fec7cfb90 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:42:13.288862 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8b0264-e207-4242-a5c2-2cabb9b916a2 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:42:13.295640 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 285/580] 10.222.0.57 () {56 vars in 1103 bytes} [Fri Sep 16 07:42:13 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:42:13.296315 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297cdb73-a3cb-4edf-87e1-755fec7cfb90 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:42:13.304333 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application [None req-5d8b0264-e207-4242-a5c2-2cabb9b916a2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 07:42:13.304333 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 07:42:13.304333 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 07:42:13.304333 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 07:42:13.304333 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 07:42:13.304333 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 07:42:13.304333 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 07:42:13.304333 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 07:42:13.304333 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 07:42:13.304333 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 07:42:13.304333 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 07:42:13.304333 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 07:42:13.304333 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 07:42:13.304333 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 07:42:13.304333 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 07:42:13.304333 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 07:42:13.305669 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 07:42:13.305669 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 07:42:13.305669 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 07:42:13.305669 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 07:42:13.305669 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 07:42:13.305669 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 07:42:13.305669 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 07:42:13.305669 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application with Lock( Sep 16 07:42:13.305669 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 07:42:13.305669 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._enter() Sep 16 07:42:13.305669 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 07:42:13.305669 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 07:42:13.305669 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 07:42:13.305669 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.creator() Sep 16 07:42:13.305669 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 07:42:13.305669 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application created_value = creator( Sep 16 07:42:13.305669 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 07:42:13.306783 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 07:42:13.306783 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 07:42:13.306783 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Sep 16 07:42:13.306783 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 296/581] 10.222.0.57 () {56 vars in 1108 bytes} [Fri Sep 16 07:42:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 07:42:13.306783 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8b0264-e207-4242-a5c2-2cabb9b916a2 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:42:13.381313 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:42:13.397068 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:42:13.397857 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297cdb73-a3cb-4edf-87e1-755fec7cfb90 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:42:13.406892 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8b0264-e207-4242-a5c2-2cabb9b916a2 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:42:13.431276 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6f236c-7531-4fab-a6bc-ec6ace73800c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:42:13.431869 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6f236c-7531-4fab-a6bc-ec6ace73800c None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:13.432143 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6f236c-7531-4fab-a6bc-ec6ace73800c None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:13.432414 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6f236c-7531-4fab-a6bc-ec6ace73800c None admin] PATH_INFO: `/v3/projects` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:13.433082 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6f236c-7531-4fab-a6bc-ec6ace73800c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:42:13.433380 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6f236c-7531-4fab-a6bc-ec6ace73800c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:42:13.435531 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6f236c-7531-4fab-a6bc-ec6ace73800c None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:42:13.440487 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2254973-1658-439a-8ffb-32d60f8d721e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:42:13.441141 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2254973-1658-439a-8ffb-32d60f8d721e None admin] REQUEST_METHOD: `PUT` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:13.441423 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2254973-1658-439a-8ffb-32d60f8d721e None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:13.441698 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2254973-1658-439a-8ffb-32d60f8d721e None admin] PATH_INFO: `/v3/projects/4735f453c0c24cc4a1c14e9ac84a0b46/users/9bec4d9b08514461a1bf63c6b88f53b2/roles/f59220af7e7f4a8dbc30ba6325c7827c` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:13.446952 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 286/582] 10.222.0.57 () {56 vars in 1148 bytes} [Fri Sep 16 07:42:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:42:13.447729 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6f236c-7531-4fab-a6bc-ec6ace73800c None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:42:13.457025 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2254973-1658-439a-8ffb-32d60f8d721e None admin] RBAC: Authorizing `identity:create_grant(project_id=4735f453c0c24cc4a1c14e9ac84a0b46, user_id=9bec4d9b08514461a1bf63c6b88f53b2, role_id=f59220af7e7f4a8dbc30ba6325c7827c)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:42:13.458512 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2254973-1658-439a-8ffb-32d60f8d721e None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:42:13.470561 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 297/583] 10.222.0.57 () {58 vars in 1439 bytes} [Fri Sep 16 07:42:13 2022] PUT /identity/v3/projects/4735f453c0c24cc4a1c14e9ac84a0b46/users/9bec4d9b08514461a1bf63c6b88f53b2/roles/f59220af7e7f4a8dbc30ba6325c7827c => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 07:42:13.471370 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2254973-1658-439a-8ffb-32d60f8d721e None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:42:13.587610 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6f236c-7531-4fab-a6bc-ec6ace73800c None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:42:13.591406 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2254973-1658-439a-8ffb-32d60f8d721e None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:42:13.626361 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb06c9f4-c383-4ed2-9fbc-f28ff92df578 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:42:13.626978 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb06c9f4-c383-4ed2-9fbc-f28ff92df578 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:13.627259 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb06c9f4-c383-4ed2-9fbc-f28ff92df578 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:13.627522 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb06c9f4-c383-4ed2-9fbc-f28ff92df578 None admin] PATH_INFO: `/v3/users` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:13.628259 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb06c9f4-c383-4ed2-9fbc-f28ff92df578 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:42:13.628564 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb06c9f4-c383-4ed2-9fbc-f28ff92df578 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:42:13.630040 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb06c9f4-c383-4ed2-9fbc-f28ff92df578 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:42:13.630262 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65318482-4212-48ea-9654-639772a761c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:42:13.630875 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65318482-4212-48ea-9654-639772a761c4 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:13.631454 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65318482-4212-48ea-9654-639772a761c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:13.631670 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65318482-4212-48ea-9654-639772a761c4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:13.644632 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65318482-4212-48ea-9654-639772a761c4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:42:13.646164 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65318482-4212-48ea-9654-639772a761c4 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:42:13.649138 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:42:13.653771 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 287/584] 10.222.0.57 () {56 vars in 1137 bytes} [Fri Sep 16 07:42:13 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:42:13.654014 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb06c9f4-c383-4ed2-9fbc-f28ff92df578 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:42:13.657238 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:42:13.666144 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application [None req-65318482-4212-48ea-9654-639772a761c4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 07:42:13.666144 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 07:42:13.666144 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 07:42:13.666144 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 07:42:13.666144 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 07:42:13.666144 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 07:42:13.666144 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 07:42:13.666144 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 07:42:13.666144 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 07:42:13.666144 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 07:42:13.666144 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 07:42:13.666144 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 07:42:13.666144 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 07:42:13.666144 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 07:42:13.666144 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 07:42:13.666144 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 07:42:13.667151 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 07:42:13.667151 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 07:42:13.667151 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 07:42:13.667151 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 07:42:13.667151 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 07:42:13.667151 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 07:42:13.667151 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 07:42:13.667151 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application with Lock( Sep 16 07:42:13.667151 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 07:42:13.667151 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._enter() Sep 16 07:42:13.667151 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 07:42:13.667151 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 07:42:13.667151 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 07:42:13.667151 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.creator() Sep 16 07:42:13.667151 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 07:42:13.667151 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application created_value = creator( Sep 16 07:42:13.667151 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 07:42:13.668065 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 07:42:13.668065 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 07:42:13.668065 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Sep 16 07:42:13.668065 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 298/585] 10.222.0.57 () {56 vars in 1108 bytes} [Fri Sep 16 07:42:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 07:42:13.668065 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65318482-4212-48ea-9654-639772a761c4 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:42:13.768450 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb06c9f4-c383-4ed2-9fbc-f28ff92df578 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:42:13.778403 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65318482-4212-48ea-9654-639772a761c4 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:42:13.806407 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f082d67b-3d62-44a0-8d0d-525e1439636f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:42:13.807008 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f082d67b-3d62-44a0-8d0d-525e1439636f None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:13.807306 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f082d67b-3d62-44a0-8d0d-525e1439636f None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:13.807575 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f082d67b-3d62-44a0-8d0d-525e1439636f None admin] PATH_INFO: `/v3/domains` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:13.808203 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f082d67b-3d62-44a0-8d0d-525e1439636f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:42:13.808503 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f082d67b-3d62-44a0-8d0d-525e1439636f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:42:13.810483 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f082d67b-3d62-44a0-8d0d-525e1439636f None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:42:13.813472 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582d29b1-3db4-4a2d-8e07-10e6e588b8a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:42:13.814297 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582d29b1-3db4-4a2d-8e07-10e6e588b8a1 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:13.814717 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582d29b1-3db4-4a2d-8e07-10e6e588b8a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:13.815147 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582d29b1-3db4-4a2d-8e07-10e6e588b8a1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:13.816008 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582d29b1-3db4-4a2d-8e07-10e6e588b8a1 None admin] RBAC: Adding query filter params (role.id=f59220af7e7f4a8dbc30ba6325c7827c, scope.project.id=4735f453c0c24cc4a1c14e9ac84a0b46, user.id=38abb0283b41449d8183b88912f2574a) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:42:13.816481 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582d29b1-3db4-4a2d-8e07-10e6e588b8a1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:42:13.818090 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582d29b1-3db4-4a2d-8e07-10e6e588b8a1 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:42:13.822214 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 288/586] 10.222.0.57 () {56 vars in 1109 bytes} [Fri Sep 16 07:42:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:42:13.823017 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f082d67b-3d62-44a0-8d0d-525e1439636f None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:42:13.828724 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 299/587] 10.222.0.57 () {56 vars in 1374 bytes} [Fri Sep 16 07:42:13 2022] GET /identity/v3/role_assignments?user.id=38abb0283b41449d8183b88912f2574a&scope.project.id=4735f453c0c24cc4a1c14e9ac84a0b46&role.id=f59220af7e7f4a8dbc30ba6325c7827c => generated 259 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:42:13.829991 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582d29b1-3db4-4a2d-8e07-10e6e588b8a1 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:42:13.904002 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:42:13.909231 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:42:13.951756 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f082d67b-3d62-44a0-8d0d-525e1439636f None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:42:13.964607 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582d29b1-3db4-4a2d-8e07-10e6e588b8a1 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:42:13.991529 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcea2354-67f7-43d8-b29b-e4ad9fa8a901 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:42:13.992206 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcea2354-67f7-43d8-b29b-e4ad9fa8a901 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:13.992587 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcea2354-67f7-43d8-b29b-e4ad9fa8a901 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:13.992958 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcea2354-67f7-43d8-b29b-e4ad9fa8a901 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:14.005000 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730232b8-e503-485b-b92c-5f079d3ea662 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:42:14.005941 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730232b8-e503-485b-b92c-5f079d3ea662 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:14.006629 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730232b8-e503-485b-b92c-5f079d3ea662 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:14.006958 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcea2354-67f7-43d8-b29b-e4ad9fa8a901 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:42:14.007231 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730232b8-e503-485b-b92c-5f079d3ea662 None admin] PATH_INFO: `/v3/domains` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:14.008033 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730232b8-e503-485b-b92c-5f079d3ea662 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:42:14.008475 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730232b8-e503-485b-b92c-5f079d3ea662 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:42:14.008877 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcea2354-67f7-43d8-b29b-e4ad9fa8a901 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:42:14.010231 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730232b8-e503-485b-b92c-5f079d3ea662 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:42:14.027378 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application [None req-fcea2354-67f7-43d8-b29b-e4ad9fa8a901 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 07:42:14.027378 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 07:42:14.027378 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 07:42:14.027378 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 07:42:14.027378 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 07:42:14.027378 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 07:42:14.027378 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 07:42:14.027378 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 07:42:14.027378 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 07:42:14.027378 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 07:42:14.027378 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 07:42:14.027378 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 07:42:14.027378 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 07:42:14.027378 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 07:42:14.027378 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 07:42:14.027378 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 07:42:14.028414 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 07:42:14.028414 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 07:42:14.028414 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 07:42:14.028414 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 07:42:14.028414 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 07:42:14.028414 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 07:42:14.028414 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 07:42:14.028414 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application with Lock( Sep 16 07:42:14.028414 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 07:42:14.028414 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._enter() Sep 16 07:42:14.028414 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 07:42:14.028414 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 07:42:14.028414 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 07:42:14.028414 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.creator() Sep 16 07:42:14.028414 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 07:42:14.028414 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application created_value = creator( Sep 16 07:42:14.028414 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 07:42:14.029658 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 07:42:14.029658 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 07:42:14.029658 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Sep 16 07:42:14.029658 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 289/588] 10.222.0.57 () {56 vars in 1108 bytes} [Fri Sep 16 07:42:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 07:42:14.029658 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcea2354-67f7-43d8-b29b-e4ad9fa8a901 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:42:14.031135 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 300/589] 10.222.0.57 () {56 vars in 1109 bytes} [Fri Sep 16 07:42:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:42:14.032216 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730232b8-e503-485b-b92c-5f079d3ea662 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:42:14.139485 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcea2354-67f7-43d8-b29b-e4ad9fa8a901 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:42:14.143448 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730232b8-e503-485b-b92c-5f079d3ea662 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:42:14.154635 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:42:14.163446 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:42:14.177000 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54572fe6-ebf1-4ffb-96f0-546623a5f563 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:42:14.177843 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54572fe6-ebf1-4ffb-96f0-546623a5f563 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:14.178225 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54572fe6-ebf1-4ffb-96f0-546623a5f563 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:14.178596 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54572fe6-ebf1-4ffb-96f0-546623a5f563 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:14.184598 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47a9349-beb2-4e7e-b76a-75738380e44e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:42:14.185430 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47a9349-beb2-4e7e-b76a-75738380e44e None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:14.185892 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47a9349-beb2-4e7e-b76a-75738380e44e None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:14.186327 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47a9349-beb2-4e7e-b76a-75738380e44e None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:14.188762 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54572fe6-ebf1-4ffb-96f0-546623a5f563 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:42:14.190412 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54572fe6-ebf1-4ffb-96f0-546623a5f563 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:42:14.195023 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47a9349-beb2-4e7e-b76a-75738380e44e None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:42:14.196654 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47a9349-beb2-4e7e-b76a-75738380e44e None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:42:14.204705 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application [None req-54572fe6-ebf1-4ffb-96f0-546623a5f563 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 16 07:42:14.204705 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 07:42:14.204705 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 07:42:14.204705 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 07:42:14.204705 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 07:42:14.204705 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 07:42:14.204705 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 07:42:14.204705 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 07:42:14.204705 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 07:42:14.204705 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 07:42:14.204705 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 07:42:14.204705 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 07:42:14.204705 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 16 07:42:14.204705 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 16 07:42:14.204705 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 16 07:42:14.204705 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 16 07:42:14.205927 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 07:42:14.205927 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 07:42:14.205927 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 16 07:42:14.205927 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 07:42:14.205927 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 16 07:42:14.205927 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 07:42:14.205927 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 07:42:14.205927 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 07:42:14.205927 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 07:42:14.205927 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 07:42:14.205927 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 07:42:14.205927 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application with Lock( Sep 16 07:42:14.205927 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 07:42:14.205927 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._enter() Sep 16 07:42:14.205927 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 07:42:14.205927 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 07:42:14.205927 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 07:42:14.205927 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.creator() Sep 16 07:42:14.207079 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 07:42:14.207079 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application created_value = creator( Sep 16 07:42:14.207079 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 16 07:42:14.207079 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 16 07:42:14.207079 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 16 07:42:14.207079 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 16 07:42:14.207079 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 16 07:42:14.207079 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 16 07:42:14.207079 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 16 07:42:14.207079 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Sep 16 07:42:14.209626 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 290/590] 10.222.0.57 () {56 vars in 1099 bytes} [Fri Sep 16 07:42:14 2022] GET /identity/v3/users/cinder => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 07:42:14.210692 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54572fe6-ebf1-4ffb-96f0-546623a5f563 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:42:14.218065 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application [None req-f47a9349-beb2-4e7e-b76a-75738380e44e None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 16 07:42:14.218065 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 07:42:14.218065 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 07:42:14.218065 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 07:42:14.218065 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 07:42:14.218065 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 07:42:14.218065 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 07:42:14.218065 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 07:42:14.218065 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 07:42:14.218065 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 07:42:14.218065 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 07:42:14.218065 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 07:42:14.218065 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 16 07:42:14.218065 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 16 07:42:14.218065 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 16 07:42:14.218065 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 16 07:42:14.219098 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 07:42:14.219098 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 07:42:14.219098 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 16 07:42:14.219098 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 07:42:14.219098 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 16 07:42:14.219098 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 07:42:14.219098 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 07:42:14.219098 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 07:42:14.219098 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 07:42:14.219098 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 07:42:14.219098 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 07:42:14.219098 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application with Lock( Sep 16 07:42:14.219098 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 07:42:14.219098 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._enter() Sep 16 07:42:14.219098 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 07:42:14.219098 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 07:42:14.219098 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 07:42:14.219098 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.creator() Sep 16 07:42:14.220021 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 07:42:14.220021 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application created_value = creator( Sep 16 07:42:14.220021 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 16 07:42:14.220021 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 16 07:42:14.220021 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 16 07:42:14.220021 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 16 07:42:14.220021 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 16 07:42:14.220021 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 16 07:42:14.220021 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 16 07:42:14.220021 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Sep 16 07:42:14.227024 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 301/591] 10.222.0.57 () {56 vars in 1102 bytes} [Fri Sep 16 07:42:14 2022] GET /identity/v3/users/neutron => generated 85 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 07:42:14.228276 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47a9349-beb2-4e7e-b76a-75738380e44e None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:42:14.325429 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54572fe6-ebf1-4ffb-96f0-546623a5f563 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:42:14.338201 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47a9349-beb2-4e7e-b76a-75738380e44e None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:42:14.360644 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b1d529-3f83-470a-a765-5ee99d7c94f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:42:14.361368 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b1d529-3f83-470a-a765-5ee99d7c94f9 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:14.361737 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b1d529-3f83-470a-a765-5ee99d7c94f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:14.362229 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b1d529-3f83-470a-a765-5ee99d7c94f9 None admin] PATH_INFO: `/v3/domains` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:14.362950 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b1d529-3f83-470a-a765-5ee99d7c94f9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:42:14.363328 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b1d529-3f83-470a-a765-5ee99d7c94f9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:42:14.364775 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b1d529-3f83-470a-a765-5ee99d7c94f9 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:42:14.378425 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152f4b71-2578-4cdb-b95b-5ac427c6b82d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:42:14.379394 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152f4b71-2578-4cdb-b95b-5ac427c6b82d None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:14.379849 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152f4b71-2578-4cdb-b95b-5ac427c6b82d None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:14.380371 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 291/592] 10.222.0.57 () {56 vars in 1109 bytes} [Fri Sep 16 07:42:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:42:14.380620 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152f4b71-2578-4cdb-b95b-5ac427c6b82d None admin] PATH_INFO: `/v3/users` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:14.381736 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b1d529-3f83-470a-a765-5ee99d7c94f9 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:42:14.382176 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152f4b71-2578-4cdb-b95b-5ac427c6b82d None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:42:14.382682 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152f4b71-2578-4cdb-b95b-5ac427c6b82d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:42:14.384381 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152f4b71-2578-4cdb-b95b-5ac427c6b82d None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:42:14.410194 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 302/593] 10.222.0.57 () {56 vars in 1137 bytes} [Fri Sep 16 07:42:14 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:42:14.411486 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152f4b71-2578-4cdb-b95b-5ac427c6b82d None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:42:14.417946 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:42:14.452546 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:42:14.487659 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b1d529-3f83-470a-a765-5ee99d7c94f9 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:42:14.523955 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3480a0dc-7c4c-4502-bbd9-38e10dbad90f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:42:14.524566 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3480a0dc-7c4c-4502-bbd9-38e10dbad90f None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:14.524846 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3480a0dc-7c4c-4502-bbd9-38e10dbad90f None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:14.525117 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3480a0dc-7c4c-4502-bbd9-38e10dbad90f None admin] PATH_INFO: `/v3/users` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:14.525861 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3480a0dc-7c4c-4502-bbd9-38e10dbad90f None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:42:14.526166 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3480a0dc-7c4c-4502-bbd9-38e10dbad90f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:42:14.526460 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152f4b71-2578-4cdb-b95b-5ac427c6b82d None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:42:14.527582 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3480a0dc-7c4c-4502-bbd9-38e10dbad90f None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:42:14.550319 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 292/594] 10.222.0.57 () {56 vars in 1139 bytes} [Fri Sep 16 07:42:14 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:42:14.551227 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3480a0dc-7c4c-4502-bbd9-38e10dbad90f None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:42:14.564811 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993e5965-414c-4941-a765-5ea89d59ab69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:42:14.565817 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993e5965-414c-4941-a765-5ea89d59ab69 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:14.566292 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993e5965-414c-4941-a765-5ea89d59ab69 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:14.566753 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993e5965-414c-4941-a765-5ea89d59ab69 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:14.574463 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993e5965-414c-4941-a765-5ea89d59ab69 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:42:14.576333 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993e5965-414c-4941-a765-5ea89d59ab69 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:42:14.588628 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application [None req-993e5965-414c-4941-a765-5ea89d59ab69 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 07:42:14.588628 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 07:42:14.588628 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 07:42:14.588628 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 07:42:14.588628 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 07:42:14.588628 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 07:42:14.588628 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 07:42:14.588628 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 07:42:14.588628 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 07:42:14.588628 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 07:42:14.588628 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 07:42:14.588628 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 07:42:14.588628 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 16 07:42:14.588628 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 16 07:42:14.588628 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 16 07:42:14.589562 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 16 07:42:14.589562 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 07:42:14.589562 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 07:42:14.589562 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 07:42:14.589562 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 07:42:14.589562 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 07:42:14.589562 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 07:42:14.589562 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 07:42:14.589562 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application with Lock( Sep 16 07:42:14.589562 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 07:42:14.589562 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._enter() Sep 16 07:42:14.589562 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 07:42:14.589562 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 07:42:14.589562 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 07:42:14.589562 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.creator() Sep 16 07:42:14.589562 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 07:42:14.589562 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application created_value = creator( Sep 16 07:42:14.590523 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 16 07:42:14.590523 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 16 07:42:14.590523 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 16 07:42:14.590523 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 16 07:42:14.590523 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 16 07:42:14.590523 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 16 07:42:14.590523 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 07:42:14.590523 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Sep 16 07:42:14.592895 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 303/595] 10.222.0.57 () {56 vars in 1111 bytes} [Fri Sep 16 07:42:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 07:42:14.594058 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993e5965-414c-4941-a765-5ea89d59ab69 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:42:14.650035 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:42:14.659490 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3480a0dc-7c4c-4502-bbd9-38e10dbad90f None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:42:14.697111 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6181f0f3-2b31-4f09-b80a-ba4743e0c627 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:42:14.697699 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6181f0f3-2b31-4f09-b80a-ba4743e0c627 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:14.698000 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6181f0f3-2b31-4f09-b80a-ba4743e0c627 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:14.698277 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6181f0f3-2b31-4f09-b80a-ba4743e0c627 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:14.700984 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:42:14.708968 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993e5965-414c-4941-a765-5ea89d59ab69 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:42:14.709141 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6181f0f3-2b31-4f09-b80a-ba4743e0c627 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:42:14.710582 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6181f0f3-2b31-4f09-b80a-ba4743e0c627 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:42:14.726518 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application [None req-6181f0f3-2b31-4f09-b80a-ba4743e0c627 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 07:42:14.726518 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 07:42:14.726518 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 07:42:14.726518 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 07:42:14.726518 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 07:42:14.726518 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 07:42:14.726518 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 07:42:14.726518 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 07:42:14.726518 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 07:42:14.726518 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 07:42:14.726518 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 07:42:14.726518 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 07:42:14.726518 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 07:42:14.726518 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 07:42:14.726518 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 07:42:14.726518 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 07:42:14.727557 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 07:42:14.727557 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 07:42:14.727557 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 07:42:14.727557 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 07:42:14.727557 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 07:42:14.727557 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 07:42:14.727557 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 07:42:14.727557 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application with Lock( Sep 16 07:42:14.727557 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 07:42:14.727557 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._enter() Sep 16 07:42:14.727557 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 07:42:14.727557 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 07:42:14.727557 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 07:42:14.727557 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.creator() Sep 16 07:42:14.727557 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 07:42:14.727557 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application created_value = creator( Sep 16 07:42:14.727557 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 07:42:14.729058 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 07:42:14.729058 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 07:42:14.729058 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Sep 16 07:42:14.729058 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 293/596] 10.222.0.57 () {56 vars in 1108 bytes} [Fri Sep 16 07:42:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 07:42:14.729058 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6181f0f3-2b31-4f09-b80a-ba4743e0c627 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:42:14.750981 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cafc51-20e5-4d3b-951b-2f243284108d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:42:14.751972 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cafc51-20e5-4d3b-951b-2f243284108d None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:14.752455 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cafc51-20e5-4d3b-951b-2f243284108d None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:14.752928 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cafc51-20e5-4d3b-951b-2f243284108d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:14.764603 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02cafc51-20e5-4d3b-951b-2f243284108d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:42:14.766372 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02cafc51-20e5-4d3b-951b-2f243284108d None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:42:14.782514 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application [None req-02cafc51-20e5-4d3b-951b-2f243284108d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 07:42:14.782514 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 07:42:14.782514 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 07:42:14.782514 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 07:42:14.782514 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 07:42:14.782514 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 07:42:14.782514 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 07:42:14.782514 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 07:42:14.782514 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 07:42:14.782514 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 07:42:14.782514 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 07:42:14.782514 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 07:42:14.782514 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 07:42:14.782514 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 07:42:14.782514 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 07:42:14.782514 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 07:42:14.783493 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 07:42:14.783493 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 07:42:14.783493 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 07:42:14.783493 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 07:42:14.783493 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 07:42:14.783493 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 07:42:14.783493 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 07:42:14.783493 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application with Lock( Sep 16 07:42:14.783493 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 07:42:14.783493 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._enter() Sep 16 07:42:14.783493 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 07:42:14.783493 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 07:42:14.783493 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 07:42:14.783493 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.creator() Sep 16 07:42:14.783493 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 07:42:14.783493 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application created_value = creator( Sep 16 07:42:14.783493 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 07:42:14.784435 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 07:42:14.784435 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 07:42:14.784435 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Sep 16 07:42:14.786202 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 304/597] 10.222.0.57 () {56 vars in 1108 bytes} [Fri Sep 16 07:42:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 07:42:14.787260 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cafc51-20e5-4d3b-951b-2f243284108d None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:42:14.855334 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6181f0f3-2b31-4f09-b80a-ba4743e0c627 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:42:14.899711 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7371210-2209-4ce1-bf05-26f621dee2f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:42:14.900901 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7371210-2209-4ce1-bf05-26f621dee2f0 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:14.901645 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7371210-2209-4ce1-bf05-26f621dee2f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:14.902147 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7371210-2209-4ce1-bf05-26f621dee2f0 None admin] PATH_INFO: `/v3/projects` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:14.903855 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7371210-2209-4ce1-bf05-26f621dee2f0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:42:14.904368 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7371210-2209-4ce1-bf05-26f621dee2f0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:42:14.906021 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7371210-2209-4ce1-bf05-26f621dee2f0 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:42:14.921465 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 294/598] 10.222.0.57 () {56 vars in 1148 bytes} [Fri Sep 16 07:42:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:42:14.922324 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7371210-2209-4ce1-bf05-26f621dee2f0 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:42:14.923129 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cafc51-20e5-4d3b-951b-2f243284108d None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:42:14.926771 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:42:14.962123 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311f0858-f6cc-4ba4-ab67-d3059d5912f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:42:14.963166 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311f0858-f6cc-4ba4-ab67-d3059d5912f2 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:14.963697 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311f0858-f6cc-4ba4-ab67-d3059d5912f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:14.964157 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311f0858-f6cc-4ba4-ab67-d3059d5912f2 None admin] PATH_INFO: `/v3/domains` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:14.965077 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311f0858-f6cc-4ba4-ab67-d3059d5912f2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:42:14.966156 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311f0858-f6cc-4ba4-ab67-d3059d5912f2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:42:14.967821 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311f0858-f6cc-4ba4-ab67-d3059d5912f2 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:42:14.982086 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 305/599] 10.222.0.57 () {56 vars in 1109 bytes} [Fri Sep 16 07:42:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:42:14.983252 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311f0858-f6cc-4ba4-ab67-d3059d5912f2 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:42:14.994378 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:42:15.026669 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7371210-2209-4ce1-bf05-26f621dee2f0 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:42:15.062689 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0268308-7321-4dcd-98d7-0d72cc4c6f91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:42:15.063407 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0268308-7321-4dcd-98d7-0d72cc4c6f91 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:15.063692 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0268308-7321-4dcd-98d7-0d72cc4c6f91 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:15.063962 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0268308-7321-4dcd-98d7-0d72cc4c6f91 None admin] PATH_INFO: `/v3/domains` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:15.064609 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0268308-7321-4dcd-98d7-0d72cc4c6f91 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:42:15.064912 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0268308-7321-4dcd-98d7-0d72cc4c6f91 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:42:15.066316 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0268308-7321-4dcd-98d7-0d72cc4c6f91 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:42:15.083126 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 295/600] 10.222.0.57 () {56 vars in 1109 bytes} [Fri Sep 16 07:42:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:42:15.084092 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0268308-7321-4dcd-98d7-0d72cc4c6f91 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:42:15.097137 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311f0858-f6cc-4ba4-ab67-d3059d5912f2 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:42:15.138371 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fcf1ad-4767-46d4-b8f5-987a50ce2ffe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:42:15.139421 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fcf1ad-4767-46d4-b8f5-987a50ce2ffe None admin] REQUEST_METHOD: `PUT` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:15.139894 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fcf1ad-4767-46d4-b8f5-987a50ce2ffe None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:15.140454 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fcf1ad-4767-46d4-b8f5-987a50ce2ffe None admin] PATH_INFO: `/v3/projects/4735f453c0c24cc4a1c14e9ac84a0b46/users/ceecb2c2fe9842e3b228848e00fd11ed/roles/f59220af7e7f4a8dbc30ba6325c7827c` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:15.150122 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:42:15.161066 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fcf1ad-4767-46d4-b8f5-987a50ce2ffe None admin] RBAC: Authorizing `identity:create_grant(project_id=4735f453c0c24cc4a1c14e9ac84a0b46, user_id=ceecb2c2fe9842e3b228848e00fd11ed, role_id=f59220af7e7f4a8dbc30ba6325c7827c)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:42:15.162844 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fcf1ad-4767-46d4-b8f5-987a50ce2ffe None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:42:15.179514 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 306/601] 10.222.0.57 () {58 vars in 1439 bytes} [Fri Sep 16 07:42:14 2022] PUT /identity/v3/projects/4735f453c0c24cc4a1c14e9ac84a0b46/users/ceecb2c2fe9842e3b228848e00fd11ed/roles/f59220af7e7f4a8dbc30ba6325c7827c => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 07:42:15.181280 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fcf1ad-4767-46d4-b8f5-987a50ce2ffe None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:42:15.194870 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0268308-7321-4dcd-98d7-0d72cc4c6f91 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:42:15.235068 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ab05a2-ae58-42ae-bdc1-d0730cc1e879 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:42:15.235635 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ab05a2-ae58-42ae-bdc1-d0730cc1e879 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:15.235916 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ab05a2-ae58-42ae-bdc1-d0730cc1e879 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:15.236188 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ab05a2-ae58-42ae-bdc1-d0730cc1e879 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:15.244342 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ab05a2-ae58-42ae-bdc1-d0730cc1e879 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:42:15.245633 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ab05a2-ae58-42ae-bdc1-d0730cc1e879 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:42:15.258128 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application [None req-42ab05a2-ae58-42ae-bdc1-d0730cc1e879 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 07:42:15.258128 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 07:42:15.258128 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 07:42:15.258128 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 07:42:15.258128 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 07:42:15.258128 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 07:42:15.258128 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 07:42:15.258128 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 07:42:15.258128 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 07:42:15.258128 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 07:42:15.258128 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 07:42:15.258128 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 07:42:15.258128 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 16 07:42:15.258128 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 16 07:42:15.258128 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 16 07:42:15.259081 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 16 07:42:15.259081 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 07:42:15.259081 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 07:42:15.259081 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 07:42:15.259081 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 07:42:15.259081 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 07:42:15.259081 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 07:42:15.259081 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 07:42:15.259081 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application with Lock( Sep 16 07:42:15.259081 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 07:42:15.259081 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._enter() Sep 16 07:42:15.259081 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 07:42:15.259081 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 07:42:15.259081 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 07:42:15.259081 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.creator() Sep 16 07:42:15.259081 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 07:42:15.259081 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application created_value = creator( Sep 16 07:42:15.260426 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 16 07:42:15.260426 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 16 07:42:15.260426 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 16 07:42:15.260426 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 16 07:42:15.260426 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 16 07:42:15.260426 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 16 07:42:15.260426 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 07:42:15.260426 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Sep 16 07:42:15.260426 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 296/602] 10.222.0.57 () {56 vars in 1111 bytes} [Fri Sep 16 07:42:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 07:42:15.266351 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ab05a2-ae58-42ae-bdc1-d0730cc1e879 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:42:15.272586 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:42:15.331473 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fcf1ad-4767-46d4-b8f5-987a50ce2ffe None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:42:15.370578 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e782817-a072-462f-bfae-1d757c14a514 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:42:15.371218 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e782817-a072-462f-bfae-1d757c14a514 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:15.371515 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e782817-a072-462f-bfae-1d757c14a514 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:15.371771 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e782817-a072-462f-bfae-1d757c14a514 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:15.379035 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e782817-a072-462f-bfae-1d757c14a514 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:42:15.380552 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e782817-a072-462f-bfae-1d757c14a514 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:42:15.393377 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application [None req-9e782817-a072-462f-bfae-1d757c14a514 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 07:42:15.393377 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 07:42:15.393377 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 07:42:15.393377 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 07:42:15.393377 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 07:42:15.393377 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 07:42:15.393377 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 07:42:15.393377 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 07:42:15.393377 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 07:42:15.393377 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 07:42:15.393377 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 07:42:15.393377 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 07:42:15.393377 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 16 07:42:15.393377 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 16 07:42:15.393377 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 16 07:42:15.394384 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 16 07:42:15.394384 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 07:42:15.394384 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 07:42:15.394384 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 07:42:15.394384 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 07:42:15.394384 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 07:42:15.394384 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 07:42:15.394384 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 07:42:15.394384 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application with Lock( Sep 16 07:42:15.394384 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 07:42:15.394384 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._enter() Sep 16 07:42:15.394384 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 07:42:15.394384 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 07:42:15.394384 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 07:42:15.394384 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.creator() Sep 16 07:42:15.394384 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 07:42:15.394384 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application created_value = creator( Sep 16 07:42:15.395853 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 16 07:42:15.395853 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 16 07:42:15.395853 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 16 07:42:15.395853 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 16 07:42:15.395853 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 16 07:42:15.395853 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 16 07:42:15.395853 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 07:42:15.395853 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Sep 16 07:42:15.395853 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 307/603] 10.222.0.57 () {56 vars in 1111 bytes} [Fri Sep 16 07:42:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 07:42:15.400548 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e782817-a072-462f-bfae-1d757c14a514 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:42:15.407034 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ab05a2-ae58-42ae-bdc1-d0730cc1e879 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:42:15.432955 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:42:15.465115 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7e1f23-b54c-414f-8f6b-6c18a4df1b84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:42:15.466405 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7e1f23-b54c-414f-8f6b-6c18a4df1b84 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:15.466683 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7e1f23-b54c-414f-8f6b-6c18a4df1b84 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:15.466950 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7e1f23-b54c-414f-8f6b-6c18a4df1b84 None admin] PATH_INFO: `/v3/projects` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:15.467896 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7e1f23-b54c-414f-8f6b-6c18a4df1b84 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:42:15.468004 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7e1f23-b54c-414f-8f6b-6c18a4df1b84 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:42:15.469366 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7e1f23-b54c-414f-8f6b-6c18a4df1b84 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:42:15.500228 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 297/604] 10.222.0.57 () {56 vars in 1148 bytes} [Fri Sep 16 07:42:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 07:42:15.505872 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7e1f23-b54c-414f-8f6b-6c18a4df1b84 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:42:15.534864 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e782817-a072-462f-bfae-1d757c14a514 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:42:15.558111 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:42:15.585140 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c49ced-7b4d-42fa-b561-5d93b03ba848 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:42:15.585806 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c49ced-7b4d-42fa-b561-5d93b03ba848 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:15.586090 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c49ced-7b4d-42fa-b561-5d93b03ba848 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:15.586362 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c49ced-7b4d-42fa-b561-5d93b03ba848 None admin] PATH_INFO: `/v3/projects` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:15.587200 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c49ced-7b4d-42fa-b561-5d93b03ba848 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:42:15.587431 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c49ced-7b4d-42fa-b561-5d93b03ba848 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:42:15.589065 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c49ced-7b4d-42fa-b561-5d93b03ba848 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:42:15.603707 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 308/605] 10.222.0.57 () {56 vars in 1148 bytes} [Fri Sep 16 07:42:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:42:15.610741 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c49ced-7b4d-42fa-b561-5d93b03ba848 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:42:15.637897 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7e1f23-b54c-414f-8f6b-6c18a4df1b84 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:42:15.676661 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe286a49-5a55-4ffd-92c4-ec9c50bb5f22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:42:15.677428 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe286a49-5a55-4ffd-92c4-ec9c50bb5f22 None admin] REQUEST_METHOD: `PUT` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:15.677640 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe286a49-5a55-4ffd-92c4-ec9c50bb5f22 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:15.677941 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe286a49-5a55-4ffd-92c4-ec9c50bb5f22 None admin] PATH_INFO: `/v3/projects/4735f453c0c24cc4a1c14e9ac84a0b46/users/6544bf6be4c24454a013ca110c43cef2/roles/f59220af7e7f4a8dbc30ba6325c7827c` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:15.710760 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe286a49-5a55-4ffd-92c4-ec9c50bb5f22 None admin] RBAC: Authorizing `identity:create_grant(project_id=4735f453c0c24cc4a1c14e9ac84a0b46, user_id=6544bf6be4c24454a013ca110c43cef2, role_id=f59220af7e7f4a8dbc30ba6325c7827c)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:42:15.712312 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe286a49-5a55-4ffd-92c4-ec9c50bb5f22 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:42:15.729331 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 298/606] 10.222.0.57 () {58 vars in 1439 bytes} [Fri Sep 16 07:42:15 2022] PUT /identity/v3/projects/4735f453c0c24cc4a1c14e9ac84a0b46/users/6544bf6be4c24454a013ca110c43cef2/roles/f59220af7e7f4a8dbc30ba6325c7827c => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 16 07:42:15.732259 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b34ac86-ee74-46f6-999f-7e939254ff7d None None] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:15.732600 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b34ac86-ee74-46f6-999f-7e939254ff7d None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:15.732876 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b34ac86-ee74-46f6-999f-7e939254ff7d None None] PATH_INFO: `/` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:15.734845 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 299/607] 10.222.0.57 () {54 vars in 927 bytes} [Fri Sep 16 07:42:15 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 07:42:15.735909 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c49ced-7b4d-42fa-b561-5d93b03ba848 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:42:15.741936 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f800eaa2-cf95-49a9-b308-c38e8b75cf86 None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:15.742244 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f800eaa2-cf95-49a9-b308-c38e8b75cf86 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:15.742481 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f800eaa2-cf95-49a9-b308-c38e8b75cf86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:15.766435 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-f800eaa2-cf95-49a9-b308-c38e8b75cf86 None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:42:15.767888 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-f800eaa2-cf95-49a9-b308-c38e8b75cf86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:42:15.783125 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c384e9-ac0f-4544-98d3-c0bd6e25fd93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:42:15.784592 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c384e9-ac0f-4544-98d3-c0bd6e25fd93 None admin] REQUEST_METHOD: `PUT` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:15.785389 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c384e9-ac0f-4544-98d3-c0bd6e25fd93 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:15.785890 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c384e9-ac0f-4544-98d3-c0bd6e25fd93 None admin] PATH_INFO: `/v3/projects/4735f453c0c24cc4a1c14e9ac84a0b46/users/1062e457207a41e4ba4f0a0c4bf36f1d/roles/f59220af7e7f4a8dbc30ba6325c7827c` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:15.806476 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c384e9-ac0f-4544-98d3-c0bd6e25fd93 None admin] RBAC: Authorizing `identity:create_grant(project_id=4735f453c0c24cc4a1c14e9ac84a0b46, user_id=1062e457207a41e4ba4f0a0c4bf36f1d, role_id=f59220af7e7f4a8dbc30ba6325c7827c)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:42:15.808345 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c384e9-ac0f-4544-98d3-c0bd6e25fd93 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:42:15.812297 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:42:15.829855 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 309/608] 10.222.0.57 () {58 vars in 1439 bytes} [Fri Sep 16 07:42:15 2022] PUT /identity/v3/projects/4735f453c0c24cc4a1c14e9ac84a0b46/users/1062e457207a41e4ba4f0a0c4bf36f1d/roles/f59220af7e7f4a8dbc30ba6325c7827c => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 16 07:42:15.857618 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 300/609] 10.222.0.57 () {58 vars in 1024 bytes} [Fri Sep 16 07:42:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 07:42:16.193201 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c384e9-ac0f-4544-98d3-c0bd6e25fd93 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:42:16.228977 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:42:16.331245 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c384e9-ac0f-4544-98d3-c0bd6e25fd93 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:42:16.380165 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55793378-5577-4daa-b697-2fde2e0e53e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:42:16.380782 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55793378-5577-4daa-b697-2fde2e0e53e9 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:16.381268 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55793378-5577-4daa-b697-2fde2e0e53e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:16.381543 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55793378-5577-4daa-b697-2fde2e0e53e9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:16.404143 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55793378-5577-4daa-b697-2fde2e0e53e9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 07:42:16.409410 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application [None req-55793378-5577-4daa-b697-2fde2e0e53e9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 16 07:42:16.409410 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 07:42:16.409410 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 07:42:16.409410 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 07:42:16.409410 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 07:42:16.409410 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 07:42:16.409410 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 07:42:16.409410 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 07:42:16.409410 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 07:42:16.409410 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 07:42:16.409410 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 07:42:16.409410 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 07:42:16.409410 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 07:42:16.409410 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 07:42:16.409410 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 07:42:16.409410 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 07:42:16.410422 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 07:42:16.410422 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 07:42:16.410422 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 07:42:16.410422 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 07:42:16.410422 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 07:42:16.410422 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 07:42:16.410422 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 07:42:16.410422 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 07:42:16.410422 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 07:42:16.410422 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 07:42:16.410422 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 07:42:16.410422 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application with Lock( Sep 16 07:42:16.410422 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 07:42:16.410422 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._enter() Sep 16 07:42:16.410422 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 07:42:16.410422 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 07:42:16.411481 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 07:42:16.411481 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.creator() Sep 16 07:42:16.411481 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 07:42:16.411481 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application created_value = creator( Sep 16 07:42:16.411481 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 07:42:16.411481 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 07:42:16.411481 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 07:42:16.411481 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 07:42:16.411481 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 07:42:16.411481 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 07:42:16.411481 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 16 07:42:16.411481 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Sep 16 07:42:16.411481 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 310/610] 10.222.0.57 () {56 vars in 1102 bytes} [Fri Sep 16 07:42:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 07:42:16.418117 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f800eaa2-cf95-49a9-b308-c38e8b75cf86 None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:42:16.520040 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea8fd04-53d0-4c7b-8df4-dfd72f57e116 None None] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:16.520403 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea8fd04-53d0-4c7b-8df4-dfd72f57e116 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:16.520598 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea8fd04-53d0-4c7b-8df4-dfd72f57e116 None None] PATH_INFO: `/` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:16.522257 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 311/611] 10.222.0.57 () {54 vars in 927 bytes} [Fri Sep 16 07:42:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 07:42:16.530962 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adeb6b1-5c95-4966-926d-49f811e9a093 None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:16.531248 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adeb6b1-5c95-4966-926d-49f811e9a093 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:16.531527 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adeb6b1-5c95-4966-926d-49f811e9a093 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:16.547670 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f800eaa2-cf95-49a9-b308-c38e8b75cf86 None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:42:16.575479 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-6adeb6b1-5c95-4966-926d-49f811e9a093 None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:42:16.576978 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-6adeb6b1-5c95-4966-926d-49f811e9a093 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:42:16.586604 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b767abf3-9597-4bde-87d7-53b87905d0ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:42:16.587710 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b767abf3-9597-4bde-87d7-53b87905d0ca None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:16.588197 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b767abf3-9597-4bde-87d7-53b87905d0ca None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:16.588671 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b767abf3-9597-4bde-87d7-53b87905d0ca None admin] PATH_INFO: `/v3/roles` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:16.589876 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b767abf3-9597-4bde-87d7-53b87905d0ca None admin] RBAC: Adding query filter params (name=service) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:42:16.591515 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b767abf3-9597-4bde-87d7-53b87905d0ca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:42:16.593983 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b767abf3-9597-4bde-87d7-53b87905d0ca None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:42:16.604311 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 301/612] 10.222.0.57 () {56 vars in 1103 bytes} [Fri Sep 16 07:42:16 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:42:16.610002 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b767abf3-9597-4bde-87d7-53b87905d0ca None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:42:16.670260 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:42:16.714148 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 312/613] 10.222.0.57 () {58 vars in 1024 bytes} [Fri Sep 16 07:42:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 07:42:16.761364 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b767abf3-9597-4bde-87d7-53b87905d0ca None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:42:16.799599 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9c4271-03b3-4268-a8bc-879a49375046 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:42:16.800233 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9c4271-03b3-4268-a8bc-879a49375046 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:16.800513 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9c4271-03b3-4268-a8bc-879a49375046 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:16.800784 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9c4271-03b3-4268-a8bc-879a49375046 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:16.812581 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9c4271-03b3-4268-a8bc-879a49375046 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:42:16.814272 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9c4271-03b3-4268-a8bc-879a49375046 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:42:16.829103 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application [None req-df9c4271-03b3-4268-a8bc-879a49375046 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 07:42:16.829103 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 07:42:16.829103 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 07:42:16.829103 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 07:42:16.829103 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 07:42:16.829103 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 07:42:16.829103 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 07:42:16.829103 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 07:42:16.829103 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 07:42:16.829103 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 07:42:16.829103 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 07:42:16.829103 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 07:42:16.829103 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 07:42:16.829103 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 07:42:16.829103 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 07:42:16.829103 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 07:42:16.830121 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 07:42:16.830121 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 07:42:16.830121 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 07:42:16.830121 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 07:42:16.830121 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 07:42:16.830121 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 07:42:16.830121 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 07:42:16.830121 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application with Lock( Sep 16 07:42:16.830121 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 07:42:16.830121 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._enter() Sep 16 07:42:16.830121 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 07:42:16.830121 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 07:42:16.830121 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 07:42:16.830121 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.creator() Sep 16 07:42:16.830121 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 07:42:16.830121 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application created_value = creator( Sep 16 07:42:16.830121 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 07:42:16.831262 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 07:42:16.831262 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 07:42:16.831262 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Sep 16 07:42:16.831262 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 302/614] 10.222.0.57 () {56 vars in 1108 bytes} [Fri Sep 16 07:42:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 07:42:16.839095 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adeb6b1-5c95-4966-926d-49f811e9a093 None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:42:16.863713 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:42:16.965964 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adeb6b1-5c95-4966-926d-49f811e9a093 None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:42:17.005337 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc110733-ad2f-447f-8c93-acb323f0aa04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:42:17.006256 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc110733-ad2f-447f-8c93-acb323f0aa04 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:17.006538 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc110733-ad2f-447f-8c93-acb323f0aa04 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:17.006808 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc110733-ad2f-447f-8c93-acb323f0aa04 None admin] PATH_INFO: `/v3/domains` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:17.007550 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc110733-ad2f-447f-8c93-acb323f0aa04 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:42:17.007858 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc110733-ad2f-447f-8c93-acb323f0aa04 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:42:17.009261 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc110733-ad2f-447f-8c93-acb323f0aa04 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:42:17.028465 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 313/615] 10.222.0.57 () {56 vars in 1109 bytes} [Fri Sep 16 07:42:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:42:17.034494 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9c4271-03b3-4268-a8bc-879a49375046 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:42:17.141200 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:42:17.168858 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9c4271-03b3-4268-a8bc-879a49375046 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:42:17.198668 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc110733-ad2f-447f-8c93-acb323f0aa04 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:42:17.213009 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e251945-a33c-44cb-9494-fbfbbe1d5d6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:42:17.213818 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e251945-a33c-44cb-9494-fbfbbe1d5d6e None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:17.214108 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e251945-a33c-44cb-9494-fbfbbe1d5d6e None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:17.214427 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e251945-a33c-44cb-9494-fbfbbe1d5d6e None admin] PATH_INFO: `/v3/users/nova` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:17.223459 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e251945-a33c-44cb-9494-fbfbbe1d5d6e None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:42:17.225068 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e251945-a33c-44cb-9494-fbfbbe1d5d6e None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:42:17.238425 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application [None req-6e251945-a33c-44cb-9494-fbfbbe1d5d6e None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 16 07:42:17.238425 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 07:42:17.238425 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 07:42:17.238425 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 07:42:17.238425 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 07:42:17.238425 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 07:42:17.238425 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 07:42:17.238425 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 07:42:17.238425 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 07:42:17.238425 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 07:42:17.238425 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 07:42:17.238425 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 07:42:17.238425 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 16 07:42:17.238425 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 16 07:42:17.238425 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 16 07:42:17.238425 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 16 07:42:17.239377 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 07:42:17.239377 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 07:42:17.239377 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 16 07:42:17.239377 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 07:42:17.239377 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 16 07:42:17.239377 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 07:42:17.239377 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 07:42:17.239377 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 07:42:17.239377 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 07:42:17.239377 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 07:42:17.239377 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 07:42:17.239377 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application with Lock( Sep 16 07:42:17.239377 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 07:42:17.239377 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._enter() Sep 16 07:42:17.239377 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 07:42:17.239377 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 07:42:17.239377 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 07:42:17.239377 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.creator() Sep 16 07:42:17.240337 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 07:42:17.240337 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application created_value = creator( Sep 16 07:42:17.240337 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 16 07:42:17.240337 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 16 07:42:17.240337 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 16 07:42:17.240337 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 16 07:42:17.240337 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 16 07:42:17.240337 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 16 07:42:17.240337 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 16 07:42:17.240337 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Sep 16 07:42:17.240337 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 303/616] 10.222.0.57 () {56 vars in 1093 bytes} [Fri Sep 16 07:42:17 2022] GET /identity/v3/users/nova => generated 82 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 07:42:17.245916 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e251945-a33c-44cb-9494-fbfbbe1d5d6e None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:42:17.337196 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:42:17.385800 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc110733-ad2f-447f-8c93-acb323f0aa04 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:42:17.430602 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e251945-a33c-44cb-9494-fbfbbe1d5d6e None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:42:17.445056 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c2a6af-c005-4d2a-aa3b-d829311ecf94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:42:17.446328 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c2a6af-c005-4d2a-aa3b-d829311ecf94 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:17.446740 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c2a6af-c005-4d2a-aa3b-d829311ecf94 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:17.447152 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c2a6af-c005-4d2a-aa3b-d829311ecf94 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:17.460957 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c2a6af-c005-4d2a-aa3b-d829311ecf94 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 07:42:17.467175 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application [None req-e3c2a6af-c005-4d2a-aa3b-d829311ecf94 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 16 07:42:17.467175 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 07:42:17.467175 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 07:42:17.467175 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 07:42:17.467175 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 07:42:17.467175 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 07:42:17.467175 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 07:42:17.467175 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 07:42:17.467175 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 07:42:17.467175 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 07:42:17.467175 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 07:42:17.467175 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 07:42:17.467175 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 07:42:17.467175 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 07:42:17.467175 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 07:42:17.467175 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 07:42:17.468129 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 07:42:17.468129 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 07:42:17.468129 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 07:42:17.468129 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 07:42:17.468129 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 07:42:17.468129 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 07:42:17.468129 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 07:42:17.468129 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 07:42:17.468129 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 07:42:17.468129 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 07:42:17.468129 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 07:42:17.468129 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application with Lock( Sep 16 07:42:17.468129 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 07:42:17.468129 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._enter() Sep 16 07:42:17.468129 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 07:42:17.468129 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 07:42:17.468967 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 07:42:17.468967 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.creator() Sep 16 07:42:17.468967 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 07:42:17.468967 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application created_value = creator( Sep 16 07:42:17.468967 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 07:42:17.468967 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 07:42:17.468967 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 07:42:17.468967 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 07:42:17.468967 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 07:42:17.468967 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 07:42:17.468967 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 16 07:42:17.468967 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Sep 16 07:42:17.468967 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 314/617] 10.222.0.57 () {56 vars in 1102 bytes} [Fri Sep 16 07:42:17 2022] GET /identity/v3/roles/service => generated 85 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 07:42:17.476211 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c2a6af-c005-4d2a-aa3b-d829311ecf94 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:42:17.530984 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c3af57-c465-4f50-aeb4-75dfc9f2b2dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:42:17.531940 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c3af57-c465-4f50-aeb4-75dfc9f2b2dd None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:17.532405 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c3af57-c465-4f50-aeb4-75dfc9f2b2dd None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:17.532868 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c3af57-c465-4f50-aeb4-75dfc9f2b2dd None admin] PATH_INFO: `/v3/users` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:17.533802 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c3af57-c465-4f50-aeb4-75dfc9f2b2dd None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:42:17.534286 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c3af57-c465-4f50-aeb4-75dfc9f2b2dd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:42:17.535885 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c3af57-c465-4f50-aeb4-75dfc9f2b2dd None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:42:17.560513 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:42:17.580415 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 304/618] 10.222.0.57 () {56 vars in 1133 bytes} [Fri Sep 16 07:42:17 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 335 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 07:42:17.585898 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c3af57-c465-4f50-aeb4-75dfc9f2b2dd None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:42:17.594123 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c2a6af-c005-4d2a-aa3b-d829311ecf94 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:42:17.633313 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4528abe2-1215-42bc-bd27-50441b2dec5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:42:17.634148 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4528abe2-1215-42bc-bd27-50441b2dec5e None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:17.634579 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4528abe2-1215-42bc-bd27-50441b2dec5e None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:17.634974 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4528abe2-1215-42bc-bd27-50441b2dec5e None admin] PATH_INFO: `/v3/roles` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:17.635828 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4528abe2-1215-42bc-bd27-50441b2dec5e None admin] RBAC: Adding query filter params (name=service) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:42:17.636247 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4528abe2-1215-42bc-bd27-50441b2dec5e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:42:17.638315 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4528abe2-1215-42bc-bd27-50441b2dec5e None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:42:17.647378 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 315/619] 10.222.0.57 () {56 vars in 1103 bytes} [Fri Sep 16 07:42:17 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 07:42:17.647670 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:42:17.653530 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4528abe2-1215-42bc-bd27-50441b2dec5e None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:42:17.774640 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4528abe2-1215-42bc-bd27-50441b2dec5e None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:42:17.816639 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fea4edc-f9b6-4098-b3fe-e34115c2ff0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:42:17.817463 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fea4edc-f9b6-4098-b3fe-e34115c2ff0a None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:17.817927 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fea4edc-f9b6-4098-b3fe-e34115c2ff0a None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:17.821744 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fea4edc-f9b6-4098-b3fe-e34115c2ff0a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:17.833093 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fea4edc-f9b6-4098-b3fe-e34115c2ff0a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:42:17.835140 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fea4edc-f9b6-4098-b3fe-e34115c2ff0a None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:42:17.854117 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c3af57-c465-4f50-aeb4-75dfc9f2b2dd None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:42:17.855080 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application [None req-0fea4edc-f9b6-4098-b3fe-e34115c2ff0a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 07:42:17.855080 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 07:42:17.855080 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 07:42:17.855080 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 07:42:17.855080 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 07:42:17.855080 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 07:42:17.855080 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 07:42:17.855080 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 07:42:17.855080 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 07:42:17.855080 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 07:42:17.855080 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 07:42:17.855080 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 07:42:17.855080 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 07:42:17.855080 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 07:42:17.855080 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 07:42:17.855080 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 07:42:17.856287 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 07:42:17.856287 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 07:42:17.856287 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 07:42:17.856287 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 07:42:17.856287 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 07:42:17.856287 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 07:42:17.856287 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 07:42:17.856287 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application with Lock( Sep 16 07:42:17.856287 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 07:42:17.856287 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._enter() Sep 16 07:42:17.856287 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 07:42:17.856287 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 07:42:17.856287 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 07:42:17.856287 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.creator() Sep 16 07:42:17.856287 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 07:42:17.856287 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application created_value = creator( Sep 16 07:42:17.856287 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 07:42:17.857496 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 07:42:17.857496 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 07:42:17.857496 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Sep 16 07:42:17.863474 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 316/620] 10.222.0.57 () {56 vars in 1108 bytes} [Fri Sep 16 07:42:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 16 07:42:17.869211 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fea4edc-f9b6-4098-b3fe-e34115c2ff0a None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:42:17.903642 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e97eb2-9232-4138-b2fc-afdab4b1f851 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:42:17.905677 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e97eb2-9232-4138-b2fc-afdab4b1f851 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:17.907373 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e97eb2-9232-4138-b2fc-afdab4b1f851 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:17.908658 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e97eb2-9232-4138-b2fc-afdab4b1f851 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:17.967962 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:42:17.998618 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:42:18.007891 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e97eb2-9232-4138-b2fc-afdab4b1f851 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:42:18.010176 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e97eb2-9232-4138-b2fc-afdab4b1f851 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:42:18.034020 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fea4edc-f9b6-4098-b3fe-e34115c2ff0a None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:42:18.078380 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420a1f3f-eece-4901-9e92-9976d89a9a2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:42:18.079258 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420a1f3f-eece-4901-9e92-9976d89a9a2f None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:18.079547 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420a1f3f-eece-4901-9e92-9976d89a9a2f None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:18.079823 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420a1f3f-eece-4901-9e92-9976d89a9a2f None admin] PATH_INFO: `/v3/domains` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:18.080470 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420a1f3f-eece-4901-9e92-9976d89a9a2f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:42:18.080776 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420a1f3f-eece-4901-9e92-9976d89a9a2f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:42:18.082740 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420a1f3f-eece-4901-9e92-9976d89a9a2f None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:42:18.105625 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 317/621] 10.222.0.57 () {56 vars in 1109 bytes} [Fri Sep 16 07:42:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:42:18.105625 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db282053-dc95-4538-9529-f9acbfd4c8d0 None None] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:18.105625 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db282053-dc95-4538-9529-f9acbfd4c8d0 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:18.105625 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db282053-dc95-4538-9529-f9acbfd4c8d0 None None] PATH_INFO: `/` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:18.105625 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 318/622] 10.222.0.57 () {54 vars in 927 bytes} [Fri Sep 16 07:42:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 07:42:18.107139 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db282053-dc95-4538-9529-f9acbfd4c8d0 None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:42:18.140277 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 305/623] 10.222.0.57 () {58 vars in 1282 bytes} [Fri Sep 16 07:42:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 555 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 16 07:42:18.141662 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d571fd65-f3b5-4426-83e1-9380f483aa99 None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:18.141986 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d571fd65-f3b5-4426-83e1-9380f483aa99 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:18.142261 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d571fd65-f3b5-4426-83e1-9380f483aa99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:18.161035 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-d571fd65-f3b5-4426-83e1-9380f483aa99 None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:42:18.162299 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-d571fd65-f3b5-4426-83e1-9380f483aa99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:42:18.234172 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 306/624] 10.222.0.57 () {58 vars in 1024 bytes} [Fri Sep 16 07:42:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 07:42:18.235026 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db282053-dc95-4538-9529-f9acbfd4c8d0 None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:42:18.235160 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d571fd65-f3b5-4426-83e1-9380f483aa99 None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:42:18.258325 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:42:18.265097 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:42:18.275834 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8336514a-39f3-4c3f-87cb-82c175ff4a47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:42:18.276846 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8336514a-39f3-4c3f-87cb-82c175ff4a47 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:18.277323 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8336514a-39f3-4c3f-87cb-82c175ff4a47 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:18.277939 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8336514a-39f3-4c3f-87cb-82c175ff4a47 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:18.285668 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8336514a-39f3-4c3f-87cb-82c175ff4a47 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:42:18.287436 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8336514a-39f3-4c3f-87cb-82c175ff4a47 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:42:18.301056 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application [None req-8336514a-39f3-4c3f-87cb-82c175ff4a47 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 16 07:42:18.301056 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 07:42:18.301056 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 07:42:18.301056 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 07:42:18.301056 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 07:42:18.301056 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 07:42:18.301056 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 07:42:18.301056 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 07:42:18.301056 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 07:42:18.301056 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 07:42:18.301056 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 07:42:18.301056 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 07:42:18.301056 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 16 07:42:18.301056 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 16 07:42:18.301056 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 16 07:42:18.301056 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 16 07:42:18.302086 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 07:42:18.302086 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 07:42:18.302086 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 16 07:42:18.302086 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 07:42:18.302086 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 16 07:42:18.302086 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 07:42:18.302086 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 07:42:18.302086 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 07:42:18.302086 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 07:42:18.302086 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 07:42:18.302086 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 07:42:18.302086 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application with Lock( Sep 16 07:42:18.302086 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 07:42:18.302086 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._enter() Sep 16 07:42:18.302086 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 07:42:18.302086 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 07:42:18.302086 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 07:42:18.302086 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.creator() Sep 16 07:42:18.303020 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 07:42:18.303020 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application created_value = creator( Sep 16 07:42:18.303020 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 16 07:42:18.303020 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 16 07:42:18.303020 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 16 07:42:18.303020 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 16 07:42:18.303020 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 16 07:42:18.303020 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 16 07:42:18.303020 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 16 07:42:18.303020 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Sep 16 07:42:18.305594 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 319/625] 10.222.0.57 () {56 vars in 1096 bytes} [Fri Sep 16 07:42:18 2022] GET /identity/v3/users/swift => generated 83 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 16 07:42:18.312041 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8336514a-39f3-4c3f-87cb-82c175ff4a47 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:42:18.411996 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d571fd65-f3b5-4426-83e1-9380f483aa99 None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:42:18.419682 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8336514a-39f3-4c3f-87cb-82c175ff4a47 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:42:18.462296 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702dda7e-faf0-4ce0-8bd1-4172355b9a30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:42:18.463532 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702dda7e-faf0-4ce0-8bd1-4172355b9a30 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:18.464121 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702dda7e-faf0-4ce0-8bd1-4172355b9a30 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:18.464781 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702dda7e-faf0-4ce0-8bd1-4172355b9a30 None admin] PATH_INFO: `/v3/users` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:18.466367 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702dda7e-faf0-4ce0-8bd1-4172355b9a30 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:42:18.466618 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d294a45-e061-46f9-ad28-f2e8f737df84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:42:18.467193 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702dda7e-faf0-4ce0-8bd1-4172355b9a30 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:42:18.467299 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d294a45-e061-46f9-ad28-f2e8f737df84 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:18.472349 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d294a45-e061-46f9-ad28-f2e8f737df84 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:18.472349 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d294a45-e061-46f9-ad28-f2e8f737df84 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:18.472586 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702dda7e-faf0-4ce0-8bd1-4172355b9a30 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:42:18.490565 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d294a45-e061-46f9-ad28-f2e8f737df84 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:42:18.492109 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d294a45-e061-46f9-ad28-f2e8f737df84 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:42:18.513618 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 320/626] 10.222.0.57 () {56 vars in 1135 bytes} [Fri Sep 16 07:42:18 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:42:18.519184 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702dda7e-faf0-4ce0-8bd1-4172355b9a30 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:42:18.529238 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application [None req-4d294a45-e061-46f9-ad28-f2e8f737df84 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 07:42:18.529238 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 07:42:18.529238 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 07:42:18.529238 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 07:42:18.529238 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 07:42:18.529238 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 07:42:18.529238 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 07:42:18.529238 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 07:42:18.529238 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 07:42:18.529238 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 07:42:18.529238 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 07:42:18.529238 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 07:42:18.529238 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 07:42:18.529238 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 07:42:18.529238 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 07:42:18.529238 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 07:42:18.530290 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 07:42:18.530290 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 07:42:18.530290 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 07:42:18.530290 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 07:42:18.530290 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 07:42:18.530290 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 07:42:18.530290 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 07:42:18.530290 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application with Lock( Sep 16 07:42:18.530290 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 07:42:18.530290 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._enter() Sep 16 07:42:18.530290 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 07:42:18.530290 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 07:42:18.530290 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 07:42:18.530290 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.creator() Sep 16 07:42:18.530290 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 07:42:18.530290 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application created_value = creator( Sep 16 07:42:18.530290 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 07:42:18.531185 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 07:42:18.531185 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 07:42:18.531185 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Sep 16 07:42:18.532603 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 307/627] 10.222.0.57 () {56 vars in 1108 bytes} [Fri Sep 16 07:42:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 298 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 07:42:18.533427 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d294a45-e061-46f9-ad28-f2e8f737df84 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:42:18.561894 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:42:18.629080 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:42:18.643166 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702dda7e-faf0-4ce0-8bd1-4172355b9a30 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:42:18.658365 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d294a45-e061-46f9-ad28-f2e8f737df84 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:42:18.680709 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf89ccb-1ce4-4b36-ab98-46c3865cca45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:42:18.681456 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf89ccb-1ce4-4b36-ab98-46c3865cca45 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:18.681762 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf89ccb-1ce4-4b36-ab98-46c3865cca45 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:18.682165 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf89ccb-1ce4-4b36-ab98-46c3865cca45 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:18.692966 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f84c27a-0681-42e1-ac22-c85095956360 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:42:18.693342 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf89ccb-1ce4-4b36-ab98-46c3865cca45 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:42:18.693587 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f84c27a-0681-42e1-ac22-c85095956360 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:18.693894 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f84c27a-0681-42e1-ac22-c85095956360 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:18.694216 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f84c27a-0681-42e1-ac22-c85095956360 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:18.694874 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf89ccb-1ce4-4b36-ab98-46c3865cca45 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:42:18.704738 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f84c27a-0681-42e1-ac22-c85095956360 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 07:42:18.709943 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application [None req-8f84c27a-0681-42e1-ac22-c85095956360 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 16 07:42:18.709943 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 07:42:18.709943 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 07:42:18.709943 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 07:42:18.709943 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 07:42:18.709943 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 07:42:18.709943 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 07:42:18.709943 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 07:42:18.709943 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 07:42:18.709943 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 07:42:18.709943 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 07:42:18.709943 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 07:42:18.709943 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 07:42:18.709943 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 07:42:18.709943 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 07:42:18.709943 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 07:42:18.710953 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 07:42:18.710953 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 07:42:18.710953 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 07:42:18.710953 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 07:42:18.710953 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 07:42:18.710953 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 07:42:18.710953 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 07:42:18.710953 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 07:42:18.710953 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 07:42:18.710953 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 07:42:18.710953 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 07:42:18.710953 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application with Lock( Sep 16 07:42:18.710953 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 07:42:18.710953 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._enter() Sep 16 07:42:18.710953 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 07:42:18.710953 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 07:42:18.711802 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 07:42:18.711802 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.creator() Sep 16 07:42:18.711802 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 07:42:18.711802 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application created_value = creator( Sep 16 07:42:18.711802 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 07:42:18.711802 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 07:42:18.711802 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 07:42:18.711802 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 07:42:18.711802 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 07:42:18.711802 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 07:42:18.711802 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 16 07:42:18.711802 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Sep 16 07:42:18.712456 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application [None req-bbf89ccb-1ce4-4b36-ab98-46c3865cca45 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 07:42:18.712456 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 07:42:18.712456 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 07:42:18.712456 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 07:42:18.712456 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 07:42:18.712456 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 07:42:18.712456 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 07:42:18.712456 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 07:42:18.712456 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 07:42:18.712456 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 07:42:18.712456 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 07:42:18.712456 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 07:42:18.712456 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 07:42:18.712456 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 07:42:18.712456 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 07:42:18.712456 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 07:42:18.718713 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 07:42:18.718713 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 07:42:18.718713 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 07:42:18.718713 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 07:42:18.718713 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 07:42:18.718713 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 07:42:18.718713 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 07:42:18.718713 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application with Lock( Sep 16 07:42:18.718713 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 07:42:18.718713 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._enter() Sep 16 07:42:18.718713 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 07:42:18.718713 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 07:42:18.718713 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 07:42:18.718713 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.creator() Sep 16 07:42:18.718713 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 07:42:18.718713 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application created_value = creator( Sep 16 07:42:18.718713 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 07:42:18.719636 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 07:42:18.719636 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 07:42:18.719636 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Sep 16 07:42:18.719636 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 321/628] 10.222.0.57 () {56 vars in 1108 bytes} [Fri Sep 16 07:42:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 16 07:42:18.719636 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf89ccb-1ce4-4b36-ab98-46c3865cca45 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:42:18.719930 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 308/629] 10.222.0.57 () {56 vars in 1102 bytes} [Fri Sep 16 07:42:18 2022] GET /identity/v3/roles/service => generated 85 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 07:42:18.719930 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816a6b58-5f39-4df2-a451-66618c37bfdc None None] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:18.719930 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816a6b58-5f39-4df2-a451-66618c37bfdc None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:18.719930 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816a6b58-5f39-4df2-a451-66618c37bfdc None None] PATH_INFO: `/` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:18.719930 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 309/630] 10.222.0.57 () {54 vars in 927 bytes} [Fri Sep 16 07:42:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 07:42:18.720623 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816a6b58-5f39-4df2-a451-66618c37bfdc None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:42:18.805673 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:42:18.825854 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf89ccb-1ce4-4b36-ab98-46c3865cca45 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:42:18.827819 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816a6b58-5f39-4df2-a451-66618c37bfdc None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:42:18.858483 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4572e5d-2458-4d5b-9e76-a10f771511c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:42:18.859084 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4572e5d-2458-4d5b-9e76-a10f771511c6 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:18.859362 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4572e5d-2458-4d5b-9e76-a10f771511c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:18.859630 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4572e5d-2458-4d5b-9e76-a10f771511c6 None admin] PATH_INFO: `/v3/domains` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:18.860262 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4572e5d-2458-4d5b-9e76-a10f771511c6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:42:18.860391 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e14aeaf-c3c1-48a4-aa95-2953fd43411e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:42:18.860828 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4572e5d-2458-4d5b-9e76-a10f771511c6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:42:18.860983 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e14aeaf-c3c1-48a4-aa95-2953fd43411e None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:18.861255 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e14aeaf-c3c1-48a4-aa95-2953fd43411e None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:18.861521 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e14aeaf-c3c1-48a4-aa95-2953fd43411e None admin] PATH_INFO: `/v3/roles` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:18.861942 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4572e5d-2458-4d5b-9e76-a10f771511c6 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:42:18.862203 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e14aeaf-c3c1-48a4-aa95-2953fd43411e None admin] RBAC: Adding query filter params (name=service) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:42:18.862502 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e14aeaf-c3c1-48a4-aa95-2953fd43411e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:42:18.863835 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e14aeaf-c3c1-48a4-aa95-2953fd43411e None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:42:18.868743 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:42:18.873517 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 310/631] 10.222.0.57 () {56 vars in 1103 bytes} [Fri Sep 16 07:42:18 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:42:18.874357 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e14aeaf-c3c1-48a4-aa95-2953fd43411e None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:42:18.874869 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 322/632] 10.222.0.57 () {56 vars in 1109 bytes} [Fri Sep 16 07:42:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:42:18.875959 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dc6b2d-16d3-4b7f-a973-5c6a212c6cf1 None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:18.876242 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dc6b2d-16d3-4b7f-a973-5c6a212c6cf1 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:18.876507 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dc6b2d-16d3-4b7f-a973-5c6a212c6cf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:18.894743 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-09dc6b2d-16d3-4b7f-a973-5c6a212c6cf1 None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:42:18.895944 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-09dc6b2d-16d3-4b7f-a973-5c6a212c6cf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:42:18.960721 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 323/633] 10.222.0.57 () {58 vars in 1024 bytes} [Fri Sep 16 07:42:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 07:42:18.962080 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31f95b3-51f5-44fe-b12a-ee69758e7e9c None None] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:18.962372 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31f95b3-51f5-44fe-b12a-ee69758e7e9c None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:18.962643 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31f95b3-51f5-44fe-b12a-ee69758e7e9c None None] PATH_INFO: `/` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:18.964159 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 324/634] 10.222.0.57 () {54 vars in 927 bytes} [Fri Sep 16 07:42:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 07:42:18.964860 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31f95b3-51f5-44fe-b12a-ee69758e7e9c None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:42:18.982030 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e14aeaf-c3c1-48a4-aa95-2953fd43411e None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:42:19.021343 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd50810b-b010-4ff2-91c7-9d688c01e21d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:42:19.022087 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd50810b-b010-4ff2-91c7-9d688c01e21d None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:19.022365 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd50810b-b010-4ff2-91c7-9d688c01e21d None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:19.022865 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd50810b-b010-4ff2-91c7-9d688c01e21d None admin] PATH_INFO: `/v3/domains` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:19.023384 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd50810b-b010-4ff2-91c7-9d688c01e21d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:42:19.023686 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd50810b-b010-4ff2-91c7-9d688c01e21d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:42:19.025153 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd50810b-b010-4ff2-91c7-9d688c01e21d None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:42:19.037174 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:42:19.043709 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 311/635] 10.222.0.57 () {56 vars in 1109 bytes} [Fri Sep 16 07:42:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:42:19.044355 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd50810b-b010-4ff2-91c7-9d688c01e21d None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:42:19.071372 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31f95b3-51f5-44fe-b12a-ee69758e7e9c None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:42:19.108779 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:42:19.114231 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b25eadc-a68a-4659-9595-392732d5ac48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:42:19.114860 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b25eadc-a68a-4659-9595-392732d5ac48 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:19.115134 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b25eadc-a68a-4659-9595-392732d5ac48 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:19.115401 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b25eadc-a68a-4659-9595-392732d5ac48 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:19.126351 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b25eadc-a68a-4659-9595-392732d5ac48 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:42:19.127780 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b25eadc-a68a-4659-9595-392732d5ac48 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:42:19.142955 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application [None req-7b25eadc-a68a-4659-9595-392732d5ac48 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 07:42:19.142955 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 07:42:19.142955 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 07:42:19.142955 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 07:42:19.142955 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 07:42:19.142955 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 07:42:19.142955 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 07:42:19.142955 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 07:42:19.142955 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 07:42:19.142955 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 07:42:19.142955 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 07:42:19.142955 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 07:42:19.142955 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 07:42:19.142955 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 07:42:19.142955 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 07:42:19.142955 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 07:42:19.143935 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 07:42:19.143935 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 07:42:19.143935 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 07:42:19.143935 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 07:42:19.143935 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 07:42:19.143935 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 07:42:19.143935 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 07:42:19.143935 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application with Lock( Sep 16 07:42:19.143935 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 07:42:19.143935 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._enter() Sep 16 07:42:19.143935 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 07:42:19.143935 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 07:42:19.143935 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 07:42:19.143935 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.creator() Sep 16 07:42:19.143935 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 07:42:19.143935 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application created_value = creator( Sep 16 07:42:19.143935 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 07:42:19.144859 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 07:42:19.144859 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 07:42:19.144859 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Sep 16 07:42:19.146040 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 325/636] 10.222.0.57 () {56 vars in 1108 bytes} [Fri Sep 16 07:42:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 07:42:19.147958 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e722b946-a7d8-4093-8080-290e2654add4 None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:19.148729 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e722b946-a7d8-4093-8080-290e2654add4 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:19.149014 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e722b946-a7d8-4093-8080-290e2654add4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:19.156299 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd50810b-b010-4ff2-91c7-9d688c01e21d None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:42:19.166958 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-e722b946-a7d8-4093-8080-290e2654add4 None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:42:19.168657 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-e722b946-a7d8-4093-8080-290e2654add4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:42:19.199377 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23ce95c-ef69-45cd-87e4-9bc102209fc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:42:19.200000 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23ce95c-ef69-45cd-87e4-9bc102209fc2 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:19.200281 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23ce95c-ef69-45cd-87e4-9bc102209fc2 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:19.200593 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23ce95c-ef69-45cd-87e4-9bc102209fc2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:19.207637 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23ce95c-ef69-45cd-87e4-9bc102209fc2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:42:19.209075 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23ce95c-ef69-45cd-87e4-9bc102209fc2 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:42:19.220186 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application [None req-d23ce95c-ef69-45cd-87e4-9bc102209fc2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 07:42:19.220186 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 07:42:19.220186 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 07:42:19.220186 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 07:42:19.220186 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 07:42:19.220186 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 07:42:19.220186 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 07:42:19.220186 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 07:42:19.220186 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 07:42:19.220186 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 07:42:19.220186 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 07:42:19.220186 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 07:42:19.220186 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 16 07:42:19.220186 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 16 07:42:19.220186 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 16 07:42:19.221127 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 16 07:42:19.221127 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 07:42:19.221127 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 07:42:19.221127 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 07:42:19.221127 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 07:42:19.221127 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 07:42:19.221127 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 07:42:19.221127 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 07:42:19.221127 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application with Lock( Sep 16 07:42:19.221127 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 07:42:19.221127 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._enter() Sep 16 07:42:19.221127 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 07:42:19.221127 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 07:42:19.221127 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 07:42:19.221127 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.creator() Sep 16 07:42:19.221127 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 07:42:19.221127 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application created_value = creator( Sep 16 07:42:19.222345 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 16 07:42:19.222345 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 16 07:42:19.222345 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 16 07:42:19.222345 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 16 07:42:19.222345 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 16 07:42:19.222345 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 16 07:42:19.222345 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 07:42:19.222345 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Sep 16 07:42:19.226166 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 312/637] 10.222.0.57 () {56 vars in 1111 bytes} [Fri Sep 16 07:42:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 07:42:19.226999 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23ce95c-ef69-45cd-87e4-9bc102209fc2 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:42:19.237320 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 326/638] 10.222.0.57 () {58 vars in 1024 bytes} [Fri Sep 16 07:42:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 07:42:19.238179 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e722b946-a7d8-4093-8080-290e2654add4 None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:42:19.301145 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:42:19.334581 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23ce95c-ef69-45cd-87e4-9bc102209fc2 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:42:19.347850 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e722b946-a7d8-4093-8080-290e2654add4 None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:42:19.356494 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:42:19.372548 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09552c29-0aba-4c02-b059-7c52472febf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:42:19.373284 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09552c29-0aba-4c02-b059-7c52472febf8 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:19.373565 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09552c29-0aba-4c02-b059-7c52472febf8 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:19.373885 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09552c29-0aba-4c02-b059-7c52472febf8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:19.380714 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09552c29-0aba-4c02-b059-7c52472febf8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:42:19.382504 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09552c29-0aba-4c02-b059-7c52472febf8 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:42:19.383937 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9a7fa4-5e5f-4f1d-9f4b-ac7e184fd643 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:42:19.384538 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9a7fa4-5e5f-4f1d-9f4b-ac7e184fd643 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:19.384811 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9a7fa4-5e5f-4f1d-9f4b-ac7e184fd643 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:19.385078 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9a7fa4-5e5f-4f1d-9f4b-ac7e184fd643 None admin] PATH_INFO: `/v3/domains` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:19.385707 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9a7fa4-5e5f-4f1d-9f4b-ac7e184fd643 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:42:19.386028 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9a7fa4-5e5f-4f1d-9f4b-ac7e184fd643 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:42:19.387419 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9a7fa4-5e5f-4f1d-9f4b-ac7e184fd643 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:42:19.394176 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application [None req-09552c29-0aba-4c02-b059-7c52472febf8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 07:42:19.394176 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 07:42:19.394176 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 07:42:19.394176 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 07:42:19.394176 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 07:42:19.394176 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 07:42:19.394176 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 07:42:19.394176 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 07:42:19.394176 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 07:42:19.394176 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 07:42:19.394176 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 07:42:19.394176 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 07:42:19.394176 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 16 07:42:19.394176 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 16 07:42:19.394176 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 16 07:42:19.395083 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 16 07:42:19.395083 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 07:42:19.395083 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 07:42:19.395083 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 07:42:19.395083 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 07:42:19.395083 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 07:42:19.395083 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 07:42:19.395083 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 07:42:19.395083 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application with Lock( Sep 16 07:42:19.395083 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 07:42:19.395083 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._enter() Sep 16 07:42:19.395083 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 07:42:19.395083 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 07:42:19.395083 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 07:42:19.395083 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.creator() Sep 16 07:42:19.395083 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 07:42:19.395083 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application created_value = creator( Sep 16 07:42:19.395986 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 16 07:42:19.395986 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 16 07:42:19.395986 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 16 07:42:19.395986 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 16 07:42:19.395986 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 16 07:42:19.395986 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 16 07:42:19.395986 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 07:42:19.395986 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Sep 16 07:42:19.395986 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 313/639] 10.222.0.57 () {56 vars in 1111 bytes} [Fri Sep 16 07:42:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 07:42:19.395986 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09552c29-0aba-4c02-b059-7c52472febf8 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:42:19.409765 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 327/640] 10.222.0.57 () {56 vars in 1109 bytes} [Fri Sep 16 07:42:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:42:19.409765 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9a7fa4-5e5f-4f1d-9f4b-ac7e184fd643 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:42:19.505685 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09552c29-0aba-4c02-b059-7c52472febf8 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:42:19.510157 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9a7fa4-5e5f-4f1d-9f4b-ac7e184fd643 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:42:19.523555 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:42:19.539361 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522e7e38-3e4d-410f-90c7-216d0e39372d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:42:19.539955 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522e7e38-3e4d-410f-90c7-216d0e39372d None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:19.540227 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522e7e38-3e4d-410f-90c7-216d0e39372d None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:19.540494 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522e7e38-3e4d-410f-90c7-216d0e39372d None admin] PATH_INFO: `/v3/projects` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:19.541169 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522e7e38-3e4d-410f-90c7-216d0e39372d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:42:19.541468 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522e7e38-3e4d-410f-90c7-216d0e39372d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:42:19.542927 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522e7e38-3e4d-410f-90c7-216d0e39372d None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:42:19.544515 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7eadbe7-7126-4299-80bc-f50aeae6bf15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:42:19.545141 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7eadbe7-7126-4299-80bc-f50aeae6bf15 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:19.545419 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7eadbe7-7126-4299-80bc-f50aeae6bf15 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:19.545689 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7eadbe7-7126-4299-80bc-f50aeae6bf15 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:19.555077 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 314/641] 10.222.0.57 () {56 vars in 1148 bytes} [Fri Sep 16 07:42:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:42:19.555861 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7eadbe7-7126-4299-80bc-f50aeae6bf15 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 07:42:19.555996 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522e7e38-3e4d-410f-90c7-216d0e39372d None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:42:19.561513 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application [None req-c7eadbe7-7126-4299-80bc-f50aeae6bf15 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 16 07:42:19.561513 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 07:42:19.561513 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 07:42:19.561513 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 07:42:19.561513 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 07:42:19.561513 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 07:42:19.561513 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 07:42:19.561513 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 07:42:19.561513 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 07:42:19.561513 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 07:42:19.561513 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 07:42:19.561513 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 07:42:19.561513 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 07:42:19.561513 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 07:42:19.561513 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 07:42:19.561513 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 07:42:19.562764 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 07:42:19.562764 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 07:42:19.562764 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 07:42:19.562764 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 07:42:19.562764 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 07:42:19.562764 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 07:42:19.562764 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 07:42:19.562764 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 07:42:19.562764 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 07:42:19.562764 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 07:42:19.562764 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 07:42:19.562764 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application with Lock( Sep 16 07:42:19.562764 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 07:42:19.562764 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._enter() Sep 16 07:42:19.562764 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 07:42:19.562764 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 07:42:19.563816 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 07:42:19.563816 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.creator() Sep 16 07:42:19.563816 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 07:42:19.563816 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application created_value = creator( Sep 16 07:42:19.563816 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 07:42:19.563816 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 07:42:19.563816 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 07:42:19.563816 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 07:42:19.563816 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 07:42:19.563816 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 07:42:19.563816 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 16 07:42:19.563816 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Sep 16 07:42:19.565854 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 328/642] 10.222.0.57 () {56 vars in 1102 bytes} [Fri Sep 16 07:42:19 2022] GET /identity/v3/roles/service => generated 85 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 07:42:19.566815 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7eadbe7-7126-4299-80bc-f50aeae6bf15 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:42:19.598584 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:42:19.655256 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522e7e38-3e4d-410f-90c7-216d0e39372d None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:42:19.667348 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7eadbe7-7126-4299-80bc-f50aeae6bf15 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:42:19.688341 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abacf6ba-6aa5-4898-a99b-ad52d9d78567 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:42:19.688942 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abacf6ba-6aa5-4898-a99b-ad52d9d78567 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:19.689228 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abacf6ba-6aa5-4898-a99b-ad52d9d78567 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:19.689499 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abacf6ba-6aa5-4898-a99b-ad52d9d78567 None admin] PATH_INFO: `/v3/projects` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:19.690222 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abacf6ba-6aa5-4898-a99b-ad52d9d78567 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:42:19.690528 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abacf6ba-6aa5-4898-a99b-ad52d9d78567 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:42:19.691978 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abacf6ba-6aa5-4898-a99b-ad52d9d78567 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:42:19.700562 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d846de2e-2f03-45f2-b979-6622307e709a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:42:19.701211 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d846de2e-2f03-45f2-b979-6622307e709a None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:19.701532 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d846de2e-2f03-45f2-b979-6622307e709a None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:19.701934 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d846de2e-2f03-45f2-b979-6622307e709a None admin] PATH_INFO: `/v3/users/glance` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:19.703849 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 315/643] 10.222.0.57 () {56 vars in 1148 bytes} [Fri Sep 16 07:42:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:42:19.704642 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abacf6ba-6aa5-4898-a99b-ad52d9d78567 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:42:19.713956 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d846de2e-2f03-45f2-b979-6622307e709a None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:42:19.716091 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d846de2e-2f03-45f2-b979-6622307e709a None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:42:19.727712 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application [None req-d846de2e-2f03-45f2-b979-6622307e709a None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 16 07:42:19.727712 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 07:42:19.727712 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 07:42:19.727712 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 07:42:19.727712 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 07:42:19.727712 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 07:42:19.727712 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 07:42:19.727712 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 07:42:19.727712 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 07:42:19.727712 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 07:42:19.727712 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 07:42:19.727712 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 07:42:19.727712 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 16 07:42:19.727712 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 16 07:42:19.727712 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 16 07:42:19.727712 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 16 07:42:19.728814 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 07:42:19.728814 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 07:42:19.728814 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 16 07:42:19.728814 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 07:42:19.728814 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 16 07:42:19.728814 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 07:42:19.728814 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 07:42:19.728814 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 07:42:19.728814 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 07:42:19.728814 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 07:42:19.728814 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 07:42:19.728814 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application with Lock( Sep 16 07:42:19.728814 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 07:42:19.728814 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._enter() Sep 16 07:42:19.728814 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 07:42:19.728814 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 07:42:19.728814 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 07:42:19.728814 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.creator() Sep 16 07:42:19.729868 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 07:42:19.729868 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application created_value = creator( Sep 16 07:42:19.729868 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 16 07:42:19.729868 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 16 07:42:19.729868 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 16 07:42:19.729868 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 16 07:42:19.729868 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 16 07:42:19.729868 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 16 07:42:19.729868 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 16 07:42:19.729868 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Sep 16 07:42:19.729868 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 329/644] 10.222.0.57 () {56 vars in 1099 bytes} [Fri Sep 16 07:42:19 2022] GET /identity/v3/users/glance => generated 84 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 07:42:19.729868 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d846de2e-2f03-45f2-b979-6622307e709a None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:42:19.766719 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:42:19.804770 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:42:19.808184 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abacf6ba-6aa5-4898-a99b-ad52d9d78567 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:42:19.832268 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d846de2e-2f03-45f2-b979-6622307e709a None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:42:19.842801 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6acce3-92fe-45f2-8ca1-73890d494337 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:42:19.843479 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6acce3-92fe-45f2-8ca1-73890d494337 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:19.843760 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6acce3-92fe-45f2-8ca1-73890d494337 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:19.844028 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6acce3-92fe-45f2-8ca1-73890d494337 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:19.853791 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6acce3-92fe-45f2-8ca1-73890d494337 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 07:42:19.859979 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application [None req-fd6acce3-92fe-45f2-8ca1-73890d494337 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 16 07:42:19.859979 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 07:42:19.859979 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 07:42:19.859979 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 07:42:19.859979 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 07:42:19.859979 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 07:42:19.859979 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 07:42:19.859979 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 07:42:19.859979 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 07:42:19.859979 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 07:42:19.859979 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 07:42:19.859979 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 07:42:19.859979 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 07:42:19.859979 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 07:42:19.859979 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 07:42:19.859979 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 07:42:19.861392 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 07:42:19.861392 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 07:42:19.861392 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 07:42:19.861392 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 07:42:19.861392 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 07:42:19.861392 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 07:42:19.861392 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 07:42:19.861392 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 07:42:19.861392 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 07:42:19.861392 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 07:42:19.861392 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 07:42:19.861392 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application with Lock( Sep 16 07:42:19.861392 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 07:42:19.861392 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._enter() Sep 16 07:42:19.861392 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 07:42:19.861392 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 07:42:19.862268 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 07:42:19.862268 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.creator() Sep 16 07:42:19.862268 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 07:42:19.862268 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application created_value = creator( Sep 16 07:42:19.862268 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 07:42:19.862268 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 07:42:19.862268 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 07:42:19.862268 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 07:42:19.862268 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 07:42:19.862268 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 07:42:19.862268 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 16 07:42:19.862268 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Sep 16 07:42:19.862268 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 316/645] 10.222.0.57 () {56 vars in 1102 bytes} [Fri Sep 16 07:42:19 2022] GET /identity/v3/roles/service => generated 85 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 07:42:19.862268 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6acce3-92fe-45f2-8ca1-73890d494337 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:42:19.867537 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d10557a-28ed-4298-a8ac-ae4c9fb9879f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:42:19.868143 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d10557a-28ed-4298-a8ac-ae4c9fb9879f None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:19.868425 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d10557a-28ed-4298-a8ac-ae4c9fb9879f None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:19.868696 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d10557a-28ed-4298-a8ac-ae4c9fb9879f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:19.869419 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d10557a-28ed-4298-a8ac-ae4c9fb9879f None admin] RBAC: Adding query filter params (role.id=f59220af7e7f4a8dbc30ba6325c7827c, scope.project.id=4735f453c0c24cc4a1c14e9ac84a0b46, user.id=9bec4d9b08514461a1bf63c6b88f53b2) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:42:19.869747 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d10557a-28ed-4298-a8ac-ae4c9fb9879f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:42:19.871219 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d10557a-28ed-4298-a8ac-ae4c9fb9879f None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:42:19.877415 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 330/646] 10.222.0.57 () {56 vars in 1374 bytes} [Fri Sep 16 07:42:19 2022] GET /identity/v3/role_assignments?user.id=9bec4d9b08514461a1bf63c6b88f53b2&scope.project.id=4735f453c0c24cc4a1c14e9ac84a0b46&role.id=f59220af7e7f4a8dbc30ba6325c7827c => generated 608 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:42:19.878194 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d10557a-28ed-4298-a8ac-ae4c9fb9879f None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:42:19.976724 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6acce3-92fe-45f2-8ca1-73890d494337 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:42:19.988429 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:42:19.992495 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d10557a-28ed-4298-a8ac-ae4c9fb9879f None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:42:20.020203 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74424ec-2bce-4ff8-b704-c57affd8b17b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:42:20.020823 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74424ec-2bce-4ff8-b704-c57affd8b17b None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:20.021098 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74424ec-2bce-4ff8-b704-c57affd8b17b None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:20.021367 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74424ec-2bce-4ff8-b704-c57affd8b17b None admin] PATH_INFO: `/v3/roles` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:20.022080 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74424ec-2bce-4ff8-b704-c57affd8b17b None admin] RBAC: Adding query filter params (name=service) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:42:20.022381 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74424ec-2bce-4ff8-b704-c57affd8b17b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:42:20.023788 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74424ec-2bce-4ff8-b704-c57affd8b17b None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:42:20.032667 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a57425-ac26-4ffc-af2a-9e7935b1bfc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:42:20.038200 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a57425-ac26-4ffc-af2a-9e7935b1bfc4 None admin] REQUEST_METHOD: `PUT` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:20.038378 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 317/647] 10.222.0.57 () {56 vars in 1103 bytes} [Fri Sep 16 07:42:19 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:42:20.038489 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a57425-ac26-4ffc-af2a-9e7935b1bfc4 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:20.038489 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a57425-ac26-4ffc-af2a-9e7935b1bfc4 None admin] PATH_INFO: `/v3/projects/4735f453c0c24cc4a1c14e9ac84a0b46/users/38abb0283b41449d8183b88912f2574a/roles/f59220af7e7f4a8dbc30ba6325c7827c` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:20.038646 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74424ec-2bce-4ff8-b704-c57affd8b17b None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:42:20.055200 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a57425-ac26-4ffc-af2a-9e7935b1bfc4 None admin] RBAC: Authorizing `identity:create_grant(project_id=4735f453c0c24cc4a1c14e9ac84a0b46, user_id=38abb0283b41449d8183b88912f2574a, role_id=f59220af7e7f4a8dbc30ba6325c7827c)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:42:20.056732 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a57425-ac26-4ffc-af2a-9e7935b1bfc4 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:42:20.067982 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:42:20.073840 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 331/648] 10.222.0.57 () {58 vars in 1439 bytes} [Fri Sep 16 07:42:19 2022] PUT /identity/v3/projects/4735f453c0c24cc4a1c14e9ac84a0b46/users/38abb0283b41449d8183b88912f2574a/roles/f59220af7e7f4a8dbc30ba6325c7827c => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 07:42:20.076561 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a57425-ac26-4ffc-af2a-9e7935b1bfc4 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:42:20.179330 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74424ec-2bce-4ff8-b704-c57affd8b17b None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:42:20.218409 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26cf5d0-8a6c-47b2-973a-112be7518c4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:42:20.219030 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26cf5d0-8a6c-47b2-973a-112be7518c4f None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:20.219307 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26cf5d0-8a6c-47b2-973a-112be7518c4f None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:20.219578 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26cf5d0-8a6c-47b2-973a-112be7518c4f None admin] PATH_INFO: `/v3/users` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:20.220437 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26cf5d0-8a6c-47b2-973a-112be7518c4f None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:42:20.220749 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26cf5d0-8a6c-47b2-973a-112be7518c4f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:42:20.222376 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26cf5d0-8a6c-47b2-973a-112be7518c4f None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:42:20.225164 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a57425-ac26-4ffc-af2a-9e7935b1bfc4 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:42:20.247775 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 318/649] 10.222.0.57 () {56 vars in 1137 bytes} [Fri Sep 16 07:42:20 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:42:20.248540 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26cf5d0-8a6c-47b2-973a-112be7518c4f None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:42:20.265519 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2d34cf-ca62-4db9-ae44-cdb166b27371 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:42:20.266267 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2d34cf-ca62-4db9-ae44-cdb166b27371 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:20.266547 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2d34cf-ca62-4db9-ae44-cdb166b27371 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:20.266925 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2d34cf-ca62-4db9-ae44-cdb166b27371 None admin] PATH_INFO: `/v3/roles` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:20.267610 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2d34cf-ca62-4db9-ae44-cdb166b27371 None admin] RBAC: Adding query filter params (name=service) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:42:20.267914 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2d34cf-ca62-4db9-ae44-cdb166b27371 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:42:20.269387 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2d34cf-ca62-4db9-ae44-cdb166b27371 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:42:20.279369 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 332/650] 10.222.0.57 () {56 vars in 1103 bytes} [Fri Sep 16 07:42:20 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:42:20.280430 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2d34cf-ca62-4db9-ae44-cdb166b27371 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:42:20.297447 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:42:20.340427 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:42:20.360779 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26cf5d0-8a6c-47b2-973a-112be7518c4f None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:42:20.397294 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47d1bfb-2a88-4d3a-8738-edd53de3c3fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:42:20.397958 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47d1bfb-2a88-4d3a-8738-edd53de3c3fe None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:20.398241 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47d1bfb-2a88-4d3a-8738-edd53de3c3fe None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:20.398509 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47d1bfb-2a88-4d3a-8738-edd53de3c3fe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:20.399704 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2d34cf-ca62-4db9-ae44-cdb166b27371 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:42:20.409269 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47d1bfb-2a88-4d3a-8738-edd53de3c3fe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:42:20.410827 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47d1bfb-2a88-4d3a-8738-edd53de3c3fe None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:42:20.426040 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application [None req-d47d1bfb-2a88-4d3a-8738-edd53de3c3fe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 07:42:20.426040 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 07:42:20.426040 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 07:42:20.426040 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 07:42:20.426040 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 07:42:20.426040 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 07:42:20.426040 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 07:42:20.426040 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 07:42:20.426040 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 07:42:20.426040 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 07:42:20.426040 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 07:42:20.426040 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 07:42:20.426040 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 07:42:20.426040 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 07:42:20.426040 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 07:42:20.426040 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 07:42:20.427022 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 07:42:20.427022 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 07:42:20.427022 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 07:42:20.427022 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 07:42:20.427022 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 07:42:20.427022 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 07:42:20.427022 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 07:42:20.427022 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application with Lock( Sep 16 07:42:20.427022 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 07:42:20.427022 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._enter() Sep 16 07:42:20.427022 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 07:42:20.427022 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 07:42:20.427022 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 07:42:20.427022 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.creator() Sep 16 07:42:20.427022 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 07:42:20.427022 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application created_value = creator( Sep 16 07:42:20.427022 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 07:42:20.427910 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 07:42:20.427910 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 07:42:20.427910 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Sep 16 07:42:20.427910 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 319/651] 10.222.0.57 () {56 vars in 1108 bytes} [Fri Sep 16 07:42:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 07:42:20.428549 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47d1bfb-2a88-4d3a-8738-edd53de3c3fe None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:42:20.441242 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b89bee2-c557-4dcb-8d4e-6be00e7b928e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:42:20.442018 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b89bee2-c557-4dcb-8d4e-6be00e7b928e None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:20.442304 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b89bee2-c557-4dcb-8d4e-6be00e7b928e None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:20.442577 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b89bee2-c557-4dcb-8d4e-6be00e7b928e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:20.522225 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b89bee2-c557-4dcb-8d4e-6be00e7b928e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:42:20.523704 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b89bee2-c557-4dcb-8d4e-6be00e7b928e None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:42:20.536317 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:42:20.538454 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47d1bfb-2a88-4d3a-8738-edd53de3c3fe None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:42:20.579921 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:42:20.587962 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec937023-abcd-4b85-8cad-eb958acaaef4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:42:20.588713 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec937023-abcd-4b85-8cad-eb958acaaef4 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:20.588994 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec937023-abcd-4b85-8cad-eb958acaaef4 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:20.589291 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec937023-abcd-4b85-8cad-eb958acaaef4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:20.602158 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec937023-abcd-4b85-8cad-eb958acaaef4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:42:20.604071 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec937023-abcd-4b85-8cad-eb958acaaef4 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:42:20.628228 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application [None req-ec937023-abcd-4b85-8cad-eb958acaaef4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 07:42:20.628228 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 07:42:20.628228 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 07:42:20.628228 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 07:42:20.628228 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 07:42:20.628228 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 07:42:20.628228 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 07:42:20.628228 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 07:42:20.628228 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 07:42:20.628228 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 07:42:20.628228 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 07:42:20.628228 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 07:42:20.628228 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 07:42:20.628228 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 07:42:20.628228 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 07:42:20.628228 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 07:42:20.629246 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 07:42:20.629246 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 07:42:20.629246 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 07:42:20.629246 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 07:42:20.629246 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 07:42:20.629246 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 07:42:20.629246 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 07:42:20.629246 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application with Lock( Sep 16 07:42:20.629246 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 07:42:20.629246 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._enter() Sep 16 07:42:20.629246 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 07:42:20.629246 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 07:42:20.629246 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 07:42:20.629246 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.creator() Sep 16 07:42:20.629246 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 07:42:20.629246 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application created_value = creator( Sep 16 07:42:20.629246 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 07:42:20.630178 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 07:42:20.630178 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 07:42:20.630178 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Sep 16 07:42:20.634232 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 320/652] 10.222.0.57 () {56 vars in 1108 bytes} [Fri Sep 16 07:42:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 07:42:20.635096 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec937023-abcd-4b85-8cad-eb958acaaef4 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:42:20.651617 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 333/653] 10.222.0.57 () {58 vars in 1282 bytes} [Fri Sep 16 07:42:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 16 07:42:20.652664 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b89bee2-c557-4dcb-8d4e-6be00e7b928e None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:42:20.744044 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec937023-abcd-4b85-8cad-eb958acaaef4 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:42:20.768508 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b89bee2-c557-4dcb-8d4e-6be00e7b928e None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:42:20.781180 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:42:20.781415 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173fe654-45b7-45e7-b111-fbe92f3cdcda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:42:20.782470 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173fe654-45b7-45e7-b111-fbe92f3cdcda None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:20.782727 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173fe654-45b7-45e7-b111-fbe92f3cdcda None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:20.783005 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173fe654-45b7-45e7-b111-fbe92f3cdcda None admin] PATH_INFO: `/v3/domains` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:20.783863 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173fe654-45b7-45e7-b111-fbe92f3cdcda None admin] RBAC: Adding query filter params (name=Default) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:42:20.784171 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173fe654-45b7-45e7-b111-fbe92f3cdcda None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:42:20.785911 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173fe654-45b7-45e7-b111-fbe92f3cdcda None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:42:20.803794 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 321/654] 10.222.0.57 () {56 vars in 1109 bytes} [Fri Sep 16 07:42:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:42:20.804753 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173fe654-45b7-45e7-b111-fbe92f3cdcda None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:42:20.808285 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b93646a-a36b-49c8-a21b-0cb441fac6b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:42:20.809520 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b93646a-a36b-49c8-a21b-0cb441fac6b5 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:20.809829 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b93646a-a36b-49c8-a21b-0cb441fac6b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:20.810099 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b93646a-a36b-49c8-a21b-0cb441fac6b5 None admin] PATH_INFO: `/v3/domains` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:20.810848 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b93646a-a36b-49c8-a21b-0cb441fac6b5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:42:20.811146 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b93646a-a36b-49c8-a21b-0cb441fac6b5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:42:20.812512 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b93646a-a36b-49c8-a21b-0cb441fac6b5 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:42:20.825470 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 334/655] 10.222.0.57 () {56 vars in 1109 bytes} [Fri Sep 16 07:42:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:42:20.830811 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b93646a-a36b-49c8-a21b-0cb441fac6b5 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:42:20.853754 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:42:20.911896 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173fe654-45b7-45e7-b111-fbe92f3cdcda None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:42:20.945791 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b93646a-a36b-49c8-a21b-0cb441fac6b5 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:42:20.948176 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdd1791-0bb9-4338-ba23-65e194d75410 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:42:20.948891 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdd1791-0bb9-4338-ba23-65e194d75410 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:20.949304 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdd1791-0bb9-4338-ba23-65e194d75410 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:20.949584 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdd1791-0bb9-4338-ba23-65e194d75410 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:20.970259 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdd1791-0bb9-4338-ba23-65e194d75410 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:42:20.971987 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdd1791-0bb9-4338-ba23-65e194d75410 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:42:20.987552 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0b802a-3ba9-42c3-a997-4fc746320757 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:42:20.988445 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0b802a-3ba9-42c3-a997-4fc746320757 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:20.988870 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0b802a-3ba9-42c3-a997-4fc746320757 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:20.989296 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application [None req-bbdd1791-0bb9-4338-ba23-65e194d75410 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 07:42:20.989296 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 07:42:20.989296 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 07:42:20.989296 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 07:42:20.989296 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 07:42:20.989296 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 07:42:20.989296 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 07:42:20.989296 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 07:42:20.989296 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 07:42:20.989296 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 07:42:20.989296 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 07:42:20.989296 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 07:42:20.989296 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 07:42:20.989296 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 07:42:20.989296 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 07:42:20.989296 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 07:42:20.994869 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 07:42:20.994869 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 07:42:20.994869 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 07:42:20.994869 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 07:42:20.994869 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 07:42:20.994869 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 07:42:20.994869 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 07:42:20.994869 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application with Lock( Sep 16 07:42:20.994869 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 07:42:20.994869 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._enter() Sep 16 07:42:20.994869 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 07:42:20.994869 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 07:42:20.994869 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 07:42:20.994869 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.creator() Sep 16 07:42:20.994869 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 07:42:20.994869 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application created_value = creator( Sep 16 07:42:20.994869 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 07:42:20.995823 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 07:42:20.995823 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 07:42:20.995823 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Sep 16 07:42:20.996041 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0b802a-3ba9-42c3-a997-4fc746320757 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:20.996123 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 322/656] 10.222.0.57 () {56 vars in 1108 bytes} [Fri Sep 16 07:42:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 07:42:20.996123 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdd1791-0bb9-4338-ba23-65e194d75410 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:42:21.011617 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0b802a-3ba9-42c3-a997-4fc746320757 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:42:21.013569 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0b802a-3ba9-42c3-a997-4fc746320757 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:42:21.026792 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application [None req-dd0b802a-3ba9-42c3-a997-4fc746320757 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 16 07:42:21.026792 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 07:42:21.026792 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 07:42:21.026792 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 07:42:21.026792 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 07:42:21.026792 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 07:42:21.026792 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 07:42:21.026792 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 07:42:21.026792 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 07:42:21.026792 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 07:42:21.026792 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 07:42:21.026792 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 07:42:21.026792 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 16 07:42:21.026792 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 16 07:42:21.026792 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 16 07:42:21.026792 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 16 07:42:21.028389 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 07:42:21.028389 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 07:42:21.028389 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 16 07:42:21.028389 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 07:42:21.028389 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 16 07:42:21.028389 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 07:42:21.028389 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 07:42:21.028389 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 07:42:21.028389 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 07:42:21.028389 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 07:42:21.028389 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 07:42:21.028389 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application with Lock( Sep 16 07:42:21.028389 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 07:42:21.028389 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._enter() Sep 16 07:42:21.028389 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 07:42:21.028389 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 07:42:21.028389 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 07:42:21.028389 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.creator() Sep 16 07:42:21.029484 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 07:42:21.029484 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application created_value = creator( Sep 16 07:42:21.029484 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 16 07:42:21.029484 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 16 07:42:21.029484 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 16 07:42:21.029484 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 16 07:42:21.029484 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 16 07:42:21.029484 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 16 07:42:21.029484 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 16 07:42:21.029484 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Sep 16 07:42:21.032242 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 335/657] 10.222.0.57 () {56 vars in 1102 bytes} [Fri Sep 16 07:42:20 2022] GET /identity/v3/users/neutron => generated 85 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 07:42:21.033552 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0b802a-3ba9-42c3-a997-4fc746320757 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:42:21.079676 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:42:21.132891 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:42:21.142048 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdd1791-0bb9-4338-ba23-65e194d75410 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:42:21.177336 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f969d3-af9a-4150-a6bb-4a96f99f6f66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:42:21.178050 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f969d3-af9a-4150-a6bb-4a96f99f6f66 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:21.178328 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f969d3-af9a-4150-a6bb-4a96f99f6f66 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:21.178609 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f969d3-af9a-4150-a6bb-4a96f99f6f66 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:21.187587 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f969d3-af9a-4150-a6bb-4a96f99f6f66 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:42:21.189033 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f969d3-af9a-4150-a6bb-4a96f99f6f66 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:42:21.190314 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0b802a-3ba9-42c3-a997-4fc746320757 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:42:21.201556 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application [None req-32f969d3-af9a-4150-a6bb-4a96f99f6f66 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 16 07:42:21.201556 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 07:42:21.201556 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 07:42:21.201556 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 07:42:21.201556 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 07:42:21.201556 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 07:42:21.201556 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 07:42:21.201556 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 07:42:21.201556 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 07:42:21.201556 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 07:42:21.201556 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 07:42:21.201556 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 07:42:21.201556 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 16 07:42:21.201556 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 16 07:42:21.201556 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 16 07:42:21.201556 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 16 07:42:21.202535 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 07:42:21.202535 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 07:42:21.202535 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 16 07:42:21.202535 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 07:42:21.202535 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 16 07:42:21.202535 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 07:42:21.202535 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 07:42:21.202535 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 07:42:21.202535 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 07:42:21.202535 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 07:42:21.202535 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 07:42:21.202535 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application with Lock( Sep 16 07:42:21.202535 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 07:42:21.202535 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._enter() Sep 16 07:42:21.202535 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 07:42:21.202535 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 07:42:21.202535 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 07:42:21.202535 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.creator() Sep 16 07:42:21.203509 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 07:42:21.203509 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application created_value = creator( Sep 16 07:42:21.203509 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 16 07:42:21.203509 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 16 07:42:21.203509 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 16 07:42:21.203509 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 16 07:42:21.203509 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 16 07:42:21.203509 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 16 07:42:21.203509 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 16 07:42:21.203509 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Sep 16 07:42:21.206142 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 323/658] 10.222.0.57 () {56 vars in 1099 bytes} [Fri Sep 16 07:42:20 2022] GET /identity/v3/users/cinder => generated 84 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 07:42:21.206998 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f969d3-af9a-4150-a6bb-4a96f99f6f66 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:42:21.236889 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68d65d6-21f1-45d2-8595-c3036fa09365 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:42:21.238026 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68d65d6-21f1-45d2-8595-c3036fa09365 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:21.238826 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68d65d6-21f1-45d2-8595-c3036fa09365 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:21.239608 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68d65d6-21f1-45d2-8595-c3036fa09365 None admin] PATH_INFO: `/v3/domains` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:21.240600 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68d65d6-21f1-45d2-8595-c3036fa09365 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:42:21.241103 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68d65d6-21f1-45d2-8595-c3036fa09365 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:42:21.243200 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68d65d6-21f1-45d2-8595-c3036fa09365 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:42:21.262939 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 336/659] 10.222.0.57 () {56 vars in 1109 bytes} [Fri Sep 16 07:42:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:42:21.262939 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68d65d6-21f1-45d2-8595-c3036fa09365 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:42:21.324513 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f969d3-af9a-4150-a6bb-4a96f99f6f66 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:42:21.366670 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1202e0e8-b127-4790-ab7d-870d129d3e9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:42:21.367654 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1202e0e8-b127-4790-ab7d-870d129d3e9e None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:21.367938 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1202e0e8-b127-4790-ab7d-870d129d3e9e None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:21.368216 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1202e0e8-b127-4790-ab7d-870d129d3e9e None admin] PATH_INFO: `/v3/users` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:21.369425 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1202e0e8-b127-4790-ab7d-870d129d3e9e None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:42:21.369909 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1202e0e8-b127-4790-ab7d-870d129d3e9e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:42:21.372193 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1202e0e8-b127-4790-ab7d-870d129d3e9e None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:42:21.393403 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68d65d6-21f1-45d2-8595-c3036fa09365 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:42:21.395046 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 324/660] 10.222.0.57 () {56 vars in 1139 bytes} [Fri Sep 16 07:42:21 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:42:21.395500 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:42:21.395922 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1202e0e8-b127-4790-ab7d-870d129d3e9e None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:42:21.413786 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:42:21.438932 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa066afe-03df-4cef-b198-583d5b9ddd21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:42:21.439649 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa066afe-03df-4cef-b198-583d5b9ddd21 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:21.439994 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa066afe-03df-4cef-b198-583d5b9ddd21 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:21.440374 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa066afe-03df-4cef-b198-583d5b9ddd21 None admin] PATH_INFO: `/v3/users` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:21.441223 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa066afe-03df-4cef-b198-583d5b9ddd21 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:42:21.441594 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa066afe-03df-4cef-b198-583d5b9ddd21 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:42:21.443140 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa066afe-03df-4cef-b198-583d5b9ddd21 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:42:21.468780 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 337/661] 10.222.0.57 () {56 vars in 1137 bytes} [Fri Sep 16 07:42:21 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:42:21.469790 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa066afe-03df-4cef-b198-583d5b9ddd21 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:42:21.518157 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1202e0e8-b127-4790-ab7d-870d129d3e9e None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:42:21.564354 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df20232e-905f-4bdd-b2f8-49c0f69ca530 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:42:21.565079 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df20232e-905f-4bdd-b2f8-49c0f69ca530 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:21.565427 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df20232e-905f-4bdd-b2f8-49c0f69ca530 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:21.565809 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df20232e-905f-4bdd-b2f8-49c0f69ca530 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:21.575364 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df20232e-905f-4bdd-b2f8-49c0f69ca530 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:42:21.577479 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df20232e-905f-4bdd-b2f8-49c0f69ca530 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:42:21.580211 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa066afe-03df-4cef-b198-583d5b9ddd21 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:42:21.591503 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application [None req-df20232e-905f-4bdd-b2f8-49c0f69ca530 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 07:42:21.591503 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 07:42:21.591503 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 07:42:21.591503 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 07:42:21.591503 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 07:42:21.591503 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 07:42:21.591503 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 07:42:21.591503 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 07:42:21.591503 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 07:42:21.591503 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 07:42:21.591503 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 07:42:21.591503 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 07:42:21.591503 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 16 07:42:21.591503 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 16 07:42:21.591503 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 16 07:42:21.592638 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 16 07:42:21.592638 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 07:42:21.592638 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 07:42:21.592638 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 07:42:21.592638 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 07:42:21.592638 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 07:42:21.592638 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 07:42:21.592638 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 07:42:21.592638 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application with Lock( Sep 16 07:42:21.592638 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 07:42:21.592638 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._enter() Sep 16 07:42:21.592638 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 07:42:21.592638 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 07:42:21.592638 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 07:42:21.592638 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.creator() Sep 16 07:42:21.592638 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 07:42:21.592638 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application created_value = creator( Sep 16 07:42:21.593770 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 16 07:42:21.593770 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 16 07:42:21.593770 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 16 07:42:21.593770 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 16 07:42:21.593770 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 16 07:42:21.593770 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 16 07:42:21.593770 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 07:42:21.593770 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Sep 16 07:42:21.594685 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 325/662] 10.222.0.57 () {56 vars in 1111 bytes} [Fri Sep 16 07:42:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 07:42:21.595862 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df20232e-905f-4bdd-b2f8-49c0f69ca530 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:42:21.629318 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79aa055-4834-4536-a4f7-ab1911fd0824 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:42:21.630247 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79aa055-4834-4536-a4f7-ab1911fd0824 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:21.630532 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79aa055-4834-4536-a4f7-ab1911fd0824 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:21.631059 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79aa055-4834-4536-a4f7-ab1911fd0824 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:21.661360 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:42:21.678338 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:42:21.717261 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df20232e-905f-4bdd-b2f8-49c0f69ca530 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:42:21.722584 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79aa055-4834-4536-a4f7-ab1911fd0824 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:42:21.724803 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79aa055-4834-4536-a4f7-ab1911fd0824 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:42:21.761457 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2670b14f-f377-4b29-af7b-2cf59dcc000f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:42:21.763730 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2670b14f-f377-4b29-af7b-2cf59dcc000f None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:21.764204 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2670b14f-f377-4b29-af7b-2cf59dcc000f None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:21.764628 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2670b14f-f377-4b29-af7b-2cf59dcc000f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:21.838825 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 338/663] 10.222.0.57 () {58 vars in 1282 bytes} [Fri Sep 16 07:42:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 16 07:42:21.840537 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79aa055-4834-4536-a4f7-ab1911fd0824 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:42:21.844892 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2670b14f-f377-4b29-af7b-2cf59dcc000f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:42:21.846577 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2670b14f-f377-4b29-af7b-2cf59dcc000f None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:42:21.893356 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:42:21.930537 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:42:21.950955 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79aa055-4834-4536-a4f7-ab1911fd0824 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:42:21.961226 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 326/664] 10.222.0.57 () {58 vars in 1282 bytes} [Fri Sep 16 07:42:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 16 07:42:21.962394 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2670b14f-f377-4b29-af7b-2cf59dcc000f None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:42:21.994572 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b735a9e6-d6d5-4c17-aef8-ed0dbbeb23b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:42:21.995331 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b735a9e6-d6d5-4c17-aef8-ed0dbbeb23b9 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:21.995614 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b735a9e6-d6d5-4c17-aef8-ed0dbbeb23b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:21.996070 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b735a9e6-d6d5-4c17-aef8-ed0dbbeb23b9 None admin] PATH_INFO: `/v3/projects` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:21.997291 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b735a9e6-d6d5-4c17-aef8-ed0dbbeb23b9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:42:21.997689 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b735a9e6-d6d5-4c17-aef8-ed0dbbeb23b9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:42:21.999260 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b735a9e6-d6d5-4c17-aef8-ed0dbbeb23b9 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:42:22.013458 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 339/665] 10.222.0.57 () {56 vars in 1148 bytes} [Fri Sep 16 07:42:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:42:22.014859 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b735a9e6-d6d5-4c17-aef8-ed0dbbeb23b9 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:42:22.074987 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2670b14f-f377-4b29-af7b-2cf59dcc000f None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:42:22.125225 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c0759f-6957-4931-9cf5-1cf4ca9f57df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:42:22.126461 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c0759f-6957-4931-9cf5-1cf4ca9f57df None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:22.126746 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c0759f-6957-4931-9cf5-1cf4ca9f57df None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:22.127023 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c0759f-6957-4931-9cf5-1cf4ca9f57df None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:22.133142 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b735a9e6-d6d5-4c17-aef8-ed0dbbeb23b9 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:42:22.144678 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:42:22.149113 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c0759f-6957-4931-9cf5-1cf4ca9f57df None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:42:22.150968 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c0759f-6957-4931-9cf5-1cf4ca9f57df None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:42:22.169159 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application [None req-f6c0759f-6957-4931-9cf5-1cf4ca9f57df None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 07:42:22.169159 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 07:42:22.169159 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 07:42:22.169159 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 07:42:22.169159 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 07:42:22.169159 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 07:42:22.169159 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 07:42:22.169159 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 07:42:22.169159 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 07:42:22.169159 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 07:42:22.169159 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 07:42:22.169159 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 07:42:22.169159 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 07:42:22.169159 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 07:42:22.169159 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 07:42:22.169159 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 07:42:22.170200 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 07:42:22.170200 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 07:42:22.170200 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 07:42:22.170200 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 07:42:22.170200 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 07:42:22.170200 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 07:42:22.170200 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 07:42:22.170200 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application with Lock( Sep 16 07:42:22.170200 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 07:42:22.170200 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._enter() Sep 16 07:42:22.170200 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 07:42:22.170200 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 07:42:22.170200 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 07:42:22.170200 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.creator() Sep 16 07:42:22.170200 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 07:42:22.170200 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application created_value = creator( Sep 16 07:42:22.170200 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 07:42:22.171115 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 07:42:22.171115 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 07:42:22.171115 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Sep 16 07:42:22.177485 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702cb255-7af5-48a6-b2b6-4609619877a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:42:22.177485 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702cb255-7af5-48a6-b2b6-4609619877a0 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:22.177485 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702cb255-7af5-48a6-b2b6-4609619877a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:22.177485 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702cb255-7af5-48a6-b2b6-4609619877a0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:22.178245 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 327/666] 10.222.0.57 () {56 vars in 1108 bytes} [Fri Sep 16 07:42:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 07:42:22.179515 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c0759f-6957-4931-9cf5-1cf4ca9f57df None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:42:22.189191 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702cb255-7af5-48a6-b2b6-4609619877a0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:42:22.190947 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702cb255-7af5-48a6-b2b6-4609619877a0 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:42:22.205714 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application [None req-702cb255-7af5-48a6-b2b6-4609619877a0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 07:42:22.205714 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 07:42:22.205714 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 07:42:22.205714 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 07:42:22.205714 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 07:42:22.205714 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 07:42:22.205714 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 07:42:22.205714 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 07:42:22.205714 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 07:42:22.205714 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 07:42:22.205714 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 07:42:22.205714 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 07:42:22.205714 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 07:42:22.205714 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 07:42:22.205714 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 07:42:22.205714 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 07:42:22.206721 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 07:42:22.206721 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 07:42:22.206721 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 07:42:22.206721 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 07:42:22.206721 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 07:42:22.206721 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 07:42:22.206721 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 07:42:22.206721 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application with Lock( Sep 16 07:42:22.206721 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 07:42:22.206721 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._enter() Sep 16 07:42:22.206721 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 07:42:22.206721 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 07:42:22.206721 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 07:42:22.206721 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.creator() Sep 16 07:42:22.206721 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 07:42:22.206721 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application created_value = creator( Sep 16 07:42:22.206721 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 07:42:22.207641 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 07:42:22.207641 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 07:42:22.207641 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Sep 16 07:42:22.211560 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 340/667] 10.222.0.57 () {56 vars in 1108 bytes} [Fri Sep 16 07:42:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 07:42:22.212481 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702cb255-7af5-48a6-b2b6-4609619877a0 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:42:22.214748 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:42:22.300796 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c0759f-6957-4931-9cf5-1cf4ca9f57df None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:42:22.319612 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702cb255-7af5-48a6-b2b6-4609619877a0 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:42:22.336002 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ae8f4e-979c-4260-8851-9e881425697b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:42:22.336611 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ae8f4e-979c-4260-8851-9e881425697b None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:22.336888 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ae8f4e-979c-4260-8851-9e881425697b None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:22.337160 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ae8f4e-979c-4260-8851-9e881425697b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:22.337908 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ae8f4e-979c-4260-8851-9e881425697b None admin] RBAC: Adding query filter params (role.id=f59220af7e7f4a8dbc30ba6325c7827c, scope.project.id=4735f453c0c24cc4a1c14e9ac84a0b46, user.id=ceecb2c2fe9842e3b228848e00fd11ed) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:42:22.338204 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ae8f4e-979c-4260-8851-9e881425697b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:42:22.339661 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ae8f4e-979c-4260-8851-9e881425697b None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:42:22.345436 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 328/668] 10.222.0.57 () {56 vars in 1374 bytes} [Fri Sep 16 07:42:22 2022] GET /identity/v3/role_assignments?user.id=ceecb2c2fe9842e3b228848e00fd11ed&scope.project.id=4735f453c0c24cc4a1c14e9ac84a0b46&role.id=f59220af7e7f4a8dbc30ba6325c7827c => generated 608 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:42:22.346267 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ae8f4e-979c-4260-8851-9e881425697b None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:42:22.369531 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62996791-d0d8-47fd-b11d-c0586de1da58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:42:22.370251 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62996791-d0d8-47fd-b11d-c0586de1da58 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:22.370629 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62996791-d0d8-47fd-b11d-c0586de1da58 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:22.371559 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62996791-d0d8-47fd-b11d-c0586de1da58 None admin] PATH_INFO: `/v3/domains` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:22.372530 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62996791-d0d8-47fd-b11d-c0586de1da58 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:42:22.372940 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62996791-d0d8-47fd-b11d-c0586de1da58 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:42:22.374632 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62996791-d0d8-47fd-b11d-c0586de1da58 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:42:22.390526 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 341/669] 10.222.0.57 () {56 vars in 1109 bytes} [Fri Sep 16 07:42:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:42:22.392044 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab2cab8-c642-44b5-bd88-3f42dfc690e5 None None] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:22.392400 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab2cab8-c642-44b5-bd88-3f42dfc690e5 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:22.392746 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab2cab8-c642-44b5-bd88-3f42dfc690e5 None None] PATH_INFO: `/` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:22.394345 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 342/670] 10.222.0.57 () {54 vars in 927 bytes} [Fri Sep 16 07:42:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 07:42:22.395556 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8074eb8d-3737-4753-b3a3-0a99e5d9ea3f None None] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:22.395842 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8074eb8d-3737-4753-b3a3-0a99e5d9ea3f None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:22.396111 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8074eb8d-3737-4753-b3a3-0a99e5d9ea3f None None] PATH_INFO: `/` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:22.398221 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 343/671] 10.222.0.57 () {54 vars in 927 bytes} [Fri Sep 16 07:42:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 07:42:22.398576 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8074eb8d-3737-4753-b3a3-0a99e5d9ea3f None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:42:22.426658 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:42:22.461486 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:42:22.473969 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ae8f4e-979c-4260-8851-9e881425697b None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:42:22.513492 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1ba6de-02db-48ec-a2d9-642b45ed1579 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:42:22.514177 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1ba6de-02db-48ec-a2d9-642b45ed1579 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:22.514465 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1ba6de-02db-48ec-a2d9-642b45ed1579 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:22.514742 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1ba6de-02db-48ec-a2d9-642b45ed1579 None admin] PATH_INFO: `/v3/domains` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:22.515405 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1ba6de-02db-48ec-a2d9-642b45ed1579 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:42:22.515723 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1ba6de-02db-48ec-a2d9-642b45ed1579 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:42:22.517631 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1ba6de-02db-48ec-a2d9-642b45ed1579 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:42:22.531173 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8074eb8d-3737-4753-b3a3-0a99e5d9ea3f None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:42:22.531601 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 329/672] 10.222.0.57 () {56 vars in 1109 bytes} [Fri Sep 16 07:42:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:42:22.532857 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ea126c-1c6f-4773-844c-4519e206e97a None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:22.533955 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ea126c-1c6f-4773-844c-4519e206e97a None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:22.534249 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ea126c-1c6f-4773-844c-4519e206e97a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:22.554887 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-56ea126c-1c6f-4773-844c-4519e206e97a None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:42:22.556081 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-56ea126c-1c6f-4773-844c-4519e206e97a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:42:22.576460 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3d074c-e6eb-4dbb-8dd5-e19b40676cab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:42:22.577098 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3d074c-e6eb-4dbb-8dd5-e19b40676cab None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:22.577378 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3d074c-e6eb-4dbb-8dd5-e19b40676cab None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:22.577650 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3d074c-e6eb-4dbb-8dd5-e19b40676cab None admin] PATH_INFO: `/v3/projects/service` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:22.584953 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3d074c-e6eb-4dbb-8dd5-e19b40676cab None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:42:22.586461 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3d074c-e6eb-4dbb-8dd5-e19b40676cab None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:42:22.599612 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application [None req-5c3d074c-e6eb-4dbb-8dd5-e19b40676cab None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 07:42:22.599612 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 07:42:22.599612 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 07:42:22.599612 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 07:42:22.599612 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 07:42:22.599612 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 07:42:22.599612 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 07:42:22.599612 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 07:42:22.599612 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 07:42:22.599612 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 07:42:22.599612 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 07:42:22.599612 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 07:42:22.599612 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 16 07:42:22.599612 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 16 07:42:22.599612 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 16 07:42:22.600607 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 16 07:42:22.600607 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 07:42:22.600607 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 07:42:22.600607 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 07:42:22.600607 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 07:42:22.600607 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 07:42:22.600607 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 07:42:22.600607 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 07:42:22.600607 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application with Lock( Sep 16 07:42:22.600607 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 07:42:22.600607 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._enter() Sep 16 07:42:22.600607 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 07:42:22.600607 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 07:42:22.600607 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 07:42:22.600607 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.creator() Sep 16 07:42:22.600607 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 07:42:22.600607 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application created_value = creator( Sep 16 07:42:22.601487 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 16 07:42:22.601487 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 16 07:42:22.601487 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 16 07:42:22.601487 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 16 07:42:22.601487 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 16 07:42:22.601487 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 16 07:42:22.601487 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 07:42:22.601487 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Sep 16 07:42:22.601487 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 344/673] 10.222.0.57 () {56 vars in 1111 bytes} [Fri Sep 16 07:42:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 07:42:22.602896 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d296ff0-fa70-447f-ba4b-20883536c41a None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:22.602896 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d296ff0-fa70-447f-ba4b-20883536c41a None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:22.602896 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d296ff0-fa70-447f-ba4b-20883536c41a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:22.621878 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-5d296ff0-fa70-447f-ba4b-20883536c41a None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:42:22.622954 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-5d296ff0-fa70-447f-ba4b-20883536c41a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:42:22.635192 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 330/674] 10.222.0.57 () {58 vars in 1024 bytes} [Fri Sep 16 07:42:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 07:42:22.636120 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ea126c-1c6f-4773-844c-4519e206e97a None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:42:22.719109 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 345/675] 10.222.0.57 () {58 vars in 1024 bytes} [Fri Sep 16 07:42:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 07:42:22.720814 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d296ff0-fa70-447f-ba4b-20883536c41a None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:42:22.726887 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:42:22.738263 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:42:22.753407 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ea126c-1c6f-4773-844c-4519e206e97a None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:42:22.796191 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c165a4f-d62f-418e-b17a-28694e770973 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:42:22.796662 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c165a4f-d62f-418e-b17a-28694e770973 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:22.797060 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c165a4f-d62f-418e-b17a-28694e770973 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:22.797432 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c165a4f-d62f-418e-b17a-28694e770973 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:22.804546 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c165a4f-d62f-418e-b17a-28694e770973 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:42:22.806113 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c165a4f-d62f-418e-b17a-28694e770973 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:42:22.817885 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application [None req-1c165a4f-d62f-418e-b17a-28694e770973 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 07:42:22.817885 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 07:42:22.817885 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 07:42:22.817885 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 07:42:22.817885 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 07:42:22.817885 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 07:42:22.817885 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 07:42:22.817885 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 07:42:22.817885 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 07:42:22.817885 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 07:42:22.817885 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 07:42:22.817885 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 07:42:22.817885 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 16 07:42:22.817885 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 16 07:42:22.817885 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 16 07:42:22.818978 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 16 07:42:22.818978 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 07:42:22.818978 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 07:42:22.818978 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 07:42:22.818978 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 07:42:22.818978 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 07:42:22.818978 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 07:42:22.818978 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 07:42:22.818978 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application with Lock( Sep 16 07:42:22.818978 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 07:42:22.818978 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._enter() Sep 16 07:42:22.818978 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 07:42:22.818978 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 07:42:22.818978 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 07:42:22.818978 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.creator() Sep 16 07:42:22.818978 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 07:42:22.818978 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application created_value = creator( Sep 16 07:42:22.820087 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 16 07:42:22.820087 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 16 07:42:22.820087 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 16 07:42:22.820087 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 16 07:42:22.820087 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 16 07:42:22.820087 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 16 07:42:22.820087 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 07:42:22.820087 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Sep 16 07:42:22.825836 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 331/676] 10.222.0.57 () {56 vars in 1111 bytes} [Fri Sep 16 07:42:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 07:42:22.828290 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c165a4f-d62f-418e-b17a-28694e770973 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:42:22.860140 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d296ff0-fa70-447f-ba4b-20883536c41a None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:42:22.898181 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dac9b5f-9341-48d8-9936-59004d699113 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:42:22.899016 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dac9b5f-9341-48d8-9936-59004d699113 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:22.899523 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dac9b5f-9341-48d8-9936-59004d699113 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:22.900044 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dac9b5f-9341-48d8-9936-59004d699113 None admin] PATH_INFO: `/v3/projects` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:22.900927 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dac9b5f-9341-48d8-9936-59004d699113 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:42:22.901433 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dac9b5f-9341-48d8-9936-59004d699113 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:42:22.903122 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dac9b5f-9341-48d8-9936-59004d699113 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:42:22.915483 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 346/677] 10.222.0.57 () {56 vars in 1148 bytes} [Fri Sep 16 07:42:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:42:22.916599 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dac9b5f-9341-48d8-9936-59004d699113 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:42:22.950232 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c165a4f-d62f-418e-b17a-28694e770973 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:42:22.994490 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d09d758-4016-46d9-8a94-be0a12d5fd8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:42:22.995240 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:42:22.995723 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d09d758-4016-46d9-8a94-be0a12d5fd8e None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:22.997042 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d09d758-4016-46d9-8a94-be0a12d5fd8e None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:22.997529 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d09d758-4016-46d9-8a94-be0a12d5fd8e None admin] PATH_INFO: `/v3/projects` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:22.998444 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d09d758-4016-46d9-8a94-be0a12d5fd8e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:42:22.998950 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d09d758-4016-46d9-8a94-be0a12d5fd8e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:42:23.000921 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d09d758-4016-46d9-8a94-be0a12d5fd8e None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:42:23.011529 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:42:23.015861 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 332/678] 10.222.0.57 () {56 vars in 1148 bytes} [Fri Sep 16 07:42:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 07:42:23.018961 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d09d758-4016-46d9-8a94-be0a12d5fd8e None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:42:23.043427 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dac9b5f-9341-48d8-9936-59004d699113 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:42:23.092464 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd148c6-906f-4161-b31b-2f1a6f21fd37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:42:23.093380 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd148c6-906f-4161-b31b-2f1a6f21fd37 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:23.093665 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd148c6-906f-4161-b31b-2f1a6f21fd37 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:23.093964 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd148c6-906f-4161-b31b-2f1a6f21fd37 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:23.108700 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd148c6-906f-4161-b31b-2f1a6f21fd37 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 07:42:23.115752 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application [None req-5bd148c6-906f-4161-b31b-2f1a6f21fd37 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 16 07:42:23.115752 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 07:42:23.115752 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 07:42:23.115752 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 07:42:23.115752 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 07:42:23.115752 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 07:42:23.115752 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 07:42:23.115752 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 07:42:23.115752 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 07:42:23.115752 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 07:42:23.115752 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 07:42:23.115752 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 07:42:23.115752 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 07:42:23.115752 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 07:42:23.115752 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 07:42:23.115752 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 07:42:23.116685 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 07:42:23.116685 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 07:42:23.116685 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 07:42:23.116685 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 07:42:23.116685 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 07:42:23.116685 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 07:42:23.116685 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 07:42:23.116685 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 07:42:23.116685 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 07:42:23.116685 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 07:42:23.116685 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 07:42:23.116685 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application with Lock( Sep 16 07:42:23.116685 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 07:42:23.116685 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._enter() Sep 16 07:42:23.116685 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 07:42:23.116685 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 07:42:23.117531 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 07:42:23.117531 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.creator() Sep 16 07:42:23.117531 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 07:42:23.117531 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application created_value = creator( Sep 16 07:42:23.117531 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 07:42:23.117531 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 07:42:23.117531 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 07:42:23.117531 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 07:42:23.117531 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 07:42:23.117531 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 07:42:23.117531 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 16 07:42:23.117531 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Sep 16 07:42:23.118677 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 347/679] 10.222.0.57 () {56 vars in 1096 bytes} [Fri Sep 16 07:42:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 07:42:23.125770 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd148c6-906f-4161-b31b-2f1a6f21fd37 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:42:23.139271 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d09d758-4016-46d9-8a94-be0a12d5fd8e None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:42:23.177764 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d25615c-f2fd-440c-8316-18c43f1636fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:42:23.179081 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d25615c-f2fd-440c-8316-18c43f1636fb None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:23.179655 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d25615c-f2fd-440c-8316-18c43f1636fb None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:23.180202 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d25615c-f2fd-440c-8316-18c43f1636fb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:23.181242 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d25615c-f2fd-440c-8316-18c43f1636fb None admin] RBAC: Adding query filter params (role.id=f59220af7e7f4a8dbc30ba6325c7827c, scope.project.id=4735f453c0c24cc4a1c14e9ac84a0b46, user.id=1062e457207a41e4ba4f0a0c4bf36f1d) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:42:23.182067 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d25615c-f2fd-440c-8316-18c43f1636fb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:42:23.184795 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d25615c-f2fd-440c-8316-18c43f1636fb None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:42:23.201755 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 333/680] 10.222.0.57 () {56 vars in 1374 bytes} [Fri Sep 16 07:42:23 2022] GET /identity/v3/role_assignments?user.id=1062e457207a41e4ba4f0a0c4bf36f1d&scope.project.id=4735f453c0c24cc4a1c14e9ac84a0b46&role.id=f59220af7e7f4a8dbc30ba6325c7827c => generated 608 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:42:23.201755 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d25615c-f2fd-440c-8316-18c43f1636fb None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:42:23.239760 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd148c6-906f-4161-b31b-2f1a6f21fd37 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:42:23.267672 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:42:23.275103 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:42:23.288880 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8815127-dc62-4a56-ac46-96ce55521515 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:42:23.289610 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8815127-dc62-4a56-ac46-96ce55521515 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:23.290494 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8815127-dc62-4a56-ac46-96ce55521515 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:23.290841 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8815127-dc62-4a56-ac46-96ce55521515 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:23.292105 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8815127-dc62-4a56-ac46-96ce55521515 None admin] RBAC: Adding query filter params (role.id=f59220af7e7f4a8dbc30ba6325c7827c, scope.project.id=4735f453c0c24cc4a1c14e9ac84a0b46, user.id=6544bf6be4c24454a013ca110c43cef2) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:42:23.292509 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8815127-dc62-4a56-ac46-96ce55521515 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:42:23.294784 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8815127-dc62-4a56-ac46-96ce55521515 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:42:23.303943 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 348/681] 10.222.0.57 () {56 vars in 1374 bytes} [Fri Sep 16 07:42:23 2022] GET /identity/v3/role_assignments?user.id=6544bf6be4c24454a013ca110c43cef2&scope.project.id=4735f453c0c24cc4a1c14e9ac84a0b46&role.id=f59220af7e7f4a8dbc30ba6325c7827c => generated 608 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:42:23.304912 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8815127-dc62-4a56-ac46-96ce55521515 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:42:23.335099 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d25615c-f2fd-440c-8316-18c43f1636fb None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:42:23.409023 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcbed35-edea-475f-b32c-2bb48c84f3c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:42:23.409673 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcbed35-edea-475f-b32c-2bb48c84f3c7 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:23.409982 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcbed35-edea-475f-b32c-2bb48c84f3c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:23.410249 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcbed35-edea-475f-b32c-2bb48c84f3c7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:23.426735 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdcbed35-edea-475f-b32c-2bb48c84f3c7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 07:42:23.432359 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application [None req-cdcbed35-edea-475f-b32c-2bb48c84f3c7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 16 07:42:23.432359 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 07:42:23.432359 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 07:42:23.432359 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 07:42:23.432359 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 07:42:23.432359 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 07:42:23.432359 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 07:42:23.432359 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 07:42:23.432359 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 07:42:23.432359 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 07:42:23.432359 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 07:42:23.432359 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 07:42:23.432359 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 07:42:23.432359 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 07:42:23.432359 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 07:42:23.432359 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 07:42:23.433560 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 07:42:23.433560 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 07:42:23.433560 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 07:42:23.433560 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 07:42:23.433560 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 07:42:23.433560 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 07:42:23.433560 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 07:42:23.433560 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 07:42:23.433560 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 07:42:23.433560 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 07:42:23.433560 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 07:42:23.433560 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application with Lock( Sep 16 07:42:23.433560 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 07:42:23.433560 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._enter() Sep 16 07:42:23.433560 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 07:42:23.433560 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 07:42:23.434473 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 07:42:23.434473 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.creator() Sep 16 07:42:23.434473 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 07:42:23.434473 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application created_value = creator( Sep 16 07:42:23.434473 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 07:42:23.434473 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 07:42:23.434473 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 07:42:23.434473 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 07:42:23.434473 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 07:42:23.434473 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 07:42:23.434473 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 16 07:42:23.434473 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Sep 16 07:42:23.434473 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 334/682] 10.222.0.57 () {56 vars in 1102 bytes} [Fri Sep 16 07:42:23 2022] GET /identity/v3/roles/service => generated 85 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 07:42:23.439966 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcbed35-edea-475f-b32c-2bb48c84f3c7 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:42:23.479438 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8815127-dc62-4a56-ac46-96ce55521515 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:42:23.520952 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6867dc24-58e6-463c-a4ad-c20974e7e191 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:42:23.521568 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6867dc24-58e6-463c-a4ad-c20974e7e191 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:23.521900 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6867dc24-58e6-463c-a4ad-c20974e7e191 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:23.522231 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6867dc24-58e6-463c-a4ad-c20974e7e191 None admin] PATH_INFO: `/v3/roles` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:23.522903 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6867dc24-58e6-463c-a4ad-c20974e7e191 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:42:23.523207 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6867dc24-58e6-463c-a4ad-c20974e7e191 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:42:23.525044 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6867dc24-58e6-463c-a4ad-c20974e7e191 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:42:23.534841 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 349/683] 10.222.0.57 () {56 vars in 1099 bytes} [Fri Sep 16 07:42:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:42:23.543702 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6867dc24-58e6-463c-a4ad-c20974e7e191 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:42:23.583219 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcbed35-edea-475f-b32c-2bb48c84f3c7 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:42:23.611174 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:42:23.614879 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:42:23.626552 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7945da52-52d2-4ad0-b9cd-f4d48b1b5780 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:42:23.627335 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7945da52-52d2-4ad0-b9cd-f4d48b1b5780 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:23.627701 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7945da52-52d2-4ad0-b9cd-f4d48b1b5780 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:23.628062 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7945da52-52d2-4ad0-b9cd-f4d48b1b5780 None admin] PATH_INFO: `/v3/roles` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:23.628818 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7945da52-52d2-4ad0-b9cd-f4d48b1b5780 None admin] RBAC: Adding query filter params (name=service) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:42:23.629213 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7945da52-52d2-4ad0-b9cd-f4d48b1b5780 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:42:23.631042 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7945da52-52d2-4ad0-b9cd-f4d48b1b5780 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:42:23.640495 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 335/684] 10.222.0.57 () {56 vars in 1103 bytes} [Fri Sep 16 07:42:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:42:23.650742 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7945da52-52d2-4ad0-b9cd-f4d48b1b5780 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:42:23.672965 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6867dc24-58e6-463c-a4ad-c20974e7e191 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:42:23.718442 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727e502f-fdd6-497d-979f-b6f87dc857fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:42:23.719303 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727e502f-fdd6-497d-979f-b6f87dc857fc None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:23.719893 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727e502f-fdd6-497d-979f-b6f87dc857fc None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:23.720603 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727e502f-fdd6-497d-979f-b6f87dc857fc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:23.737063 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727e502f-fdd6-497d-979f-b6f87dc857fc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:42:23.739072 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727e502f-fdd6-497d-979f-b6f87dc857fc None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:42:23.759663 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application [None req-727e502f-fdd6-497d-979f-b6f87dc857fc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 07:42:23.759663 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 07:42:23.759663 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 07:42:23.759663 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 07:42:23.759663 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 07:42:23.759663 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 07:42:23.759663 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 07:42:23.759663 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 07:42:23.759663 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 07:42:23.759663 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 07:42:23.759663 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 07:42:23.759663 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 07:42:23.759663 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 07:42:23.759663 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 07:42:23.759663 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 07:42:23.759663 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 07:42:23.760892 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 07:42:23.760892 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 07:42:23.760892 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 07:42:23.760892 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 07:42:23.760892 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 07:42:23.760892 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 07:42:23.760892 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 07:42:23.760892 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application with Lock( Sep 16 07:42:23.760892 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 07:42:23.760892 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._enter() Sep 16 07:42:23.760892 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 07:42:23.760892 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 07:42:23.760892 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 07:42:23.760892 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.creator() Sep 16 07:42:23.760892 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 07:42:23.760892 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application created_value = creator( Sep 16 07:42:23.760892 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 07:42:23.762199 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 07:42:23.762199 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 07:42:23.762199 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Sep 16 07:42:23.762419 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7945da52-52d2-4ad0-b9cd-f4d48b1b5780 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:42:23.768423 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 350/685] 10.222.0.57 () {56 vars in 1108 bytes} [Fri Sep 16 07:42:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 07:42:23.770061 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727e502f-fdd6-497d-979f-b6f87dc857fc None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:42:23.830065 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32e9c14-a019-4e57-85cd-6a78bf346a1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:42:23.831252 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32e9c14-a019-4e57-85cd-6a78bf346a1d None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:23.831530 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32e9c14-a019-4e57-85cd-6a78bf346a1d None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:23.831803 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32e9c14-a019-4e57-85cd-6a78bf346a1d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:23.857177 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32e9c14-a019-4e57-85cd-6a78bf346a1d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:42:23.858681 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32e9c14-a019-4e57-85cd-6a78bf346a1d None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:42:23.885444 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application [None req-a32e9c14-a019-4e57-85cd-6a78bf346a1d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 07:42:23.885444 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 07:42:23.885444 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 07:42:23.885444 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 07:42:23.885444 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 07:42:23.885444 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 07:42:23.885444 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 07:42:23.885444 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 07:42:23.885444 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 07:42:23.885444 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 07:42:23.885444 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 07:42:23.885444 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 07:42:23.885444 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 07:42:23.885444 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 07:42:23.885444 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 07:42:23.885444 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 07:42:23.886532 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 07:42:23.886532 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 07:42:23.886532 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 07:42:23.886532 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 07:42:23.886532 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 07:42:23.886532 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 07:42:23.886532 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 07:42:23.886532 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application with Lock( Sep 16 07:42:23.886532 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 07:42:23.886532 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._enter() Sep 16 07:42:23.886532 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 07:42:23.886532 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 07:42:23.886532 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 07:42:23.886532 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.creator() Sep 16 07:42:23.886532 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 07:42:23.886532 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application created_value = creator( Sep 16 07:42:23.886532 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 07:42:23.888015 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 07:42:23.888015 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 07:42:23.888015 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Sep 16 07:42:23.888015 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 336/686] 10.222.0.57 () {56 vars in 1108 bytes} [Fri Sep 16 07:42:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 07:42:23.896179 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32e9c14-a019-4e57-85cd-6a78bf346a1d None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:42:23.972438 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727e502f-fdd6-497d-979f-b6f87dc857fc None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:42:23.986111 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:42:24.002075 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:42:24.043963 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0389d5-797e-4c67-9ce6-5251762a73d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:42:24.044574 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0389d5-797e-4c67-9ce6-5251762a73d5 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:24.044851 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0389d5-797e-4c67-9ce6-5251762a73d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:24.045119 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0389d5-797e-4c67-9ce6-5251762a73d5 None admin] PATH_INFO: `/v3/domains` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:24.045778 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0389d5-797e-4c67-9ce6-5251762a73d5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:42:24.046079 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0389d5-797e-4c67-9ce6-5251762a73d5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:42:24.047541 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0389d5-797e-4c67-9ce6-5251762a73d5 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:42:24.072183 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 351/687] 10.222.0.57 () {56 vars in 1109 bytes} [Fri Sep 16 07:42:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:42:24.086998 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32e9c14-a019-4e57-85cd-6a78bf346a1d None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:42:24.090371 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0389d5-797e-4c67-9ce6-5251762a73d5 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:42:24.129982 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7009229-418f-42a2-a03d-1f2554a6b9cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:42:24.131132 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7009229-418f-42a2-a03d-1f2554a6b9cf None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:24.131622 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7009229-418f-42a2-a03d-1f2554a6b9cf None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:24.132078 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7009229-418f-42a2-a03d-1f2554a6b9cf None admin] PATH_INFO: `/v3/domains` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:24.133168 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7009229-418f-42a2-a03d-1f2554a6b9cf None admin] RBAC: Adding query filter params (name=Default) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:42:24.133688 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7009229-418f-42a2-a03d-1f2554a6b9cf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:42:24.135131 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7009229-418f-42a2-a03d-1f2554a6b9cf None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:42:24.150472 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 337/688] 10.222.0.57 () {56 vars in 1109 bytes} [Fri Sep 16 07:42:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:42:24.156753 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7009229-418f-42a2-a03d-1f2554a6b9cf None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:42:24.262467 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:42:24.265840 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7009229-418f-42a2-a03d-1f2554a6b9cf None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:42:24.302589 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85fd46d-f2b1-46e0-b1c8-83c1d05d35f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:42:24.302807 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0389d5-797e-4c67-9ce6-5251762a73d5 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:42:24.303459 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85fd46d-f2b1-46e0-b1c8-83c1d05d35f9 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:24.303835 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85fd46d-f2b1-46e0-b1c8-83c1d05d35f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:24.304201 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85fd46d-f2b1-46e0-b1c8-83c1d05d35f9 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:24.312648 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85fd46d-f2b1-46e0-b1c8-83c1d05d35f9 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:42:24.314270 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85fd46d-f2b1-46e0-b1c8-83c1d05d35f9 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:42:24.327660 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application [None req-f85fd46d-f2b1-46e0-b1c8-83c1d05d35f9 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 16 07:42:24.327660 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 07:42:24.327660 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 07:42:24.327660 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 07:42:24.327660 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 07:42:24.327660 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 07:42:24.327660 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 07:42:24.327660 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 07:42:24.327660 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 07:42:24.327660 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 07:42:24.327660 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 07:42:24.327660 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 07:42:24.327660 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 16 07:42:24.327660 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 16 07:42:24.327660 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 16 07:42:24.327660 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 16 07:42:24.328622 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 07:42:24.328622 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 07:42:24.328622 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 16 07:42:24.328622 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 07:42:24.328622 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 16 07:42:24.328622 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 07:42:24.328622 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 07:42:24.328622 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 07:42:24.328622 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 07:42:24.328622 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 07:42:24.328622 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 07:42:24.328622 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application with Lock( Sep 16 07:42:24.328622 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 07:42:24.328622 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._enter() Sep 16 07:42:24.328622 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 07:42:24.328622 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 07:42:24.328622 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 07:42:24.328622 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.creator() Sep 16 07:42:24.329885 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 07:42:24.329885 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application created_value = creator( Sep 16 07:42:24.329885 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 16 07:42:24.329885 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 16 07:42:24.329885 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 16 07:42:24.329885 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 16 07:42:24.329885 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 16 07:42:24.329885 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 16 07:42:24.329885 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 16 07:42:24.329885 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Sep 16 07:42:24.329885 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 338/689] 10.222.0.57 () {56 vars in 1096 bytes} [Fri Sep 16 07:42:24 2022] GET /identity/v3/users/swift => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 16 07:42:24.335375 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85fd46d-f2b1-46e0-b1c8-83c1d05d35f9 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:42:24.363581 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5c9723-b5ac-44a4-866c-76e2251247d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:42:24.364231 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5c9723-b5ac-44a4-866c-76e2251247d9 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:24.364606 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5c9723-b5ac-44a4-866c-76e2251247d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:24.364883 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5c9723-b5ac-44a4-866c-76e2251247d9 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:24.375460 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5c9723-b5ac-44a4-866c-76e2251247d9 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:42:24.387185 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5c9723-b5ac-44a4-866c-76e2251247d9 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:42:24.409171 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application [None req-8e5c9723-b5ac-44a4-866c-76e2251247d9 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 16 07:42:24.409171 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 07:42:24.409171 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 07:42:24.409171 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 07:42:24.409171 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 07:42:24.409171 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 07:42:24.409171 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 07:42:24.409171 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 07:42:24.409171 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 07:42:24.409171 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 07:42:24.409171 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 07:42:24.409171 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 07:42:24.409171 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 16 07:42:24.409171 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 16 07:42:24.409171 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 16 07:42:24.409171 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 16 07:42:24.410229 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 07:42:24.410229 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 07:42:24.410229 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 16 07:42:24.410229 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 07:42:24.410229 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 16 07:42:24.410229 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 07:42:24.410229 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 07:42:24.410229 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 07:42:24.410229 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 07:42:24.410229 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 07:42:24.410229 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 07:42:24.410229 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application with Lock( Sep 16 07:42:24.410229 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 07:42:24.410229 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._enter() Sep 16 07:42:24.410229 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 07:42:24.410229 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 07:42:24.410229 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 07:42:24.410229 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.creator() Sep 16 07:42:24.411537 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 07:42:24.411537 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application created_value = creator( Sep 16 07:42:24.411537 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 16 07:42:24.411537 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 16 07:42:24.411537 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 16 07:42:24.411537 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 16 07:42:24.411537 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 16 07:42:24.411537 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 16 07:42:24.411537 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 16 07:42:24.411537 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Sep 16 07:42:24.411537 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 352/690] 10.222.0.57 () {56 vars in 1093 bytes} [Fri Sep 16 07:42:24 2022] GET /identity/v3/users/nova => generated 82 bytes in 321 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 07:42:24.417611 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5c9723-b5ac-44a4-866c-76e2251247d9 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:42:24.455556 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85fd46d-f2b1-46e0-b1c8-83c1d05d35f9 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:42:24.482089 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:42:24.492101 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a4da7e-1815-4104-90af-1bc63f0e2510 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:42:24.492767 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a4da7e-1815-4104-90af-1bc63f0e2510 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:24.493091 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a4da7e-1815-4104-90af-1bc63f0e2510 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:24.493373 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a4da7e-1815-4104-90af-1bc63f0e2510 None admin] PATH_INFO: `/v3/users` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:24.494127 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a4da7e-1815-4104-90af-1bc63f0e2510 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:42:24.494436 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a4da7e-1815-4104-90af-1bc63f0e2510 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:42:24.496044 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a4da7e-1815-4104-90af-1bc63f0e2510 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:42:24.517704 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 339/691] 10.222.0.57 () {56 vars in 1135 bytes} [Fri Sep 16 07:42:24 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 07:42:24.523175 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a4da7e-1815-4104-90af-1bc63f0e2510 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:42:24.552919 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:42:24.635979 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a4da7e-1815-4104-90af-1bc63f0e2510 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:42:24.673464 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5c9723-b5ac-44a4-866c-76e2251247d9 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:42:24.675826 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5028358b-78a6-4213-b611-4b958eef434e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:42:24.676442 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5028358b-78a6-4213-b611-4b958eef434e None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:24.676721 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5028358b-78a6-4213-b611-4b958eef434e None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:24.676994 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5028358b-78a6-4213-b611-4b958eef434e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:24.772445 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5028358b-78a6-4213-b611-4b958eef434e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:42:24.774587 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5028358b-78a6-4213-b611-4b958eef434e None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:42:24.784707 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0949d3-16d0-45de-bdd2-0a442e8e26eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:42:24.785332 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0949d3-16d0-45de-bdd2-0a442e8e26eb None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:24.785613 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0949d3-16d0-45de-bdd2-0a442e8e26eb None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:24.785912 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0949d3-16d0-45de-bdd2-0a442e8e26eb None admin] PATH_INFO: `/v3/users` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:24.786651 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0949d3-16d0-45de-bdd2-0a442e8e26eb None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:42:24.786955 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0949d3-16d0-45de-bdd2-0a442e8e26eb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:42:24.788381 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0949d3-16d0-45de-bdd2-0a442e8e26eb None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:42:24.827035 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 353/692] 10.222.0.57 () {56 vars in 1133 bytes} [Fri Sep 16 07:42:24 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 410 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 07:42:24.829564 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:42:24.835140 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0949d3-16d0-45de-bdd2-0a442e8e26eb None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:42:24.935190 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 340/693] 10.222.0.57 () {58 vars in 1282 bytes} [Fri Sep 16 07:42:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 16 07:42:24.936599 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ee3b08-7847-4119-9c1f-33984463f907 None None] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:24.936885 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ee3b08-7847-4119-9c1f-33984463f907 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:24.937160 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ee3b08-7847-4119-9c1f-33984463f907 None None] PATH_INFO: `/` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:24.942773 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 341/694] 10.222.0.57 () {54 vars in 927 bytes} [Fri Sep 16 07:42:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 07:42:24.943642 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ee3b08-7847-4119-9c1f-33984463f907 None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:42:24.967620 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:42:24.988772 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0949d3-16d0-45de-bdd2-0a442e8e26eb None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:42:25.038268 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3535a8-bc88-4b46-ac7e-6b2f5f2272eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:42:25.039144 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3535a8-bc88-4b46-ac7e-6b2f5f2272eb None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:25.039867 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3535a8-bc88-4b46-ac7e-6b2f5f2272eb None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:25.040250 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3535a8-bc88-4b46-ac7e-6b2f5f2272eb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:25.059509 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ee3b08-7847-4119-9c1f-33984463f907 None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:42:25.085302 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:42:25.117958 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0e3cb8-0f2f-4309-af06-ec4b27cbf011 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:42:25.118862 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0e3cb8-0f2f-4309-af06-ec4b27cbf011 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:25.119544 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0e3cb8-0f2f-4309-af06-ec4b27cbf011 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:25.119840 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0e3cb8-0f2f-4309-af06-ec4b27cbf011 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:25.132659 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3535a8-bc88-4b46-ac7e-6b2f5f2272eb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:42:25.134183 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3535a8-bc88-4b46-ac7e-6b2f5f2272eb None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:42:25.134749 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0e3cb8-0f2f-4309-af06-ec4b27cbf011 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:42:25.137834 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0e3cb8-0f2f-4309-af06-ec4b27cbf011 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:42:25.158406 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application [None req-2f0e3cb8-0f2f-4309-af06-ec4b27cbf011 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 07:42:25.158406 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 07:42:25.158406 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 07:42:25.158406 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 07:42:25.158406 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 07:42:25.158406 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 07:42:25.158406 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 07:42:25.158406 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 07:42:25.158406 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 07:42:25.158406 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 07:42:25.158406 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 07:42:25.158406 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 07:42:25.158406 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 07:42:25.158406 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 07:42:25.158406 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 07:42:25.158406 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 07:42:25.159398 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 07:42:25.159398 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 07:42:25.159398 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 07:42:25.159398 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 07:42:25.159398 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 07:42:25.159398 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 07:42:25.159398 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 07:42:25.159398 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application with Lock( Sep 16 07:42:25.159398 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 07:42:25.159398 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._enter() Sep 16 07:42:25.159398 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 07:42:25.159398 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 07:42:25.159398 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 07:42:25.159398 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.creator() Sep 16 07:42:25.159398 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 07:42:25.159398 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application created_value = creator( Sep 16 07:42:25.159398 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 07:42:25.160296 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 07:42:25.160296 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 07:42:25.160296 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Sep 16 07:42:25.161817 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 342/695] 10.222.0.57 () {56 vars in 1108 bytes} [Fri Sep 16 07:42:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 07:42:25.163097 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d31300-b6ae-4c08-a462-066da37807ce None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:25.163446 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d31300-b6ae-4c08-a462-066da37807ce None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:25.163785 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d31300-b6ae-4c08-a462-066da37807ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:25.187820 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-b0d31300-b6ae-4c08-a462-066da37807ce None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:42:25.189102 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-b0d31300-b6ae-4c08-a462-066da37807ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:42:25.249315 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:42:25.269999 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 343/696] 10.222.0.57 () {58 vars in 1024 bytes} [Fri Sep 16 07:42:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 07:42:25.271050 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d31300-b6ae-4c08-a462-066da37807ce None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:42:25.276076 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 354/697] 10.222.0.57 () {58 vars in 1282 bytes} [Fri Sep 16 07:42:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 437 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 16 07:42:25.279063 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3535a8-bc88-4b46-ac7e-6b2f5f2272eb None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:42:25.398264 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3535a8-bc88-4b46-ac7e-6b2f5f2272eb None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:42:25.447802 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d171a4-b93f-4674-b21c-5bff957b72cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:42:25.448448 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d171a4-b93f-4674-b21c-5bff957b72cb None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:25.448728 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d171a4-b93f-4674-b21c-5bff957b72cb None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:25.449039 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d171a4-b93f-4674-b21c-5bff957b72cb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:25.449662 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:42:25.454408 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d31300-b6ae-4c08-a462-066da37807ce None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:42:25.474143 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d171a4-b93f-4674-b21c-5bff957b72cb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:42:25.475598 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d171a4-b93f-4674-b21c-5bff957b72cb None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:42:25.497027 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84faa702-fc8f-4a81-b722-b922b114e884 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:42:25.497868 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84faa702-fc8f-4a81-b722-b922b114e884 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:25.497868 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84faa702-fc8f-4a81-b722-b922b114e884 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:25.498135 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84faa702-fc8f-4a81-b722-b922b114e884 None admin] PATH_INFO: `/v3/domains` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:25.498989 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84faa702-fc8f-4a81-b722-b922b114e884 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:42:25.499421 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84faa702-fc8f-4a81-b722-b922b114e884 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:42:25.500832 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84faa702-fc8f-4a81-b722-b922b114e884 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:42:25.505269 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application [None req-74d171a4-b93f-4674-b21c-5bff957b72cb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 07:42:25.505269 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 07:42:25.505269 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 07:42:25.505269 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 07:42:25.505269 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 07:42:25.505269 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 07:42:25.505269 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 07:42:25.505269 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 07:42:25.505269 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 07:42:25.505269 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 07:42:25.505269 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 07:42:25.505269 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 07:42:25.505269 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 07:42:25.505269 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 07:42:25.505269 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 07:42:25.505269 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 07:42:25.506708 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 07:42:25.506708 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 07:42:25.506708 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 07:42:25.506708 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 07:42:25.506708 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 07:42:25.506708 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 07:42:25.506708 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 07:42:25.506708 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application with Lock( Sep 16 07:42:25.506708 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 07:42:25.506708 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._enter() Sep 16 07:42:25.506708 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 07:42:25.506708 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 07:42:25.506708 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 07:42:25.506708 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.creator() Sep 16 07:42:25.506708 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 07:42:25.506708 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application created_value = creator( Sep 16 07:42:25.506708 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 07:42:25.507839 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 07:42:25.507839 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 07:42:25.507839 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Sep 16 07:42:25.509617 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 355/698] 10.222.0.57 () {56 vars in 1108 bytes} [Fri Sep 16 07:42:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 07:42:25.516011 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 344/699] 10.222.0.57 () {56 vars in 1109 bytes} [Fri Sep 16 07:42:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:42:25.516854 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d171a4-b93f-4674-b21c-5bff957b72cb None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:42:25.531827 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84faa702-fc8f-4a81-b722-b922b114e884 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:42:25.566108 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:42:25.640170 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d171a4-b93f-4674-b21c-5bff957b72cb None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:42:25.679065 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf70ed8-6260-433e-a4af-7115adb76377 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:42:25.680330 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf70ed8-6260-433e-a4af-7115adb76377 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:25.680744 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf70ed8-6260-433e-a4af-7115adb76377 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:25.681176 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf70ed8-6260-433e-a4af-7115adb76377 None admin] PATH_INFO: `/v3/domains` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:25.682064 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf70ed8-6260-433e-a4af-7115adb76377 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:42:25.684883 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf70ed8-6260-433e-a4af-7115adb76377 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:42:25.687680 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf70ed8-6260-433e-a4af-7115adb76377 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:42:25.714494 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 356/700] 10.222.0.57 () {56 vars in 1109 bytes} [Fri Sep 16 07:42:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 07:42:25.723114 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf70ed8-6260-433e-a4af-7115adb76377 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:42:25.731294 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84faa702-fc8f-4a81-b722-b922b114e884 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:42:25.767798 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed0b45f-7823-46c9-974a-b25f4ed8127a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:42:25.768431 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed0b45f-7823-46c9-974a-b25f4ed8127a None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:25.768708 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed0b45f-7823-46c9-974a-b25f4ed8127a None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:25.768978 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed0b45f-7823-46c9-974a-b25f4ed8127a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:25.776374 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed0b45f-7823-46c9-974a-b25f4ed8127a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:42:25.778742 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed0b45f-7823-46c9-974a-b25f4ed8127a None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:42:25.790252 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application [None req-7ed0b45f-7823-46c9-974a-b25f4ed8127a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 07:42:25.790252 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 07:42:25.790252 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 07:42:25.790252 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 07:42:25.790252 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 07:42:25.790252 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 07:42:25.790252 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 07:42:25.790252 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 07:42:25.790252 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 07:42:25.790252 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 07:42:25.790252 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 07:42:25.790252 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 07:42:25.790252 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 16 07:42:25.790252 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 16 07:42:25.790252 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 16 07:42:25.791137 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 16 07:42:25.791137 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 07:42:25.791137 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 07:42:25.791137 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 07:42:25.791137 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 07:42:25.791137 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 07:42:25.791137 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 07:42:25.791137 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 07:42:25.791137 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application with Lock( Sep 16 07:42:25.791137 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 07:42:25.791137 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._enter() Sep 16 07:42:25.791137 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 07:42:25.791137 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 07:42:25.791137 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 07:42:25.791137 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.creator() Sep 16 07:42:25.791137 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 07:42:25.791137 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application created_value = creator( Sep 16 07:42:25.792627 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 16 07:42:25.792627 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 16 07:42:25.792627 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 16 07:42:25.792627 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 16 07:42:25.792627 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 16 07:42:25.792627 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 16 07:42:25.792627 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 07:42:25.792627 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Sep 16 07:42:25.792627 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 345/701] 10.222.0.57 () {56 vars in 1111 bytes} [Fri Sep 16 07:42:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 07:42:25.792627 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf707b7-3365-43e6-9101-588ca971b292 None None] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:25.793229 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf707b7-3365-43e6-9101-588ca971b292 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:25.793305 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf707b7-3365-43e6-9101-588ca971b292 None None] PATH_INFO: `/` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:25.797788 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 346/702] 10.222.0.57 () {54 vars in 927 bytes} [Fri Sep 16 07:42:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 07:42:25.797788 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf707b7-3365-43e6-9101-588ca971b292 None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:42:25.816331 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:42:25.842785 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:42:25.847536 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf70ed8-6260-433e-a4af-7115adb76377 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:42:25.885041 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d51a9ba-433d-4aff-a333-8992612caa17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:42:25.885843 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d51a9ba-433d-4aff-a333-8992612caa17 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:25.886126 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d51a9ba-433d-4aff-a333-8992612caa17 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:25.886955 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d51a9ba-433d-4aff-a333-8992612caa17 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:25.893981 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d51a9ba-433d-4aff-a333-8992612caa17 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:42:25.895424 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d51a9ba-433d-4aff-a333-8992612caa17 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:42:25.906321 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf707b7-3365-43e6-9101-588ca971b292 None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:42:25.908048 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application [None req-3d51a9ba-433d-4aff-a333-8992612caa17 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 07:42:25.908048 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 07:42:25.908048 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 07:42:25.908048 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 07:42:25.908048 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 07:42:25.908048 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 07:42:25.908048 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 07:42:25.908048 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 07:42:25.908048 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 07:42:25.908048 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 07:42:25.908048 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 07:42:25.908048 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 07:42:25.908048 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 16 07:42:25.908048 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 16 07:42:25.908048 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 16 07:42:25.908957 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 16 07:42:25.908957 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 07:42:25.908957 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 07:42:25.908957 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 07:42:25.908957 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 07:42:25.908957 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 07:42:25.908957 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 07:42:25.908957 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 07:42:25.908957 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application with Lock( Sep 16 07:42:25.908957 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 07:42:25.908957 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._enter() Sep 16 07:42:25.908957 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 07:42:25.908957 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 07:42:25.908957 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 07:42:25.908957 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.creator() Sep 16 07:42:25.908957 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 07:42:25.908957 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application created_value = creator( Sep 16 07:42:25.911165 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 16 07:42:25.911165 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 16 07:42:25.911165 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 16 07:42:25.911165 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 16 07:42:25.911165 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 16 07:42:25.911165 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 16 07:42:25.911165 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 07:42:25.911165 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Sep 16 07:42:25.911165 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 357/703] 10.222.0.57 () {56 vars in 1111 bytes} [Fri Sep 16 07:42:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 07:42:25.911165 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d51a9ba-433d-4aff-a333-8992612caa17 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:42:25.948594 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15949d8f-ae5c-4fd9-a98e-e4c2b567eaa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:42:25.949639 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15949d8f-ae5c-4fd9-a98e-e4c2b567eaa1 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:25.949948 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15949d8f-ae5c-4fd9-a98e-e4c2b567eaa1 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:25.950221 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15949d8f-ae5c-4fd9-a98e-e4c2b567eaa1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:25.963593 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15949d8f-ae5c-4fd9-a98e-e4c2b567eaa1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:42:25.965135 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15949d8f-ae5c-4fd9-a98e-e4c2b567eaa1 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:42:25.981197 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application [None req-15949d8f-ae5c-4fd9-a98e-e4c2b567eaa1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 07:42:25.981197 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 07:42:25.981197 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 07:42:25.981197 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 07:42:25.981197 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 07:42:25.981197 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 07:42:25.981197 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 07:42:25.981197 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 07:42:25.981197 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 07:42:25.981197 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 07:42:25.981197 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 07:42:25.981197 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 07:42:25.981197 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 07:42:25.981197 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 07:42:25.981197 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 07:42:25.981197 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 07:42:25.982418 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 07:42:25.982418 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 07:42:25.982418 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 07:42:25.982418 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 07:42:25.982418 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 07:42:25.982418 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 07:42:25.982418 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 07:42:25.982418 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application with Lock( Sep 16 07:42:25.982418 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 07:42:25.982418 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._enter() Sep 16 07:42:25.982418 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 07:42:25.982418 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 07:42:25.982418 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 07:42:25.982418 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.creator() Sep 16 07:42:25.982418 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 07:42:25.982418 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application created_value = creator( Sep 16 07:42:25.982418 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 07:42:25.983358 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 07:42:25.983358 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 07:42:25.983358 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Sep 16 07:42:25.983358 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 347/704] 10.222.0.57 () {56 vars in 1108 bytes} [Fri Sep 16 07:42:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 07:42:25.988454 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b586bef-3825-4db8-8eca-4d2041d17814 None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:25.988737 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b586bef-3825-4db8-8eca-4d2041d17814 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:25.989134 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b586bef-3825-4db8-8eca-4d2041d17814 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:26.008912 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-0b586bef-3825-4db8-8eca-4d2041d17814 None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:42:26.010255 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-0b586bef-3825-4db8-8eca-4d2041d17814 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:42:26.027511 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d51a9ba-433d-4aff-a333-8992612caa17 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:42:26.063368 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501d5abc-ad4c-4354-a55b-a896e9d9bd14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:42:26.063972 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501d5abc-ad4c-4354-a55b-a896e9d9bd14 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:26.064245 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501d5abc-ad4c-4354-a55b-a896e9d9bd14 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:26.064515 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501d5abc-ad4c-4354-a55b-a896e9d9bd14 None admin] PATH_INFO: `/v3/projects` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:26.065198 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501d5abc-ad4c-4354-a55b-a896e9d9bd14 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:42:26.065503 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501d5abc-ad4c-4354-a55b-a896e9d9bd14 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:42:26.066963 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501d5abc-ad4c-4354-a55b-a896e9d9bd14 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:42:26.079670 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 358/705] 10.222.0.57 () {56 vars in 1148 bytes} [Fri Sep 16 07:42:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:42:26.079923 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501d5abc-ad4c-4354-a55b-a896e9d9bd14 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:42:26.086506 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:42:26.086995 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 348/706] 10.222.0.57 () {58 vars in 1024 bytes} [Fri Sep 16 07:42:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 07:42:26.088097 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b586bef-3825-4db8-8eca-4d2041d17814 None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:42:26.113213 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:42:26.201084 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b586bef-3825-4db8-8eca-4d2041d17814 None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:42:26.204141 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501d5abc-ad4c-4354-a55b-a896e9d9bd14 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:42:26.238115 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3985cd56-c870-4714-96ac-4aa1bf6f288c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:42:26.238713 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3985cd56-c870-4714-96ac-4aa1bf6f288c None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:26.238984 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3985cd56-c870-4714-96ac-4aa1bf6f288c None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:26.239247 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3985cd56-c870-4714-96ac-4aa1bf6f288c None admin] PATH_INFO: `/v3/domains` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:26.239871 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3985cd56-c870-4714-96ac-4aa1bf6f288c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:42:26.240163 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3985cd56-c870-4714-96ac-4aa1bf6f288c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:42:26.240920 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36cab8a-356e-4bb9-9dd4-c240339b2c18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:42:26.241518 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3985cd56-c870-4714-96ac-4aa1bf6f288c None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:42:26.241697 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36cab8a-356e-4bb9-9dd4-c240339b2c18 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:26.242092 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36cab8a-356e-4bb9-9dd4-c240339b2c18 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:26.242458 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36cab8a-356e-4bb9-9dd4-c240339b2c18 None admin] PATH_INFO: `/v3/projects` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:26.243247 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36cab8a-356e-4bb9-9dd4-c240339b2c18 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:42:26.243659 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36cab8a-356e-4bb9-9dd4-c240339b2c18 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:42:26.245149 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36cab8a-356e-4bb9-9dd4-c240339b2c18 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:42:26.252986 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 349/707] 10.222.0.57 () {56 vars in 1109 bytes} [Fri Sep 16 07:42:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:42:26.252986 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff0f056-ea31-4a9d-92ad-17a51c218541 None None] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:26.252986 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff0f056-ea31-4a9d-92ad-17a51c218541 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:26.252986 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff0f056-ea31-4a9d-92ad-17a51c218541 None None] PATH_INFO: `/` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:26.252986 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 350/708] 10.222.0.57 () {54 vars in 927 bytes} [Fri Sep 16 07:42:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 07:42:26.252986 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff0f056-ea31-4a9d-92ad-17a51c218541 None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:42:26.263525 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 359/709] 10.222.0.57 () {56 vars in 1148 bytes} [Fri Sep 16 07:42:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:42:26.268343 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36cab8a-356e-4bb9-9dd4-c240339b2c18 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:42:26.325217 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:42:26.349339 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:42:26.372228 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36cab8a-356e-4bb9-9dd4-c240339b2c18 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:42:26.373824 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff0f056-ea31-4a9d-92ad-17a51c218541 None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:42:26.405201 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd9423a-e945-4800-a206-2a4373e72f85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:42:26.405832 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd9423a-e945-4800-a206-2a4373e72f85 None admin] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:26.406110 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd9423a-e945-4800-a206-2a4373e72f85 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:26.406402 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd9423a-e945-4800-a206-2a4373e72f85 None admin] PATH_INFO: `/v3/users` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:26.406582 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db93b408-2498-4ee3-a703-0a14202111f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:42:26.407034 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd9423a-e945-4800-a206-2a4373e72f85 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:42:26.407175 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db93b408-2498-4ee3-a703-0a14202111f1 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:26.407449 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db93b408-2498-4ee3-a703-0a14202111f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:26.407714 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db93b408-2498-4ee3-a703-0a14202111f1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:26.408412 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db93b408-2498-4ee3-a703-0a14202111f1 None admin] RBAC: Adding query filter params (role.id=f59220af7e7f4a8dbc30ba6325c7827c, scope.project.id=4735f453c0c24cc4a1c14e9ac84a0b46, user.id=38abb0283b41449d8183b88912f2574a) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:42:26.408604 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd9423a-e945-4800-a206-2a4373e72f85 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:42:26.408694 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db93b408-2498-4ee3-a703-0a14202111f1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:42:26.410119 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db93b408-2498-4ee3-a703-0a14202111f1 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:42:26.415748 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 351/710] 10.222.0.57 () {56 vars in 1374 bytes} [Fri Sep 16 07:42:26 2022] GET /identity/v3/role_assignments?user.id=38abb0283b41449d8183b88912f2574a&scope.project.id=4735f453c0c24cc4a1c14e9ac84a0b46&role.id=f59220af7e7f4a8dbc30ba6325c7827c => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:42:26.416853 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29ecc16-3fdd-4754-8e9a-ad215a14a9ce None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:26.417129 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29ecc16-3fdd-4754-8e9a-ad215a14a9ce None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:26.417398 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29ecc16-3fdd-4754-8e9a-ad215a14a9ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:26.438650 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-b29ecc16-3fdd-4754-8e9a-ad215a14a9ce None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:42:26.440064 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-b29ecc16-3fdd-4754-8e9a-ad215a14a9ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:42:26.446978 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 360/711] 10.222.0.57 () {60 vars in 1132 bytes} [Fri Sep 16 07:42:26 2022] POST /identity/v3/users => generated 254 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 07:42:26.448151 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd9423a-e945-4800-a206-2a4373e72f85 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:42:26.550794 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 352/712] 10.222.0.57 () {58 vars in 1024 bytes} [Fri Sep 16 07:42:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 07:42:26.552016 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29ecc16-3fdd-4754-8e9a-ad215a14a9ce None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:42:26.626098 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:42:26.628339 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd9423a-e945-4800-a206-2a4373e72f85 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:42:26.681370 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ea5330-cab2-4500-ac2d-7364aa7b0b0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:42:26.682153 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ea5330-cab2-4500-ac2d-7364aa7b0b0b None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:26.682526 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ea5330-cab2-4500-ac2d-7364aa7b0b0b None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:26.682896 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ea5330-cab2-4500-ac2d-7364aa7b0b0b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:26.684178 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ea5330-cab2-4500-ac2d-7364aa7b0b0b None admin] RBAC: Adding query filter params (role.id=567db03c91854ad9af1e9a87ec1bd275, scope.project.id=4735f453c0c24cc4a1c14e9ac84a0b46, user.id=9bec4d9b08514461a1bf63c6b88f53b2) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:42:26.684906 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ea5330-cab2-4500-ac2d-7364aa7b0b0b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:42:26.686376 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ea5330-cab2-4500-ac2d-7364aa7b0b0b None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:42:26.687532 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29ecc16-3fdd-4754-8e9a-ad215a14a9ce None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:42:26.688417 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:42:26.698143 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 361/713] 10.222.0.57 () {56 vars in 1374 bytes} [Fri Sep 16 07:42:26 2022] GET /identity/v3/role_assignments?user.id=9bec4d9b08514461a1bf63c6b88f53b2&scope.project.id=4735f453c0c24cc4a1c14e9ac84a0b46&role.id=567db03c91854ad9af1e9a87ec1bd275 => generated 259 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:42:26.734950 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b536fcad-a8eb-41e3-96d1-87b8dd682808 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:42:26.736009 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b536fcad-a8eb-41e3-96d1-87b8dd682808 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:26.736485 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b536fcad-a8eb-41e3-96d1-87b8dd682808 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:26.736950 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b536fcad-a8eb-41e3-96d1-87b8dd682808 None admin] PATH_INFO: `/v3/services/network` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:26.737828 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b536fcad-a8eb-41e3-96d1-87b8dd682808 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:42:26.739549 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b536fcad-a8eb-41e3-96d1-87b8dd682808 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:42:26.752864 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application [None req-b536fcad-a8eb-41e3-96d1-87b8dd682808 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 16 07:42:26.752864 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 07:42:26.752864 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 16 07:42:26.752864 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 16 07:42:26.752864 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 16 07:42:26.752864 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 16 07:42:26.752864 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 16 07:42:26.752864 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 16 07:42:26.752864 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 16 07:42:26.752864 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Sep 16 07:42:26.752864 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 16 07:42:26.752864 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Sep 16 07:42:26.752864 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 07:42:26.752864 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 07:42:26.752864 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 07:42:26.752864 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 07:42:26.752864 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 07:42:26.753968 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 07:42:26.753968 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 07:42:26.753968 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 07:42:26.753968 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 07:42:26.753968 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 07:42:26.753968 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 07:42:26.753968 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 16 07:42:26.753968 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 16 07:42:26.753968 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 16 07:42:26.753968 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 16 07:42:26.753968 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 07:42:26.753968 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 07:42:26.753968 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 07:42:26.753968 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 07:42:26.753968 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 07:42:26.753968 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 07:42:26.754893 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 07:42:26.754893 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application with Lock( Sep 16 07:42:26.754893 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 07:42:26.754893 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._enter() Sep 16 07:42:26.754893 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 07:42:26.754893 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 07:42:26.754893 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 07:42:26.754893 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.creator() Sep 16 07:42:26.754893 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 07:42:26.754893 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application created_value = creator( Sep 16 07:42:26.754893 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 16 07:42:26.754893 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 16 07:42:26.754893 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 16 07:42:26.754893 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Sep 16 07:42:26.756500 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 353/714] 10.222.0.57 () {56 vars in 1111 bytes} [Fri Sep 16 07:42:26 2022] GET /identity/v3/services/network => generated 88 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 07:42:26.762899 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ea5330-cab2-4500-ac2d-7364aa7b0b0b None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:42:26.836181 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b536fcad-a8eb-41e3-96d1-87b8dd682808 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:42:26.897420 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ea5330-cab2-4500-ac2d-7364aa7b0b0b None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:42:26.944530 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e783cf02-c76f-4e65-a745-2fae0d13f80c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:42:26.945151 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e783cf02-c76f-4e65-a745-2fae0d13f80c None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:26.945430 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e783cf02-c76f-4e65-a745-2fae0d13f80c None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:26.946110 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e783cf02-c76f-4e65-a745-2fae0d13f80c None admin] PATH_INFO: `/v3/services` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:26.946758 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e783cf02-c76f-4e65-a745-2fae0d13f80c None admin] RBAC: Adding query filter params (name=network) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:42:26.947062 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e783cf02-c76f-4e65-a745-2fae0d13f80c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:42:26.948787 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e783cf02-c76f-4e65-a745-2fae0d13f80c None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:42:26.955354 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 362/715] 10.222.0.57 () {56 vars in 1112 bytes} [Fri Sep 16 07:42:26 2022] GET /identity/v3/services?name=network => generated 124 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:42:26.960569 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e783cf02-c76f-4e65-a745-2fae0d13f80c None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:42:26.969052 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b536fcad-a8eb-41e3-96d1-87b8dd682808 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:42:26.988650 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:42:27.008910 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f273b4-c5ab-42ae-8a11-5b73d8da2421 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:42:27.009973 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f273b4-c5ab-42ae-8a11-5b73d8da2421 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:27.010496 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f273b4-c5ab-42ae-8a11-5b73d8da2421 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:27.010965 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f273b4-c5ab-42ae-8a11-5b73d8da2421 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:27.011769 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f273b4-c5ab-42ae-8a11-5b73d8da2421 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:42:27.013417 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f273b4-c5ab-42ae-8a11-5b73d8da2421 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:42:27.023622 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application [None req-d3f273b4-c5ab-42ae-8a11-5b73d8da2421 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 16 07:42:27.023622 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 07:42:27.023622 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 16 07:42:27.023622 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 16 07:42:27.023622 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 16 07:42:27.023622 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 16 07:42:27.023622 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 16 07:42:27.023622 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 16 07:42:27.023622 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 16 07:42:27.023622 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Sep 16 07:42:27.023622 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 16 07:42:27.023622 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Sep 16 07:42:27.023622 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 07:42:27.023622 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 07:42:27.023622 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 07:42:27.023622 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 07:42:27.023622 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 07:42:27.024703 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 07:42:27.024703 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 07:42:27.024703 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 07:42:27.024703 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 07:42:27.024703 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 07:42:27.024703 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 07:42:27.024703 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 16 07:42:27.024703 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 16 07:42:27.024703 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 16 07:42:27.024703 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 16 07:42:27.024703 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 07:42:27.024703 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 07:42:27.024703 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 07:42:27.024703 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 07:42:27.024703 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 07:42:27.024703 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 07:42:27.025589 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 07:42:27.025589 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application with Lock( Sep 16 07:42:27.025589 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 07:42:27.025589 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._enter() Sep 16 07:42:27.025589 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 07:42:27.025589 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 07:42:27.025589 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 07:42:27.025589 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.creator() Sep 16 07:42:27.025589 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 07:42:27.025589 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application created_value = creator( Sep 16 07:42:27.025589 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 16 07:42:27.025589 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 16 07:42:27.025589 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 16 07:42:27.025589 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Sep 16 07:42:27.029253 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 354/716] 10.222.0.57 () {56 vars in 1129 bytes} [Fri Sep 16 07:42:26 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 16 07:42:27.034688 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f273b4-c5ab-42ae-8a11-5b73d8da2421 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:42:27.040341 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:42:27.116619 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e783cf02-c76f-4e65-a745-2fae0d13f80c None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:42:27.194455 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b92c10-23d1-460e-a5c2-f4c4e2bc846c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:42:27.195078 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b92c10-23d1-460e-a5c2-f4c4e2bc846c None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:27.195350 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b92c10-23d1-460e-a5c2-f4c4e2bc846c None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:27.195616 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b92c10-23d1-460e-a5c2-f4c4e2bc846c None admin] PATH_INFO: `/v3/services` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:27.195715 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f273b4-c5ab-42ae-8a11-5b73d8da2421 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:42:27.196245 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b92c10-23d1-460e-a5c2-f4c4e2bc846c None admin] RBAC: Adding query filter params (type=network) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:42:27.196544 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b92c10-23d1-460e-a5c2-f4c4e2bc846c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:42:27.197921 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b92c10-23d1-460e-a5c2-f4c4e2bc846c None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:42:27.219737 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 363/717] 10.222.0.57 () {56 vars in 1112 bytes} [Fri Sep 16 07:42:26 2022] GET /identity/v3/services?type=network => generated 124 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 07:42:27.266619 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fd85d8-4a63-408a-a89f-cccaa650fd36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:42:27.267259 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fd85d8-4a63-408a-a89f-cccaa650fd36 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:27.267540 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fd85d8-4a63-408a-a89f-cccaa650fd36 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:27.267815 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fd85d8-4a63-408a-a89f-cccaa650fd36 None admin] PATH_INFO: `/v3/services` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:27.268466 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0fd85d8-4a63-408a-a89f-cccaa650fd36 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:42:27.268767 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0fd85d8-4a63-408a-a89f-cccaa650fd36 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:42:27.270187 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0fd85d8-4a63-408a-a89f-cccaa650fd36 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:42:27.278418 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 355/718] 10.222.0.57 () {56 vars in 1124 bytes} [Fri Sep 16 07:42:27 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:42:27.283867 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b92c10-23d1-460e-a5c2-f4c4e2bc846c None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:42:27.438820 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b92c10-23d1-460e-a5c2-f4c4e2bc846c None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:42:27.475217 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:42:27.488866 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833e6dee-0dd8-4db3-98e0-e658d933ca7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:42:27.489478 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833e6dee-0dd8-4db3-98e0-e658d933ca7d None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:27.489777 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833e6dee-0dd8-4db3-98e0-e658d933ca7d None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:27.490057 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833e6dee-0dd8-4db3-98e0-e658d933ca7d None admin] PATH_INFO: `/v3/services` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:27.490692 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833e6dee-0dd8-4db3-98e0-e658d933ca7d None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:42:27.490996 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833e6dee-0dd8-4db3-98e0-e658d933ca7d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:42:27.492355 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833e6dee-0dd8-4db3-98e0-e658d933ca7d None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:42:27.497609 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 364/719] 10.222.0.57 () {56 vars in 1124 bytes} [Fri Sep 16 07:42:27 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:42:28.945964 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fd05d9-038a-4a37-9c9a-9be0cb1e2e70 None None] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:28.946495 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fd05d9-038a-4a37-9c9a-9be0cb1e2e70 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:28.946495 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fd05d9-038a-4a37-9c9a-9be0cb1e2e70 None None] PATH_INFO: `/` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:28.948145 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 356/720] 10.222.0.57 () {54 vars in 927 bytes} [Fri Sep 16 07:42:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 07:42:28.954476 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea2ecd6-e638-4493-949a-fa851deecf5b None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:28.954948 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea2ecd6-e638-4493-949a-fa851deecf5b None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:28.955024 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea2ecd6-e638-4493-949a-fa851deecf5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:28.982768 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-5ea2ecd6-e638-4493-949a-fa851deecf5b None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:42:28.983991 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-5ea2ecd6-e638-4493-949a-fa851deecf5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:42:29.088422 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 365/721] 10.222.0.57 () {58 vars in 1024 bytes} [Fri Sep 16 07:42:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 07:42:29.235548 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c711e488-f4a1-4401-8288-22e4eb3e5cb2 None None] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:29.235848 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c711e488-f4a1-4401-8288-22e4eb3e5cb2 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:29.236027 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c711e488-f4a1-4401-8288-22e4eb3e5cb2 None None] PATH_INFO: `/` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:29.237610 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 357/722] 10.222.0.57 () {54 vars in 927 bytes} [Fri Sep 16 07:42:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 07:42:29.242416 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ced624-c903-4e26-9225-d92fba2d378f None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:29.242708 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ced624-c903-4e26-9225-d92fba2d378f None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:29.242985 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ced624-c903-4e26-9225-d92fba2d378f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:29.266144 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-a8ced624-c903-4e26-9225-d92fba2d378f None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:42:29.267331 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-a8ced624-c903-4e26-9225-d92fba2d378f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:42:29.368020 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 366/723] 10.222.0.57 () {58 vars in 1024 bytes} [Fri Sep 16 07:42:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 07:42:29.417251 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180f1550-9f72-434d-9b68-fd0eb6ba9292 None None] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:29.418439 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180f1550-9f72-434d-9b68-fd0eb6ba9292 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:29.419001 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180f1550-9f72-434d-9b68-fd0eb6ba9292 None None] PATH_INFO: `/` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:29.420797 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 358/724] 10.222.0.57 () {54 vars in 927 bytes} [Fri Sep 16 07:42:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 07:42:29.426508 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31214f2f-7fb2-4b95-ae91-8cc1ba78249c None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:29.426802 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31214f2f-7fb2-4b95-ae91-8cc1ba78249c None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:29.427080 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31214f2f-7fb2-4b95-ae91-8cc1ba78249c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:29.454767 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-31214f2f-7fb2-4b95-ae91-8cc1ba78249c None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:42:29.456219 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-31214f2f-7fb2-4b95-ae91-8cc1ba78249c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:42:29.524348 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:42:29.552103 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 367/725] 10.222.0.57 () {58 vars in 1024 bytes} [Fri Sep 16 07:42:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 07:42:29.565370 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180f1550-9f72-434d-9b68-fd0eb6ba9292 None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:42:29.641643 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:42:29.710391 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180f1550-9f72-434d-9b68-fd0eb6ba9292 None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:42:29.719224 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31214f2f-7fb2-4b95-ae91-8cc1ba78249c None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:42:29.766920 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea5aca0-7674-4ec4-83c0-2cd30749559c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:42:29.767562 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea5aca0-7674-4ec4-83c0-2cd30749559c None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:29.767948 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea5aca0-7674-4ec4-83c0-2cd30749559c None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:29.768410 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea5aca0-7674-4ec4-83c0-2cd30749559c None admin] PATH_INFO: `/v3/roles/service` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:29.793289 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea5aca0-7674-4ec4-83c0-2cd30749559c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 07:42:29.799078 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application [None req-1ea5aca0-7674-4ec4-83c0-2cd30749559c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 16 07:42:29.799078 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 07:42:29.799078 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 07:42:29.799078 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 07:42:29.799078 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 07:42:29.799078 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 07:42:29.799078 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 07:42:29.799078 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 07:42:29.799078 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 07:42:29.799078 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 07:42:29.799078 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 07:42:29.799078 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 07:42:29.799078 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 07:42:29.799078 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 07:42:29.799078 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 07:42:29.799078 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 07:42:29.799989 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 07:42:29.799989 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 07:42:29.799989 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 07:42:29.799989 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 07:42:29.799989 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 07:42:29.799989 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 07:42:29.799989 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 07:42:29.799989 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 07:42:29.799989 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 07:42:29.799989 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 07:42:29.799989 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 07:42:29.799989 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application with Lock( Sep 16 07:42:29.799989 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 07:42:29.799989 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._enter() Sep 16 07:42:29.799989 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 07:42:29.799989 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 07:42:29.800821 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 07:42:29.800821 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.creator() Sep 16 07:42:29.800821 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 07:42:29.800821 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application created_value = creator( Sep 16 07:42:29.800821 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 07:42:29.800821 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 07:42:29.800821 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 07:42:29.800821 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 07:42:29.800821 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 07:42:29.800821 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 07:42:29.800821 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 16 07:42:29.800821 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Sep 16 07:42:29.800821 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 359/726] 10.222.0.57 () {56 vars in 1102 bytes} [Fri Sep 16 07:42:29 2022] GET /identity/v3/roles/service => generated 85 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 07:42:29.805835 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea5aca0-7674-4ec4-83c0-2cd30749559c None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:42:29.873534 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31214f2f-7fb2-4b95-ae91-8cc1ba78249c None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:42:29.918355 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c205957-a771-4941-9f5a-5a90862a4fe5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:42:29.919256 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c205957-a771-4941-9f5a-5a90862a4fe5 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:29.919538 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c205957-a771-4941-9f5a-5a90862a4fe5 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:29.919810 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c205957-a771-4941-9f5a-5a90862a4fe5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:29.933437 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c205957-a771-4941-9f5a-5a90862a4fe5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 07:42:29.940642 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application [None req-9c205957-a771-4941-9f5a-5a90862a4fe5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 16 07:42:29.940642 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 07:42:29.940642 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 07:42:29.940642 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 07:42:29.940642 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 07:42:29.940642 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 07:42:29.940642 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 07:42:29.940642 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 07:42:29.940642 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 07:42:29.940642 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 07:42:29.940642 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 07:42:29.940642 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 07:42:29.940642 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 07:42:29.940642 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 07:42:29.940642 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 07:42:29.940642 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 07:42:29.941574 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 07:42:29.941574 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 07:42:29.941574 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 07:42:29.941574 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 07:42:29.941574 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 07:42:29.941574 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 07:42:29.941574 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 07:42:29.941574 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 07:42:29.941574 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 07:42:29.941574 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 07:42:29.941574 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 07:42:29.941574 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application with Lock( Sep 16 07:42:29.941574 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 07:42:29.941574 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._enter() Sep 16 07:42:29.941574 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 07:42:29.941574 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 07:42:29.942458 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 07:42:29.942458 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.creator() Sep 16 07:42:29.942458 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 07:42:29.942458 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application created_value = creator( Sep 16 07:42:29.942458 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 07:42:29.942458 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 07:42:29.942458 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 07:42:29.942458 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 07:42:29.942458 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 07:42:29.942458 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 07:42:29.942458 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 16 07:42:29.942458 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Sep 16 07:42:29.943975 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 368/727] 10.222.0.57 () {56 vars in 1096 bytes} [Fri Sep 16 07:42:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 07:42:29.945821 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c205957-a771-4941-9f5a-5a90862a4fe5 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:42:29.946426 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea5aca0-7674-4ec4-83c0-2cd30749559c None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:42:29.954382 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:42:29.989252 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fcde3a-e9b8-46e0-94b0-d92b546801e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:42:29.989869 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fcde3a-e9b8-46e0-94b0-d92b546801e9 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:29.990146 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fcde3a-e9b8-46e0-94b0-d92b546801e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:29.990414 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fcde3a-e9b8-46e0-94b0-d92b546801e9 None admin] PATH_INFO: `/v3/roles` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:29.991455 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91fcde3a-e9b8-46e0-94b0-d92b546801e9 None admin] RBAC: Adding query filter params (name=service) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:42:29.991455 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91fcde3a-e9b8-46e0-94b0-d92b546801e9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:42:29.992903 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91fcde3a-e9b8-46e0-94b0-d92b546801e9 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:42:30.003473 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 360/728] 10.222.0.57 () {56 vars in 1103 bytes} [Fri Sep 16 07:42:29 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 07:42:30.004058 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fcde3a-e9b8-46e0-94b0-d92b546801e9 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:42:30.006942 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:42:30.083400 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c205957-a771-4941-9f5a-5a90862a4fe5 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:42:30.123870 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fcde3a-e9b8-46e0-94b0-d92b546801e9 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:42:30.129410 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c7992a-c8cb-4d00-8ed4-c28a8513c2c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:42:30.130139 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c7992a-c8cb-4d00-8ed4-c28a8513c2c6 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:30.130665 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c7992a-c8cb-4d00-8ed4-c28a8513c2c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:30.130937 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c7992a-c8cb-4d00-8ed4-c28a8513c2c6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:30.143056 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c7992a-c8cb-4d00-8ed4-c28a8513c2c6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 07:42:30.147805 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application [None req-84c7992a-c8cb-4d00-8ed4-c28a8513c2c6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 16 07:42:30.147805 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 07:42:30.147805 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 07:42:30.147805 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 07:42:30.147805 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 07:42:30.147805 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 07:42:30.147805 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 07:42:30.147805 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 07:42:30.147805 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 07:42:30.147805 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 07:42:30.147805 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 07:42:30.147805 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 07:42:30.147805 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 07:42:30.147805 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 07:42:30.147805 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 07:42:30.147805 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 07:42:30.148962 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 07:42:30.148962 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 07:42:30.148962 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 07:42:30.148962 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 07:42:30.148962 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 07:42:30.148962 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 07:42:30.148962 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 07:42:30.148962 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 07:42:30.148962 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 07:42:30.148962 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 07:42:30.148962 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 07:42:30.148962 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application with Lock( Sep 16 07:42:30.148962 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 07:42:30.148962 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._enter() Sep 16 07:42:30.148962 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 07:42:30.148962 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 07:42:30.150081 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 07:42:30.150081 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.creator() Sep 16 07:42:30.150081 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 07:42:30.150081 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application created_value = creator( Sep 16 07:42:30.150081 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 07:42:30.150081 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 07:42:30.150081 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 07:42:30.150081 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 07:42:30.150081 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 07:42:30.150081 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 07:42:30.150081 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 16 07:42:30.150081 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Sep 16 07:42:30.150081 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 369/729] 10.222.0.57 () {56 vars in 1096 bytes} [Fri Sep 16 07:42:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 07:42:30.150081 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c7992a-c8cb-4d00-8ed4-c28a8513c2c6 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:42:30.162575 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e333af8c-9047-4638-a58a-ea997fd51929 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:42:30.163227 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e333af8c-9047-4638-a58a-ea997fd51929 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:30.163506 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e333af8c-9047-4638-a58a-ea997fd51929 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:30.163772 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e333af8c-9047-4638-a58a-ea997fd51929 None admin] PATH_INFO: `/v3/roles` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:30.164425 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e333af8c-9047-4638-a58a-ea997fd51929 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:42:30.164721 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e333af8c-9047-4638-a58a-ea997fd51929 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:42:30.166111 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e333af8c-9047-4638-a58a-ea997fd51929 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:42:30.175177 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 361/730] 10.222.0.57 () {56 vars in 1099 bytes} [Fri Sep 16 07:42:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:42:30.176356 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8bac28-b12a-467b-8f12-900279d75454 None None] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:30.176638 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8bac28-b12a-467b-8f12-900279d75454 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:30.176905 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8bac28-b12a-467b-8f12-900279d75454 None None] PATH_INFO: `/` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:30.178252 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 362/731] 10.222.0.57 () {54 vars in 927 bytes} [Fri Sep 16 07:42:30 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 07:42:30.178783 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8bac28-b12a-467b-8f12-900279d75454 None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:42:30.213541 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:42:30.260060 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:42:30.263835 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c7992a-c8cb-4d00-8ed4-c28a8513c2c6 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:42:30.292814 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8bac28-b12a-467b-8f12-900279d75454 None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:42:30.300096 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d66c37-812c-4fb6-a00b-2837eea18400 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:42:30.300714 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d66c37-812c-4fb6-a00b-2837eea18400 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:30.300987 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d66c37-812c-4fb6-a00b-2837eea18400 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:30.301253 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d66c37-812c-4fb6-a00b-2837eea18400 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:30.314421 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d66c37-812c-4fb6-a00b-2837eea18400 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:42:30.315854 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d66c37-812c-4fb6-a00b-2837eea18400 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:42:30.331627 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b848cf-bcb6-462e-8017-b070ff893807 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:42:30.332229 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b848cf-bcb6-462e-8017-b070ff893807 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:30.332507 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b848cf-bcb6-462e-8017-b070ff893807 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:30.332776 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b848cf-bcb6-462e-8017-b070ff893807 None admin] PATH_INFO: `/v3/roles` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:30.333479 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b848cf-bcb6-462e-8017-b070ff893807 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:42:30.333742 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b848cf-bcb6-462e-8017-b070ff893807 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:42:30.333841 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application [None req-a5d66c37-812c-4fb6-a00b-2837eea18400 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 07:42:30.333841 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 07:42:30.333841 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 07:42:30.333841 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 07:42:30.333841 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 07:42:30.333841 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 07:42:30.333841 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 07:42:30.333841 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 07:42:30.333841 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 07:42:30.333841 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 07:42:30.333841 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 07:42:30.333841 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 07:42:30.333841 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 07:42:30.333841 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 07:42:30.333841 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 07:42:30.333841 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 07:42:30.334732 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 07:42:30.334732 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 07:42:30.334732 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 07:42:30.334732 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 07:42:30.334732 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 07:42:30.334732 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 07:42:30.334732 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 07:42:30.334732 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application with Lock( Sep 16 07:42:30.334732 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 07:42:30.334732 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._enter() Sep 16 07:42:30.334732 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 07:42:30.334732 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 07:42:30.334732 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 07:42:30.334732 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.creator() Sep 16 07:42:30.334732 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 07:42:30.334732 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application created_value = creator( Sep 16 07:42:30.334732 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 07:42:30.336178 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 07:42:30.336178 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 07:42:30.336178 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Sep 16 07:42:30.336178 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 370/732] 10.222.0.57 () {56 vars in 1108 bytes} [Fri Sep 16 07:42:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 07:42:30.336178 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d66c37-812c-4fb6-a00b-2837eea18400 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:42:30.340238 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b848cf-bcb6-462e-8017-b070ff893807 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:42:30.348684 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 363/733] 10.222.0.57 () {56 vars in 1099 bytes} [Fri Sep 16 07:42:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:42:30.349904 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161bba99-7ad9-4ba7-a47a-b4feabb4aa37 None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:30.350185 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161bba99-7ad9-4ba7-a47a-b4feabb4aa37 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:30.350455 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161bba99-7ad9-4ba7-a47a-b4feabb4aa37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:30.369012 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-161bba99-7ad9-4ba7-a47a-b4feabb4aa37 None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:42:30.370321 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-161bba99-7ad9-4ba7-a47a-b4feabb4aa37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:42:30.441853 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 364/734] 10.222.0.57 () {58 vars in 1024 bytes} [Fri Sep 16 07:42:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 07:42:30.442748 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161bba99-7ad9-4ba7-a47a-b4feabb4aa37 None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:42:30.458451 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d66c37-812c-4fb6-a00b-2837eea18400 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:42:30.469763 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:42:30.507672 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5591849-34c8-4b3f-a284-8b09dd0a5d02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:42:30.508349 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5591849-34c8-4b3f-a284-8b09dd0a5d02 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:30.508628 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5591849-34c8-4b3f-a284-8b09dd0a5d02 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:30.508950 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5591849-34c8-4b3f-a284-8b09dd0a5d02 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:30.521949 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5591849-34c8-4b3f-a284-8b09dd0a5d02 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:42:30.523463 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5591849-34c8-4b3f-a284-8b09dd0a5d02 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:42:30.539921 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application [None req-c5591849-34c8-4b3f-a284-8b09dd0a5d02 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 07:42:30.539921 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 07:42:30.539921 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 07:42:30.539921 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 07:42:30.539921 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 07:42:30.539921 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 07:42:30.539921 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 07:42:30.539921 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 07:42:30.539921 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 07:42:30.539921 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 07:42:30.539921 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 07:42:30.539921 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 07:42:30.539921 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 07:42:30.539921 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 07:42:30.539921 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 07:42:30.539921 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 07:42:30.540889 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 07:42:30.540889 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 07:42:30.540889 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 07:42:30.540889 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 07:42:30.540889 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 07:42:30.540889 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 07:42:30.540889 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 07:42:30.540889 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application with Lock( Sep 16 07:42:30.540889 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 07:42:30.540889 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._enter() Sep 16 07:42:30.540889 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 07:42:30.540889 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 07:42:30.540889 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 07:42:30.540889 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.creator() Sep 16 07:42:30.540889 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 07:42:30.540889 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application created_value = creator( Sep 16 07:42:30.540889 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 07:42:30.541808 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 07:42:30.541808 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 07:42:30.541808 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Sep 16 07:42:30.541808 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 371/735] 10.222.0.57 () {56 vars in 1108 bytes} [Fri Sep 16 07:42:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 07:42:30.542560 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5591849-34c8-4b3f-a284-8b09dd0a5d02 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:42:30.547385 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:42:30.577300 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161bba99-7ad9-4ba7-a47a-b4feabb4aa37 None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:42:30.619415 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21c64cf-6e72-4480-a0d0-684beff76ec5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:42:30.620835 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21c64cf-6e72-4480-a0d0-684beff76ec5 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:30.621316 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21c64cf-6e72-4480-a0d0-684beff76ec5 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:30.621778 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21c64cf-6e72-4480-a0d0-684beff76ec5 None admin] PATH_INFO: `/v3/domains` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:30.622550 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21c64cf-6e72-4480-a0d0-684beff76ec5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:42:30.622850 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21c64cf-6e72-4480-a0d0-684beff76ec5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:42:30.624215 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21c64cf-6e72-4480-a0d0-684beff76ec5 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:42:30.636990 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 365/736] 10.222.0.57 () {56 vars in 1109 bytes} [Fri Sep 16 07:42:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:42:30.638073 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21c64cf-6e72-4480-a0d0-684beff76ec5 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:42:30.658552 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5591849-34c8-4b3f-a284-8b09dd0a5d02 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:42:30.696921 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5990d732-02ff-4b79-b203-39b79d0ca9ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:42:30.697865 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5990d732-02ff-4b79-b203-39b79d0ca9ea None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:30.698317 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5990d732-02ff-4b79-b203-39b79d0ca9ea None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:30.699729 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5990d732-02ff-4b79-b203-39b79d0ca9ea None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:30.711082 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5990d732-02ff-4b79-b203-39b79d0ca9ea None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:42:30.712507 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5990d732-02ff-4b79-b203-39b79d0ca9ea None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:42:30.719509 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:42:30.727631 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application [None req-5990d732-02ff-4b79-b203-39b79d0ca9ea None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 07:42:30.727631 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 07:42:30.727631 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 07:42:30.727631 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 07:42:30.727631 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 07:42:30.727631 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 07:42:30.727631 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 07:42:30.727631 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 07:42:30.727631 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 07:42:30.727631 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 07:42:30.727631 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 07:42:30.727631 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 07:42:30.727631 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 07:42:30.727631 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 07:42:30.727631 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 07:42:30.727631 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 07:42:30.728656 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 07:42:30.728656 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 07:42:30.728656 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 07:42:30.728656 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 07:42:30.728656 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 07:42:30.728656 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 07:42:30.728656 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 07:42:30.728656 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application with Lock( Sep 16 07:42:30.728656 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 07:42:30.728656 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._enter() Sep 16 07:42:30.728656 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 07:42:30.728656 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 07:42:30.728656 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 07:42:30.728656 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.creator() Sep 16 07:42:30.728656 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 07:42:30.728656 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application created_value = creator( Sep 16 07:42:30.728656 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 07:42:30.729554 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 07:42:30.729554 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 07:42:30.729554 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Sep 16 07:42:30.729554 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 372/737] 10.222.0.57 () {56 vars in 1108 bytes} [Fri Sep 16 07:42:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 07:42:30.730081 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab77c51a-b08b-41a3-8642-27b69ff46c88 None None] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:30.730359 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab77c51a-b08b-41a3-8642-27b69ff46c88 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:30.730632 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab77c51a-b08b-41a3-8642-27b69ff46c88 None None] PATH_INFO: `/` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:30.731838 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 373/738] 10.222.0.57 () {54 vars in 927 bytes} [Fri Sep 16 07:42:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 07:42:30.732571 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab77c51a-b08b-41a3-8642-27b69ff46c88 None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:42:30.742066 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21c64cf-6e72-4480-a0d0-684beff76ec5 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:42:30.777413 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444ee1d5-284e-444e-bc43-685e1101cc8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:42:30.778042 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444ee1d5-284e-444e-bc43-685e1101cc8e None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:30.778319 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444ee1d5-284e-444e-bc43-685e1101cc8e None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:30.778588 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444ee1d5-284e-444e-bc43-685e1101cc8e None admin] PATH_INFO: `/v3/domains` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:30.779214 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444ee1d5-284e-444e-bc43-685e1101cc8e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:42:30.779512 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444ee1d5-284e-444e-bc43-685e1101cc8e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:42:30.780861 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444ee1d5-284e-444e-bc43-685e1101cc8e None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:42:30.792066 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:42:30.797647 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 366/739] 10.222.0.57 () {56 vars in 1109 bytes} [Fri Sep 16 07:42:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:42:30.797647 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444ee1d5-284e-444e-bc43-685e1101cc8e None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:42:30.839689 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab77c51a-b08b-41a3-8642-27b69ff46c88 None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:42:30.873637 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62899bec-e3ae-48d4-bee9-310d5bd60b69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:42:30.874223 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62899bec-e3ae-48d4-bee9-310d5bd60b69 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:30.874504 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62899bec-e3ae-48d4-bee9-310d5bd60b69 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:30.874776 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62899bec-e3ae-48d4-bee9-310d5bd60b69 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:30.882943 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62899bec-e3ae-48d4-bee9-310d5bd60b69 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:42:30.884368 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62899bec-e3ae-48d4-bee9-310d5bd60b69 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:42:30.894228 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444ee1d5-284e-444e-bc43-685e1101cc8e None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:42:30.895210 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application [None req-62899bec-e3ae-48d4-bee9-310d5bd60b69 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 16 07:42:30.895210 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 07:42:30.895210 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 07:42:30.895210 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 07:42:30.895210 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 07:42:30.895210 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 07:42:30.895210 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 07:42:30.895210 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 07:42:30.895210 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 07:42:30.895210 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 07:42:30.895210 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 07:42:30.895210 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 07:42:30.895210 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 16 07:42:30.895210 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 16 07:42:30.895210 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 16 07:42:30.895210 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 16 07:42:30.896203 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 07:42:30.896203 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 07:42:30.896203 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 16 07:42:30.896203 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 07:42:30.896203 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 16 07:42:30.896203 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 07:42:30.896203 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 07:42:30.896203 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 07:42:30.896203 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 07:42:30.896203 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 07:42:30.896203 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 07:42:30.896203 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application with Lock( Sep 16 07:42:30.896203 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 07:42:30.896203 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._enter() Sep 16 07:42:30.896203 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 07:42:30.896203 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 07:42:30.896203 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 07:42:30.896203 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.creator() Sep 16 07:42:30.897145 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 07:42:30.897145 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application created_value = creator( Sep 16 07:42:30.897145 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 16 07:42:30.897145 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 16 07:42:30.897145 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 16 07:42:30.897145 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 16 07:42:30.897145 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 16 07:42:30.897145 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 16 07:42:30.897145 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 16 07:42:30.897145 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Sep 16 07:42:30.897145 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 374/740] 10.222.0.57 () {56 vars in 1117 bytes} [Fri Sep 16 07:42:30 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 07:42:30.897811 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62899bec-e3ae-48d4-bee9-310d5bd60b69 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:42:30.933428 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4005bd54-a335-4a94-a7d6-a5501b73824b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:42:30.934051 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4005bd54-a335-4a94-a7d6-a5501b73824b None admin] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:30.934415 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4005bd54-a335-4a94-a7d6-a5501b73824b None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:30.934681 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4005bd54-a335-4a94-a7d6-a5501b73824b None admin] PATH_INFO: `/v3/services` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:30.935307 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4005bd54-a335-4a94-a7d6-a5501b73824b None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:42:30.936652 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4005bd54-a335-4a94-a7d6-a5501b73824b None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:42:30.952173 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 367/741] 10.222.0.57 () {60 vars in 1141 bytes} [Fri Sep 16 07:42:30 2022] POST /identity/v3/services => generated 240 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 07:42:30.953433 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7c4db8-3c60-4c66-8dfa-efd8d4dfd590 None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:30.953740 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7c4db8-3c60-4c66-8dfa-efd8d4dfd590 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:30.954023 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7c4db8-3c60-4c66-8dfa-efd8d4dfd590 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:30.961580 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:42:30.983602 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-6d7c4db8-3c60-4c66-8dfa-efd8d4dfd590 None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:42:30.984932 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-6d7c4db8-3c60-4c66-8dfa-efd8d4dfd590 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:42:31.009320 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62899bec-e3ae-48d4-bee9-310d5bd60b69 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:42:31.028559 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:42:31.065003 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eba1044-499e-47cd-8d1a-01da3da89ab3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:42:31.065788 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eba1044-499e-47cd-8d1a-01da3da89ab3 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:31.066094 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eba1044-499e-47cd-8d1a-01da3da89ab3 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:31.066362 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eba1044-499e-47cd-8d1a-01da3da89ab3 None admin] PATH_INFO: `/v3/domains` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:31.067107 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eba1044-499e-47cd-8d1a-01da3da89ab3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:42:31.067413 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eba1044-499e-47cd-8d1a-01da3da89ab3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:42:31.068802 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eba1044-499e-47cd-8d1a-01da3da89ab3 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:42:31.071631 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 368/742] 10.222.0.57 () {58 vars in 1024 bytes} [Fri Sep 16 07:42:30 2022] POST /identity/v3/auth/tokens => generated 898 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 07:42:31.072606 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7c4db8-3c60-4c66-8dfa-efd8d4dfd590 None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:42:31.090980 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 375/743] 10.222.0.57 () {56 vars in 1109 bytes} [Fri Sep 16 07:42:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:42:31.095905 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eba1044-499e-47cd-8d1a-01da3da89ab3 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:42:31.205540 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7c4db8-3c60-4c66-8dfa-efd8d4dfd590 None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:42:31.223148 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eba1044-499e-47cd-8d1a-01da3da89ab3 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:42:31.234806 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:42:31.244140 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6505530-8379-455f-b008-7628a259f225 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:42:31.244773 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6505530-8379-455f-b008-7628a259f225 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:31.245049 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6505530-8379-455f-b008-7628a259f225 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:31.245343 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6505530-8379-455f-b008-7628a259f225 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:31.253522 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6505530-8379-455f-b008-7628a259f225 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:42:31.255039 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6505530-8379-455f-b008-7628a259f225 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:42:31.262838 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b75ac79-069e-4ba1-b882-6c27dfa7ff85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:42:31.263683 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b75ac79-069e-4ba1-b882-6c27dfa7ff85 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:31.264159 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b75ac79-069e-4ba1-b882-6c27dfa7ff85 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:31.264608 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b75ac79-069e-4ba1-b882-6c27dfa7ff85 None admin] PATH_INFO: `/v3/users` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:31.265562 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b75ac79-069e-4ba1-b882-6c27dfa7ff85 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:42:31.266078 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b75ac79-069e-4ba1-b882-6c27dfa7ff85 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:42:31.267710 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b75ac79-069e-4ba1-b882-6c27dfa7ff85 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:42:31.267819 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application [None req-c6505530-8379-455f-b008-7628a259f225 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 16 07:42:31.267819 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 07:42:31.267819 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 07:42:31.267819 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 07:42:31.267819 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 07:42:31.267819 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 07:42:31.267819 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 07:42:31.267819 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 07:42:31.267819 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 07:42:31.267819 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 07:42:31.267819 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 07:42:31.267819 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 07:42:31.267819 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 16 07:42:31.267819 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 16 07:42:31.267819 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 16 07:42:31.267819 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 16 07:42:31.268750 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 07:42:31.268750 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 07:42:31.268750 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 16 07:42:31.268750 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 07:42:31.268750 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 16 07:42:31.268750 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 07:42:31.268750 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 07:42:31.268750 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 07:42:31.268750 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 07:42:31.268750 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 07:42:31.268750 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 07:42:31.268750 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application with Lock( Sep 16 07:42:31.268750 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 07:42:31.268750 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._enter() Sep 16 07:42:31.268750 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 07:42:31.268750 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 07:42:31.268750 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 07:42:31.268750 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.creator() Sep 16 07:42:31.269702 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 07:42:31.269702 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application created_value = creator( Sep 16 07:42:31.269702 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 16 07:42:31.269702 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 16 07:42:31.269702 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 16 07:42:31.269702 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 16 07:42:31.269702 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 16 07:42:31.269702 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 16 07:42:31.269702 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 16 07:42:31.269702 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Sep 16 07:42:31.269702 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 369/744] 10.222.0.57 () {56 vars in 1093 bytes} [Fri Sep 16 07:42:31 2022] GET /identity/v3/users/nova => generated 82 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 07:42:31.270334 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6505530-8379-455f-b008-7628a259f225 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:42:31.291721 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 376/745] 10.222.0.57 () {56 vars in 1149 bytes} [Fri Sep 16 07:42:31 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:42:31.293743 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b75ac79-069e-4ba1-b882-6c27dfa7ff85 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:42:31.334374 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:42:31.384939 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6505530-8379-455f-b008-7628a259f225 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:42:31.419111 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca125a30-d2b2-4de5-8f08-ab489ea6b7d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:42:31.419736 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca125a30-d2b2-4de5-8f08-ab489ea6b7d9 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:31.420011 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca125a30-d2b2-4de5-8f08-ab489ea6b7d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:31.420279 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca125a30-d2b2-4de5-8f08-ab489ea6b7d9 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:31.427683 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca125a30-d2b2-4de5-8f08-ab489ea6b7d9 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:42:31.428725 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b75ac79-069e-4ba1-b882-6c27dfa7ff85 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:42:31.429106 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca125a30-d2b2-4de5-8f08-ab489ea6b7d9 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:42:31.440914 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application [None req-ca125a30-d2b2-4de5-8f08-ab489ea6b7d9 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 16 07:42:31.440914 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 07:42:31.440914 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 07:42:31.440914 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 07:42:31.440914 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 07:42:31.440914 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 07:42:31.440914 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 07:42:31.440914 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 07:42:31.440914 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 07:42:31.440914 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 07:42:31.440914 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 07:42:31.440914 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 07:42:31.440914 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 16 07:42:31.440914 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 16 07:42:31.440914 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 16 07:42:31.440914 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 16 07:42:31.442050 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 07:42:31.442050 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 07:42:31.442050 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 16 07:42:31.442050 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 07:42:31.442050 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 16 07:42:31.442050 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 07:42:31.442050 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 07:42:31.442050 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 07:42:31.442050 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 07:42:31.442050 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 07:42:31.442050 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 07:42:31.442050 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application with Lock( Sep 16 07:42:31.442050 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 07:42:31.442050 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._enter() Sep 16 07:42:31.442050 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 07:42:31.442050 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 07:42:31.442050 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 07:42:31.442050 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.creator() Sep 16 07:42:31.442987 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 07:42:31.442987 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application created_value = creator( Sep 16 07:42:31.442987 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 16 07:42:31.442987 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 16 07:42:31.442987 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 16 07:42:31.442987 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 16 07:42:31.442987 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 16 07:42:31.442987 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 16 07:42:31.442987 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 16 07:42:31.442987 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Sep 16 07:42:31.442987 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 370/746] 10.222.0.57 () {56 vars in 1096 bytes} [Fri Sep 16 07:42:31 2022] GET /identity/v3/users/swift => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 07:42:31.443572 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca125a30-d2b2-4de5-8f08-ab489ea6b7d9 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:42:31.471674 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7c208e-2e3e-43bd-85c8-a20c698ad541 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:42:31.472197 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7c208e-2e3e-43bd-85c8-a20c698ad541 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:31.472468 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7c208e-2e3e-43bd-85c8-a20c698ad541 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:31.472761 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7c208e-2e3e-43bd-85c8-a20c698ad541 None admin] PATH_INFO: `/v3/users` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:31.473544 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7c208e-2e3e-43bd-85c8-a20c698ad541 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:42:31.473865 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7c208e-2e3e-43bd-85c8-a20c698ad541 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:42:31.475180 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7c208e-2e3e-43bd-85c8-a20c698ad541 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:42:31.495667 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:42:31.498428 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 377/747] 10.222.0.57 () {56 vars in 1133 bytes} [Fri Sep 16 07:42:31 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:42:31.499887 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7c208e-2e3e-43bd-85c8-a20c698ad541 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:42:31.552179 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca125a30-d2b2-4de5-8f08-ab489ea6b7d9 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:42:31.587820 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f885b4-771a-47d3-a523-d149cf3739bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:42:31.588420 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f885b4-771a-47d3-a523-d149cf3739bf None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:31.588693 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f885b4-771a-47d3-a523-d149cf3739bf None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:31.589457 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f885b4-771a-47d3-a523-d149cf3739bf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:31.596792 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:42:31.609983 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7c208e-2e3e-43bd-85c8-a20c698ad541 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:42:31.646592 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202faa92-4ff0-4dc6-8e01-7f7c39995da4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:42:31.647192 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202faa92-4ff0-4dc6-8e01-7f7c39995da4 None admin] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:31.647467 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202faa92-4ff0-4dc6-8e01-7f7c39995da4 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:31.647733 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202faa92-4ff0-4dc6-8e01-7f7c39995da4 None admin] PATH_INFO: `/v3/services` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:31.648438 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202faa92-4ff0-4dc6-8e01-7f7c39995da4 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:42:31.649829 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202faa92-4ff0-4dc6-8e01-7f7c39995da4 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:42:31.664224 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f885b4-771a-47d3-a523-d149cf3739bf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:42:31.665785 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f885b4-771a-47d3-a523-d149cf3739bf None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:42:31.673779 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 378/748] 10.222.0.57 () {60 vars in 1141 bytes} [Fri Sep 16 07:42:31 2022] POST /identity/v3/services => generated 251 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 07:42:31.673779 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202faa92-4ff0-4dc6-8e01-7f7c39995da4 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:42:31.752853 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:42:31.798537 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202faa92-4ff0-4dc6-8e01-7f7c39995da4 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:42:31.841603 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdc3983-2f7a-418f-83e5-d528f4793e6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:42:31.842272 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdc3983-2f7a-418f-83e5-d528f4793e6b None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:31.842745 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdc3983-2f7a-418f-83e5-d528f4793e6b None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:31.842887 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdc3983-2f7a-418f-83e5-d528f4793e6b None admin] PATH_INFO: `/v3/users` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:31.843146 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 371/749] 10.222.0.57 () {58 vars in 1282 bytes} [Fri Sep 16 07:42:31 2022] GET /identity/v3/auth/tokens => generated 898 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 16 07:42:31.843572 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdc3983-2f7a-418f-83e5-d528f4793e6b None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:42:31.843860 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdc3983-2f7a-418f-83e5-d528f4793e6b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:42:31.845172 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f885b4-771a-47d3-a523-d149cf3739bf None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:42:31.845304 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdc3983-2f7a-418f-83e5-d528f4793e6b None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:42:31.870948 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 379/750] 10.222.0.57 () {56 vars in 1135 bytes} [Fri Sep 16 07:42:31 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:42:31.872380 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdc3983-2f7a-418f-83e5-d528f4793e6b None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:42:31.876317 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:42:31.978739 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f885b4-771a-47d3-a523-d149cf3739bf None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:42:32.006771 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdc3983-2f7a-418f-83e5-d528f4793e6b None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:42:32.015931 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d02092-324a-41f3-8d24-a6e91531e019 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:42:32.016560 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d02092-324a-41f3-8d24-a6e91531e019 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:32.016837 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d02092-324a-41f3-8d24-a6e91531e019 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:32.017105 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d02092-324a-41f3-8d24-a6e91531e019 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:32.028423 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d02092-324a-41f3-8d24-a6e91531e019 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:42:32.029988 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d02092-324a-41f3-8d24-a6e91531e019 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:42:32.039087 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:42:32.047046 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application [None req-86d02092-324a-41f3-8d24-a6e91531e019 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 07:42:32.047046 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 07:42:32.047046 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 07:42:32.047046 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 07:42:32.047046 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 07:42:32.047046 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 07:42:32.047046 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 07:42:32.047046 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 07:42:32.047046 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 07:42:32.047046 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 07:42:32.047046 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 07:42:32.047046 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 07:42:32.047046 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 07:42:32.047046 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 07:42:32.047046 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 07:42:32.047046 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 07:42:32.048163 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 07:42:32.048163 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 07:42:32.048163 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 07:42:32.048163 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 07:42:32.048163 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 07:42:32.048163 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 07:42:32.048163 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 07:42:32.048163 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application with Lock( Sep 16 07:42:32.048163 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 07:42:32.048163 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._enter() Sep 16 07:42:32.048163 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 07:42:32.048163 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 07:42:32.048163 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 07:42:32.048163 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.creator() Sep 16 07:42:32.048163 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 07:42:32.048163 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application created_value = creator( Sep 16 07:42:32.048163 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 07:42:32.049255 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 07:42:32.049255 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 07:42:32.049255 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Sep 16 07:42:32.053790 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 372/751] 10.222.0.57 () {56 vars in 1108 bytes} [Fri Sep 16 07:42:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 07:42:32.054733 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d02092-324a-41f3-8d24-a6e91531e019 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:42:32.059065 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b353777a-7ec2-4b95-a6a9-bca2913454b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:42:32.060527 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b353777a-7ec2-4b95-a6a9-bca2913454b0 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:32.061969 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b353777a-7ec2-4b95-a6a9-bca2913454b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:32.062415 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b353777a-7ec2-4b95-a6a9-bca2913454b0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:32.076183 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b353777a-7ec2-4b95-a6a9-bca2913454b0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:42:32.078501 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b353777a-7ec2-4b95-a6a9-bca2913454b0 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:42:32.098324 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application [None req-b353777a-7ec2-4b95-a6a9-bca2913454b0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 07:42:32.098324 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 07:42:32.098324 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 07:42:32.098324 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 07:42:32.098324 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 07:42:32.098324 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 07:42:32.098324 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 07:42:32.098324 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 07:42:32.098324 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 07:42:32.098324 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 07:42:32.098324 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 07:42:32.098324 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 07:42:32.098324 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 07:42:32.098324 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 07:42:32.098324 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 07:42:32.098324 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 07:42:32.099481 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 07:42:32.099481 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 07:42:32.099481 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 07:42:32.099481 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 07:42:32.099481 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 07:42:32.099481 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 07:42:32.099481 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 07:42:32.099481 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application with Lock( Sep 16 07:42:32.099481 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 07:42:32.099481 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._enter() Sep 16 07:42:32.099481 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 07:42:32.099481 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 07:42:32.099481 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 07:42:32.099481 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.creator() Sep 16 07:42:32.099481 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 07:42:32.099481 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application created_value = creator( Sep 16 07:42:32.099481 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 07:42:32.100377 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 07:42:32.100377 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 07:42:32.100377 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Sep 16 07:42:32.100892 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 380/752] 10.222.0.57 () {56 vars in 1108 bytes} [Fri Sep 16 07:42:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 07:42:32.101944 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b353777a-7ec2-4b95-a6a9-bca2913454b0 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:42:32.166957 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:42:32.181890 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d02092-324a-41f3-8d24-a6e91531e019 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:42:32.217307 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b353777a-7ec2-4b95-a6a9-bca2913454b0 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:42:32.221259 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b7669b-fdcf-46b4-8a6c-c16b7e68ff59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:42:32.221679 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b7669b-fdcf-46b4-8a6c-c16b7e68ff59 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:32.221985 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b7669b-fdcf-46b4-8a6c-c16b7e68ff59 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:32.222253 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b7669b-fdcf-46b4-8a6c-c16b7e68ff59 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:32.258002 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016b6ff3-d2c9-42b2-8c79-0714e084d54f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:42:32.259876 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016b6ff3-d2c9-42b2-8c79-0714e084d54f None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:32.260392 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016b6ff3-d2c9-42b2-8c79-0714e084d54f None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:32.260907 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016b6ff3-d2c9-42b2-8c79-0714e084d54f None admin] PATH_INFO: `/v3/domains` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:32.261801 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016b6ff3-d2c9-42b2-8c79-0714e084d54f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:42:32.262326 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016b6ff3-d2c9-42b2-8c79-0714e084d54f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:42:32.264410 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016b6ff3-d2c9-42b2-8c79-0714e084d54f None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:42:32.280369 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 381/753] 10.222.0.57 () {56 vars in 1109 bytes} [Fri Sep 16 07:42:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:42:32.282139 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016b6ff3-d2c9-42b2-8c79-0714e084d54f None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:42:32.293584 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:42:32.296058 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b7669b-fdcf-46b4-8a6c-c16b7e68ff59 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:42:32.297547 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b7669b-fdcf-46b4-8a6c-c16b7e68ff59 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:42:32.405927 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 373/754] 10.222.0.57 () {58 vars in 1282 bytes} [Fri Sep 16 07:42:32 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 16 07:42:32.406948 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b7669b-fdcf-46b4-8a6c-c16b7e68ff59 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:42:32.415164 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016b6ff3-d2c9-42b2-8c79-0714e084d54f None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:42:32.435478 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:42:32.466066 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383be5a8-106d-4000-a50b-b829f9c68f4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:42:32.466744 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383be5a8-106d-4000-a50b-b829f9c68f4e None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:32.467028 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383be5a8-106d-4000-a50b-b829f9c68f4e None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:32.467304 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383be5a8-106d-4000-a50b-b829f9c68f4e None admin] PATH_INFO: `/v3/domains` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:32.468061 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383be5a8-106d-4000-a50b-b829f9c68f4e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:42:32.468373 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383be5a8-106d-4000-a50b-b829f9c68f4e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:42:32.469764 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383be5a8-106d-4000-a50b-b829f9c68f4e None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:42:32.482740 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 382/755] 10.222.0.57 () {56 vars in 1109 bytes} [Fri Sep 16 07:42:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:42:32.483582 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383be5a8-106d-4000-a50b-b829f9c68f4e None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:42:32.515040 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:42:32.517882 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b7669b-fdcf-46b4-8a6c-c16b7e68ff59 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:42:32.555954 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275a7f49-f8b3-437f-b804-076e381d3640 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:42:32.556666 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275a7f49-f8b3-437f-b804-076e381d3640 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:32.557081 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275a7f49-f8b3-437f-b804-076e381d3640 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:32.557425 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275a7f49-f8b3-437f-b804-076e381d3640 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:32.565504 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275a7f49-f8b3-437f-b804-076e381d3640 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:42:32.567074 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275a7f49-f8b3-437f-b804-076e381d3640 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:42:32.579035 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application [None req-275a7f49-f8b3-437f-b804-076e381d3640 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 07:42:32.579035 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 07:42:32.579035 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 07:42:32.579035 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 07:42:32.579035 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 07:42:32.579035 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 07:42:32.579035 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 07:42:32.579035 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 07:42:32.579035 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 07:42:32.579035 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 07:42:32.579035 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 07:42:32.579035 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 07:42:32.579035 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 16 07:42:32.579035 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 16 07:42:32.579035 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 16 07:42:32.580147 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 16 07:42:32.580147 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 07:42:32.580147 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 07:42:32.580147 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 07:42:32.580147 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 07:42:32.580147 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 07:42:32.580147 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 07:42:32.580147 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 07:42:32.580147 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application with Lock( Sep 16 07:42:32.580147 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 07:42:32.580147 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._enter() Sep 16 07:42:32.580147 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 07:42:32.580147 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 07:42:32.580147 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 07:42:32.580147 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.creator() Sep 16 07:42:32.580147 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 07:42:32.580147 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application created_value = creator( Sep 16 07:42:32.581370 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 16 07:42:32.581370 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 16 07:42:32.581370 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 16 07:42:32.581370 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 16 07:42:32.581370 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 16 07:42:32.581370 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 16 07:42:32.581370 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 07:42:32.581370 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Sep 16 07:42:32.586551 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 374/756] 10.222.0.57 () {56 vars in 1111 bytes} [Fri Sep 16 07:42:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 07:42:32.587071 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275a7f49-f8b3-437f-b804-076e381d3640 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:42:32.599473 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383be5a8-106d-4000-a50b-b829f9c68f4e None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:42:32.639021 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754079c5-465f-4d5e-9e8c-6d8f0d1cba38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:42:32.640510 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754079c5-465f-4d5e-9e8c-6d8f0d1cba38 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:32.640977 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754079c5-465f-4d5e-9e8c-6d8f0d1cba38 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:32.641410 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754079c5-465f-4d5e-9e8c-6d8f0d1cba38 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:32.656801 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754079c5-465f-4d5e-9e8c-6d8f0d1cba38 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:42:32.659436 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754079c5-465f-4d5e-9e8c-6d8f0d1cba38 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:42:32.679294 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application [None req-754079c5-465f-4d5e-9e8c-6d8f0d1cba38 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 07:42:32.679294 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 07:42:32.679294 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 07:42:32.679294 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 07:42:32.679294 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 07:42:32.679294 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 07:42:32.679294 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 07:42:32.679294 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 07:42:32.679294 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 07:42:32.679294 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 07:42:32.679294 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 07:42:32.679294 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 07:42:32.679294 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 07:42:32.679294 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 07:42:32.679294 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 07:42:32.679294 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 07:42:32.680512 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 07:42:32.680512 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 07:42:32.680512 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 07:42:32.680512 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 07:42:32.680512 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 07:42:32.680512 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 07:42:32.680512 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 07:42:32.680512 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application with Lock( Sep 16 07:42:32.680512 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 07:42:32.680512 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._enter() Sep 16 07:42:32.680512 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 07:42:32.680512 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 07:42:32.680512 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 07:42:32.680512 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.creator() Sep 16 07:42:32.680512 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 07:42:32.680512 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application created_value = creator( Sep 16 07:42:32.680512 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 07:42:32.681542 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 07:42:32.681542 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 07:42:32.681542 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Sep 16 07:42:32.688455 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 383/757] 10.222.0.57 () {56 vars in 1108 bytes} [Fri Sep 16 07:42:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 07:42:32.688455 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754079c5-465f-4d5e-9e8c-6d8f0d1cba38 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:42:32.704400 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275a7f49-f8b3-437f-b804-076e381d3640 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:42:32.717213 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:42:32.752821 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda24f54-c8ee-4074-9a4c-02693d83ecad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:42:32.753861 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda24f54-c8ee-4074-9a4c-02693d83ecad None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:32.754580 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda24f54-c8ee-4074-9a4c-02693d83ecad None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:32.755530 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda24f54-c8ee-4074-9a4c-02693d83ecad None admin] PATH_INFO: `/v3/projects/service` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:32.764571 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda24f54-c8ee-4074-9a4c-02693d83ecad None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:42:32.767252 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda24f54-c8ee-4074-9a4c-02693d83ecad None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:42:32.783313 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application [None req-fda24f54-c8ee-4074-9a4c-02693d83ecad None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 07:42:32.783313 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 07:42:32.783313 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 07:42:32.783313 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 07:42:32.783313 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 07:42:32.783313 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 07:42:32.783313 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 07:42:32.783313 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 07:42:32.783313 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 07:42:32.783313 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 07:42:32.783313 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 07:42:32.783313 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 07:42:32.783313 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 16 07:42:32.783313 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 16 07:42:32.783313 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 16 07:42:32.784421 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 16 07:42:32.784421 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 07:42:32.784421 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 07:42:32.784421 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 07:42:32.784421 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 07:42:32.784421 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 07:42:32.784421 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 07:42:32.784421 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 07:42:32.784421 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application with Lock( Sep 16 07:42:32.784421 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 07:42:32.784421 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._enter() Sep 16 07:42:32.784421 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 07:42:32.784421 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 07:42:32.784421 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 07:42:32.784421 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.creator() Sep 16 07:42:32.784421 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 07:42:32.784421 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application created_value = creator( Sep 16 07:42:32.785529 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 16 07:42:32.785529 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 16 07:42:32.785529 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 16 07:42:32.785529 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 16 07:42:32.785529 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 16 07:42:32.785529 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 16 07:42:32.785529 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 07:42:32.785529 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Sep 16 07:42:32.788227 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 375/758] 10.222.0.57 () {56 vars in 1111 bytes} [Fri Sep 16 07:42:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 07:42:32.789174 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda24f54-c8ee-4074-9a4c-02693d83ecad None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:42:32.800406 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754079c5-465f-4d5e-9e8c-6d8f0d1cba38 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:42:32.819174 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:42:32.837073 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9428e07-becf-45d6-894a-57cc9be2094e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:42:32.837750 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9428e07-becf-45d6-894a-57cc9be2094e None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:32.838126 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9428e07-becf-45d6-894a-57cc9be2094e None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:32.838493 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9428e07-becf-45d6-894a-57cc9be2094e None admin] PATH_INFO: `/v3/projects` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:32.839810 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9428e07-becf-45d6-894a-57cc9be2094e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:42:32.840211 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9428e07-becf-45d6-894a-57cc9be2094e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:42:32.841734 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9428e07-becf-45d6-894a-57cc9be2094e None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:42:32.860292 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 384/759] 10.222.0.57 () {56 vars in 1148 bytes} [Fri Sep 16 07:42:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:42:32.861304 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9428e07-becf-45d6-894a-57cc9be2094e None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:42:32.924948 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda24f54-c8ee-4074-9a4c-02693d83ecad None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:42:32.959718 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6e2044-55fe-4122-8536-61afd7696f60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:42:32.960504 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6e2044-55fe-4122-8536-61afd7696f60 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:32.960888 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6e2044-55fe-4122-8536-61afd7696f60 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:32.961243 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6e2044-55fe-4122-8536-61afd7696f60 None admin] PATH_INFO: `/v3/domains` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:32.962079 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6e2044-55fe-4122-8536-61afd7696f60 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:42:32.962475 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6e2044-55fe-4122-8536-61afd7696f60 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:42:32.963316 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:42:32.965893 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6e2044-55fe-4122-8536-61afd7696f60 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:42:32.979747 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 376/760] 10.222.0.57 () {56 vars in 1109 bytes} [Fri Sep 16 07:42:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:42:32.981407 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6e2044-55fe-4122-8536-61afd7696f60 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:42:32.987334 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9428e07-becf-45d6-894a-57cc9be2094e None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:42:33.038085 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8164625a-5843-42ac-ae94-645f1cffdf55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:42:33.039184 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8164625a-5843-42ac-ae94-645f1cffdf55 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:33.039959 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8164625a-5843-42ac-ae94-645f1cffdf55 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:33.040458 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8164625a-5843-42ac-ae94-645f1cffdf55 None admin] PATH_INFO: `/v3/projects` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:33.041370 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8164625a-5843-42ac-ae94-645f1cffdf55 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:42:33.042034 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8164625a-5843-42ac-ae94-645f1cffdf55 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:42:33.044670 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8164625a-5843-42ac-ae94-645f1cffdf55 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:42:33.065072 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 385/761] 10.222.0.57 () {56 vars in 1148 bytes} [Fri Sep 16 07:42:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:42:33.066719 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8164625a-5843-42ac-ae94-645f1cffdf55 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:42:33.149192 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:42:33.202105 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8164625a-5843-42ac-ae94-645f1cffdf55 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:42:33.235756 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6e2044-55fe-4122-8536-61afd7696f60 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:42:33.247615 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29d1ed6-5f4a-4969-922d-ef1cd63ce1c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:42:33.248534 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29d1ed6-5f4a-4969-922d-ef1cd63ce1c1 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:33.249174 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29d1ed6-5f4a-4969-922d-ef1cd63ce1c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:33.249666 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29d1ed6-5f4a-4969-922d-ef1cd63ce1c1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:33.257372 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29d1ed6-5f4a-4969-922d-ef1cd63ce1c1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:42:33.259126 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29d1ed6-5f4a-4969-922d-ef1cd63ce1c1 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:42:33.271797 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application [None req-e29d1ed6-5f4a-4969-922d-ef1cd63ce1c1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 07:42:33.271797 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 07:42:33.271797 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 07:42:33.271797 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 07:42:33.271797 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 07:42:33.271797 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 07:42:33.271797 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 07:42:33.271797 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 07:42:33.271797 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 07:42:33.271797 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 07:42:33.271797 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 07:42:33.271797 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 07:42:33.271797 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 16 07:42:33.271797 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 16 07:42:33.271797 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 16 07:42:33.272711 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 16 07:42:33.272711 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 07:42:33.272711 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 07:42:33.272711 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 07:42:33.272711 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 07:42:33.272711 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 07:42:33.272711 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 07:42:33.272711 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 07:42:33.272711 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application with Lock( Sep 16 07:42:33.272711 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 07:42:33.272711 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._enter() Sep 16 07:42:33.272711 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 07:42:33.272711 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 07:42:33.272711 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 07:42:33.272711 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.creator() Sep 16 07:42:33.272711 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 07:42:33.272711 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application created_value = creator( Sep 16 07:42:33.273613 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 16 07:42:33.273613 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 16 07:42:33.273613 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 16 07:42:33.273613 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 16 07:42:33.273613 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 16 07:42:33.273613 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 16 07:42:33.273613 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 07:42:33.273613 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Sep 16 07:42:33.280831 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 386/762] 10.222.0.57 () {56 vars in 1111 bytes} [Fri Sep 16 07:42:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 07:42:33.281995 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29d1ed6-5f4a-4969-922d-ef1cd63ce1c1 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:42:33.302176 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:42:33.333650 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a810fbbc-85af-4feb-9c5c-dc585a04735d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:42:33.334347 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a810fbbc-85af-4feb-9c5c-dc585a04735d None admin] REQUEST_METHOD: `PUT` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:33.334627 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a810fbbc-85af-4feb-9c5c-dc585a04735d None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:33.334901 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a810fbbc-85af-4feb-9c5c-dc585a04735d None admin] PATH_INFO: `/v3/projects/4735f453c0c24cc4a1c14e9ac84a0b46/users/9bec4d9b08514461a1bf63c6b88f53b2/roles/567db03c91854ad9af1e9a87ec1bd275` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:33.336827 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a810fbbc-85af-4feb-9c5c-dc585a04735d None admin] RBAC: Authorizing `identity:create_grant(project_id=4735f453c0c24cc4a1c14e9ac84a0b46, user_id=9bec4d9b08514461a1bf63c6b88f53b2, role_id=567db03c91854ad9af1e9a87ec1bd275)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:42:33.338306 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a810fbbc-85af-4feb-9c5c-dc585a04735d None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:42:33.357545 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 377/763] 10.222.0.57 () {58 vars in 1439 bytes} [Fri Sep 16 07:42:32 2022] PUT /identity/v3/projects/4735f453c0c24cc4a1c14e9ac84a0b46/users/9bec4d9b08514461a1bf63c6b88f53b2/roles/567db03c91854ad9af1e9a87ec1bd275 => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 07:42:33.363989 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a810fbbc-85af-4feb-9c5c-dc585a04735d None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:42:33.410601 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29d1ed6-5f4a-4969-922d-ef1cd63ce1c1 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:42:33.458811 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04606a3f-e4c2-46b4-bdca-00d974b1dc6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:42:33.459799 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04606a3f-e4c2-46b4-bdca-00d974b1dc6a None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:33.460320 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04606a3f-e4c2-46b4-bdca-00d974b1dc6a None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:33.461411 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04606a3f-e4c2-46b4-bdca-00d974b1dc6a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:33.462774 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04606a3f-e4c2-46b4-bdca-00d974b1dc6a None admin] RBAC: Adding query filter params (role.id=f59220af7e7f4a8dbc30ba6325c7827c, scope.project.id=4735f453c0c24cc4a1c14e9ac84a0b46, user.id=56eb9bbabb65436bb095952159df184c) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:42:33.463304 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04606a3f-e4c2-46b4-bdca-00d974b1dc6a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:42:33.466657 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04606a3f-e4c2-46b4-bdca-00d974b1dc6a None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:42:33.480317 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 387/764] 10.222.0.57 () {56 vars in 1374 bytes} [Fri Sep 16 07:42:33 2022] GET /identity/v3/role_assignments?user.id=56eb9bbabb65436bb095952159df184c&scope.project.id=4735f453c0c24cc4a1c14e9ac84a0b46&role.id=f59220af7e7f4a8dbc30ba6325c7827c => generated 259 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:42:33.482582 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdda4cf-3a72-4dfc-8c69-c1dd2b1c53f6 None None] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:33.483123 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdda4cf-3a72-4dfc-8c69-c1dd2b1c53f6 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:33.483603 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdda4cf-3a72-4dfc-8c69-c1dd2b1c53f6 None None] PATH_INFO: `/` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:33.491662 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 388/765] 10.222.0.57 () {54 vars in 927 bytes} [Fri Sep 16 07:42:33 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 07:42:33.499478 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf88618-97d9-446a-a2ac-f79dd1f7c3f9 None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:33.500125 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf88618-97d9-446a-a2ac-f79dd1f7c3f9 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:33.500633 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf88618-97d9-446a-a2ac-f79dd1f7c3f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:33.556570 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-cbf88618-97d9-446a-a2ac-f79dd1f7c3f9 None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:42:33.560176 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-cbf88618-97d9-446a-a2ac-f79dd1f7c3f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:42:33.613751 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a810fbbc-85af-4feb-9c5c-dc585a04735d None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:42:33.688533 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5415de40-38f0-415a-99ff-805f33070952 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:42:33.689204 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5415de40-38f0-415a-99ff-805f33070952 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:33.689490 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5415de40-38f0-415a-99ff-805f33070952 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:33.689779 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5415de40-38f0-415a-99ff-805f33070952 None admin] PATH_INFO: `/v3/projects` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:33.690483 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5415de40-38f0-415a-99ff-805f33070952 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:42:33.690788 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5415de40-38f0-415a-99ff-805f33070952 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:42:33.692232 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5415de40-38f0-415a-99ff-805f33070952 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:42:33.697140 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:42:33.706470 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 389/766] 10.222.0.57 () {58 vars in 1024 bytes} [Fri Sep 16 07:42:33 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 16 07:42:33.712297 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 378/767] 10.222.0.57 () {56 vars in 1148 bytes} [Fri Sep 16 07:42:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 354 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:42:33.712603 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:42:33.719128 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf88618-97d9-446a-a2ac-f79dd1f7c3f9 None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:42:33.853405 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf88618-97d9-446a-a2ac-f79dd1f7c3f9 None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:42:33.901909 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b934573-f8ec-459c-86cf-e9beb857cdcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:42:33.902534 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b934573-f8ec-459c-86cf-e9beb857cdcc None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:33.902815 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b934573-f8ec-459c-86cf-e9beb857cdcc None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:33.903085 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b934573-f8ec-459c-86cf-e9beb857cdcc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:33.903820 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b934573-f8ec-459c-86cf-e9beb857cdcc None admin] RBAC: Adding query filter params (role.id=567db03c91854ad9af1e9a87ec1bd275, scope.project.id=4735f453c0c24cc4a1c14e9ac84a0b46, user.id=38abb0283b41449d8183b88912f2574a) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:42:33.904133 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b934573-f8ec-459c-86cf-e9beb857cdcc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:42:33.905560 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b934573-f8ec-459c-86cf-e9beb857cdcc None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:42:33.911479 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 390/768] 10.222.0.57 () {56 vars in 1374 bytes} [Fri Sep 16 07:42:33 2022] GET /identity/v3/role_assignments?user.id=38abb0283b41449d8183b88912f2574a&scope.project.id=4735f453c0c24cc4a1c14e9ac84a0b46&role.id=567db03c91854ad9af1e9a87ec1bd275 => generated 259 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:42:34.059751 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5415de40-38f0-415a-99ff-805f33070952 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:42:34.200461 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2306a709-901e-4d18-8cfe-ca2628cefc84 None None] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:34.200982 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2306a709-901e-4d18-8cfe-ca2628cefc84 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:34.200982 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2306a709-901e-4d18-8cfe-ca2628cefc84 None None] PATH_INFO: `/` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:34.202479 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 391/769] 10.222.0.57 () {54 vars in 927 bytes} [Fri Sep 16 07:42:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 07:42:34.208059 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d72bf92-fe90-4db5-9f17-10f81814a247 None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:34.208619 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d72bf92-fe90-4db5-9f17-10f81814a247 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:34.209099 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d72bf92-fe90-4db5-9f17-10f81814a247 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:34.232685 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-1d72bf92-fe90-4db5-9f17-10f81814a247 None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:42:34.234220 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5415de40-38f0-415a-99ff-805f33070952 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:42:34.234630 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-1d72bf92-fe90-4db5-9f17-10f81814a247 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:42:34.303071 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14b2a03-908a-47f9-b7f5-0d66d84c7ae8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:42:34.308812 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14b2a03-908a-47f9-b7f5-0d66d84c7ae8 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:34.309327 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14b2a03-908a-47f9-b7f5-0d66d84c7ae8 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:34.309832 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14b2a03-908a-47f9-b7f5-0d66d84c7ae8 None admin] PATH_INFO: `/v3/services/network` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:34.310648 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14b2a03-908a-47f9-b7f5-0d66d84c7ae8 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:42:34.312294 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14b2a03-908a-47f9-b7f5-0d66d84c7ae8 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:42:34.328708 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application [None req-d14b2a03-908a-47f9-b7f5-0d66d84c7ae8 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 16 07:42:34.328708 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 07:42:34.328708 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 16 07:42:34.328708 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 16 07:42:34.328708 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 16 07:42:34.328708 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 16 07:42:34.328708 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 16 07:42:34.328708 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 16 07:42:34.328708 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 16 07:42:34.328708 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Sep 16 07:42:34.328708 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 16 07:42:34.328708 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Sep 16 07:42:34.328708 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 07:42:34.328708 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 07:42:34.328708 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 07:42:34.328708 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 07:42:34.328708 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 07:42:34.329782 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 07:42:34.329782 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 07:42:34.329782 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 07:42:34.329782 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 07:42:34.329782 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 07:42:34.329782 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 07:42:34.329782 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 16 07:42:34.329782 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 16 07:42:34.329782 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 16 07:42:34.329782 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 16 07:42:34.329782 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 07:42:34.329782 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 07:42:34.329782 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 07:42:34.329782 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 07:42:34.329782 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 07:42:34.329782 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 07:42:34.330636 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 07:42:34.330636 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application with Lock( Sep 16 07:42:34.330636 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 07:42:34.330636 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._enter() Sep 16 07:42:34.330636 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 07:42:34.330636 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 07:42:34.330636 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 07:42:34.330636 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.creator() Sep 16 07:42:34.330636 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 07:42:34.330636 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application created_value = creator( Sep 16 07:42:34.330636 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 16 07:42:34.330636 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 16 07:42:34.330636 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 16 07:42:34.330636 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Sep 16 07:42:34.335118 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 379/770] 10.222.0.57 () {56 vars in 1111 bytes} [Fri Sep 16 07:42:34 2022] GET /identity/v3/services/network => generated 88 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 07:42:34.341763 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14b2a03-908a-47f9-b7f5-0d66d84c7ae8 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:42:34.357092 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:42:34.361624 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 392/771] 10.222.0.57 () {58 vars in 1024 bytes} [Fri Sep 16 07:42:34 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 16 07:42:34.443962 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:42:34.497361 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14b2a03-908a-47f9-b7f5-0d66d84c7ae8 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:42:34.534304 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2de7f72-c311-46d8-ac32-1fdf8da02600 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:42:34.535256 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2de7f72-c311-46d8-ac32-1fdf8da02600 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:34.535740 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2de7f72-c311-46d8-ac32-1fdf8da02600 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:34.536230 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2de7f72-c311-46d8-ac32-1fdf8da02600 None admin] PATH_INFO: `/v3/services` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:34.537090 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2de7f72-c311-46d8-ac32-1fdf8da02600 None admin] RBAC: Adding query filter params (name=network) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:42:34.537595 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2de7f72-c311-46d8-ac32-1fdf8da02600 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:42:34.539195 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2de7f72-c311-46d8-ac32-1fdf8da02600 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:42:34.544491 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 380/772] 10.222.0.57 () {56 vars in 1112 bytes} [Fri Sep 16 07:42:34 2022] GET /identity/v3/services?name=network => generated 124 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 07:42:34.549888 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d72bf92-fe90-4db5-9f17-10f81814a247 None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:42:34.667991 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2de7f72-c311-46d8-ac32-1fdf8da02600 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:42:34.737836 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d72bf92-fe90-4db5-9f17-10f81814a247 None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:42:34.778839 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2de7f72-c311-46d8-ac32-1fdf8da02600 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:42:34.810114 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:42:34.818335 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977ff83a-bcac-42d9-8513-9546f5a6b884 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:42:34.819254 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977ff83a-bcac-42d9-8513-9546f5a6b884 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:34.819782 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977ff83a-bcac-42d9-8513-9546f5a6b884 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:34.820264 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977ff83a-bcac-42d9-8513-9546f5a6b884 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:34.821039 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977ff83a-bcac-42d9-8513-9546f5a6b884 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:42:34.822754 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977ff83a-bcac-42d9-8513-9546f5a6b884 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:42:34.832354 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application [None req-977ff83a-bcac-42d9-8513-9546f5a6b884 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 16 07:42:34.832354 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 07:42:34.832354 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 16 07:42:34.832354 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 16 07:42:34.832354 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 16 07:42:34.832354 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 16 07:42:34.832354 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 16 07:42:34.832354 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 16 07:42:34.832354 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 16 07:42:34.832354 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Sep 16 07:42:34.832354 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 16 07:42:34.832354 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Sep 16 07:42:34.832354 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 07:42:34.832354 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 07:42:34.832354 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 07:42:34.832354 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 07:42:34.832354 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 07:42:34.833358 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 07:42:34.833358 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 07:42:34.833358 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 07:42:34.833358 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 07:42:34.833358 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 07:42:34.833358 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 07:42:34.833358 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 16 07:42:34.833358 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 16 07:42:34.833358 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 16 07:42:34.833358 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 16 07:42:34.833358 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 07:42:34.833358 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 07:42:34.833358 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 07:42:34.833358 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 07:42:34.833358 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 07:42:34.833358 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 07:42:34.834240 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 07:42:34.834240 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application with Lock( Sep 16 07:42:34.834240 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 07:42:34.834240 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._enter() Sep 16 07:42:34.834240 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 07:42:34.834240 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 07:42:34.834240 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 07:42:34.834240 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.creator() Sep 16 07:42:34.834240 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 07:42:34.834240 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application created_value = creator( Sep 16 07:42:34.834240 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 16 07:42:34.834240 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 16 07:42:34.834240 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 16 07:42:34.834240 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Sep 16 07:42:34.836979 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 381/773] 10.222.0.57 () {56 vars in 1129 bytes} [Fri Sep 16 07:42:34 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 07:42:34.842407 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977ff83a-bcac-42d9-8513-9546f5a6b884 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:42:34.850446 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d6d971-9d43-4feb-a545-91c0af948a72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:42:34.851077 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d6d971-9d43-4feb-a545-91c0af948a72 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:34.851360 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d6d971-9d43-4feb-a545-91c0af948a72 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:34.851635 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d6d971-9d43-4feb-a545-91c0af948a72 None admin] PATH_INFO: `/v3/services` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:34.852283 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d6d971-9d43-4feb-a545-91c0af948a72 None admin] RBAC: Adding query filter params (type=network) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:42:34.852586 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d6d971-9d43-4feb-a545-91c0af948a72 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:42:34.853994 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d6d971-9d43-4feb-a545-91c0af948a72 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:42:34.873682 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 393/774] 10.222.0.57 () {56 vars in 1112 bytes} [Fri Sep 16 07:42:34 2022] GET /identity/v3/services?type=network => generated 350 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:42:34.882736 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d6d971-9d43-4feb-a545-91c0af948a72 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:42:34.955844 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977ff83a-bcac-42d9-8513-9546f5a6b884 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:42:34.992606 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee09964-4a42-403d-a273-09705bda255e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:42:34.993581 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee09964-4a42-403d-a273-09705bda255e None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:34.994101 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee09964-4a42-403d-a273-09705bda255e None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:34.994894 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee09964-4a42-403d-a273-09705bda255e None admin] PATH_INFO: `/v3/services` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:34.996317 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee09964-4a42-403d-a273-09705bda255e None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:42:34.996838 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee09964-4a42-403d-a273-09705bda255e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:42:34.998552 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee09964-4a42-403d-a273-09705bda255e None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:42:35.003787 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 382/775] 10.222.0.57 () {56 vars in 1124 bytes} [Fri Sep 16 07:42:34 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 07:42:35.009269 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee09964-4a42-403d-a273-09705bda255e None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:42:35.078248 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:42:35.099371 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:42:35.126988 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee09964-4a42-403d-a273-09705bda255e None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:42:35.165123 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08531009-2001-465b-8ef4-715eb216eb7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:42:35.166416 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08531009-2001-465b-8ef4-715eb216eb7b None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:35.167464 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08531009-2001-465b-8ef4-715eb216eb7b None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:35.168093 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08531009-2001-465b-8ef4-715eb216eb7b None admin] PATH_INFO: `/v3/services` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:35.169069 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08531009-2001-465b-8ef4-715eb216eb7b None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:42:35.169655 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08531009-2001-465b-8ef4-715eb216eb7b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:42:35.171588 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08531009-2001-465b-8ef4-715eb216eb7b None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:42:35.178242 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 383/776] 10.222.0.57 () {56 vars in 1124 bytes} [Fri Sep 16 07:42:35 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 07:42:35.185856 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08531009-2001-465b-8ef4-715eb216eb7b None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:42:35.246628 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d6d971-9d43-4feb-a545-91c0af948a72 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:42:35.287425 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5273c0-1869-4584-ae7a-47de25b29162 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:42:35.288040 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5273c0-1869-4584-ae7a-47de25b29162 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:35.288324 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5273c0-1869-4584-ae7a-47de25b29162 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:35.288592 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5273c0-1869-4584-ae7a-47de25b29162 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:35.289346 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5273c0-1869-4584-ae7a-47de25b29162 None admin] RBAC: Adding query filter params (interface=public, service_id=e6610ecd27c3456887448e9de7495227, region_id=RegionOne) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:42:35.289658 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5273c0-1869-4584-ae7a-47de25b29162 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:42:35.291637 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5273c0-1869-4584-ae7a-47de25b29162 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:42:35.302976 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 394/777] 10.222.0.57 () {56 vars in 1251 bytes} [Fri Sep 16 07:42:34 2022] GET /identity/v3/endpoints?service_id=e6610ecd27c3456887448e9de7495227&interface=public®ion_id=RegionOne => generated 194 bytes in 421 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:42:35.310385 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5273c0-1869-4584-ae7a-47de25b29162 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:42:35.364425 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08531009-2001-465b-8ef4-715eb216eb7b None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:42:35.385263 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:42:35.401862 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4397f9a3-cf80-4bfb-979b-4f52c3d85b73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:42:35.402596 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4397f9a3-cf80-4bfb-979b-4f52c3d85b73 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:35.402914 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4397f9a3-cf80-4bfb-979b-4f52c3d85b73 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:35.403190 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4397f9a3-cf80-4bfb-979b-4f52c3d85b73 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:35.403892 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4397f9a3-cf80-4bfb-979b-4f52c3d85b73 None admin] RBAC: Adding query filter params (interface=public, service_id=3facc65525064ae783cb6990b546c5f5, region_id=RegionOne) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:42:35.404206 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4397f9a3-cf80-4bfb-979b-4f52c3d85b73 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:42:35.405584 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4397f9a3-cf80-4bfb-979b-4f52c3d85b73 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:42:35.417585 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 384/778] 10.222.0.57 () {56 vars in 1251 bytes} [Fri Sep 16 07:42:35 2022] GET /identity/v3/endpoints?service_id=3facc65525064ae783cb6990b546c5f5&interface=public®ion_id=RegionOne => generated 194 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:42:35.428254 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4397f9a3-cf80-4bfb-979b-4f52c3d85b73 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:42:35.460951 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5273c0-1869-4584-ae7a-47de25b29162 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:42:35.490861 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:42:35.498138 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570118de-c7f8-47c8-94c8-3d4cf485393d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:42:35.499049 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570118de-c7f8-47c8-94c8-3d4cf485393d None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:35.499580 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570118de-c7f8-47c8-94c8-3d4cf485393d None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:35.500047 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570118de-c7f8-47c8-94c8-3d4cf485393d None admin] PATH_INFO: `/v3/services` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:35.500843 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570118de-c7f8-47c8-94c8-3d4cf485393d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:42:35.502438 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570118de-c7f8-47c8-94c8-3d4cf485393d None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:42:35.508569 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 395/779] 10.222.0.57 () {56 vars in 1087 bytes} [Fri Sep 16 07:42:35 2022] GET /identity/v3/services => generated 772 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:42:35.610672 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4397f9a3-cf80-4bfb-979b-4f52c3d85b73 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:42:35.663604 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052daa97-47e4-44f0-9e40-668f60cacae8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:42:35.664589 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052daa97-47e4-44f0-9e40-668f60cacae8 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:35.665091 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052daa97-47e4-44f0-9e40-668f60cacae8 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:35.665623 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052daa97-47e4-44f0-9e40-668f60cacae8 None admin] PATH_INFO: `/v3/services` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:35.666526 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052daa97-47e4-44f0-9e40-668f60cacae8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:42:35.668687 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052daa97-47e4-44f0-9e40-668f60cacae8 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:42:35.678511 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 385/780] 10.222.0.57 () {56 vars in 1087 bytes} [Fri Sep 16 07:42:35 2022] GET /identity/v3/services => generated 772 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 07:42:36.090661 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec4ea60-eeb9-4b68-bdcf-81a3da3c77c3 None None] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:36.091300 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec4ea60-eeb9-4b68-bdcf-81a3da3c77c3 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:36.091833 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec4ea60-eeb9-4b68-bdcf-81a3da3c77c3 None None] PATH_INFO: `/` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:36.093605 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 396/781] 10.222.0.57 () {54 vars in 927 bytes} [Fri Sep 16 07:42:36 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 07:42:36.108857 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbf68d1-f265-43e7-b41c-4a2d0c92716e None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:36.109259 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbf68d1-f265-43e7-b41c-4a2d0c92716e None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:36.109457 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbf68d1-f265-43e7-b41c-4a2d0c92716e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:36.118618 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b5d1c3-a6ce-4dd3-a2eb-b3a717dac38a None None] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:36.118876 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b5d1c3-a6ce-4dd3-a2eb-b3a717dac38a None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:36.119175 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b5d1c3-a6ce-4dd3-a2eb-b3a717dac38a None None] PATH_INFO: `/` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:36.121556 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 397/782] 10.222.0.57 () {54 vars in 927 bytes} [Fri Sep 16 07:42:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 16 07:42:36.126890 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b182d1fa-939b-4ce2-88d6-fe7cf611e22c None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:36.127177 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b182d1fa-939b-4ce2-88d6-fe7cf611e22c None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:36.127446 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b182d1fa-939b-4ce2-88d6-fe7cf611e22c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:36.137756 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-9cbf68d1-f265-43e7-b41c-4a2d0c92716e None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:42:36.138955 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-9cbf68d1-f265-43e7-b41c-4a2d0c92716e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:42:36.159865 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-b182d1fa-939b-4ce2-88d6-fe7cf611e22c None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:42:36.161071 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-b182d1fa-939b-4ce2-88d6-fe7cf611e22c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:42:36.225532 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:42:36.286603 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 386/783] 10.222.0.57 () {58 vars in 1024 bytes} [Fri Sep 16 07:42:36 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 16 07:42:36.297853 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 398/784] 10.222.0.57 () {58 vars in 1024 bytes} [Fri Sep 16 07:42:36 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 16 07:42:36.581234 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1334b4f-9b1f-4748-837f-c536cb1c4765 None None] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:36.581234 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1334b4f-9b1f-4748-837f-c536cb1c4765 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:36.581234 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1334b4f-9b1f-4748-837f-c536cb1c4765 None None] PATH_INFO: `/` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:36.581872 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 387/785] 10.222.0.57 () {54 vars in 927 bytes} [Fri Sep 16 07:42:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 07:42:36.587414 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5551e8f2-e48d-451c-9871-0a3ec1f67f34 None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:36.587700 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5551e8f2-e48d-451c-9871-0a3ec1f67f34 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:36.587974 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5551e8f2-e48d-451c-9871-0a3ec1f67f34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:36.606926 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-5551e8f2-e48d-451c-9871-0a3ec1f67f34 None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:42:36.608126 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-5551e8f2-e48d-451c-9871-0a3ec1f67f34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:42:36.626867 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1334b4f-9b1f-4748-837f-c536cb1c4765 None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:42:36.709147 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 399/786] 10.222.0.57 () {58 vars in 1024 bytes} [Fri Sep 16 07:42:36 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 16 07:42:36.709768 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5551e8f2-e48d-451c-9871-0a3ec1f67f34 None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:42:36.835671 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:42:36.903355 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1334b4f-9b1f-4748-837f-c536cb1c4765 None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:42:36.940229 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22eb3c4-0169-426f-81b2-5d357bb00d05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:42:36.940855 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22eb3c4-0169-426f-81b2-5d357bb00d05 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:36.941130 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22eb3c4-0169-426f-81b2-5d357bb00d05 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:36.941399 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22eb3c4-0169-426f-81b2-5d357bb00d05 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:36.953404 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22eb3c4-0169-426f-81b2-5d357bb00d05 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 07:42:36.958697 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application [None req-c22eb3c4-0169-426f-81b2-5d357bb00d05 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 16 07:42:36.958697 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 07:42:36.958697 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 07:42:36.958697 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 07:42:36.958697 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 07:42:36.958697 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 07:42:36.958697 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 07:42:36.958697 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 07:42:36.958697 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 07:42:36.958697 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 07:42:36.958697 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 07:42:36.958697 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 07:42:36.958697 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 07:42:36.958697 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 07:42:36.958697 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 07:42:36.958697 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 07:42:36.959720 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 07:42:36.959720 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 07:42:36.959720 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 07:42:36.959720 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 07:42:36.959720 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 07:42:36.959720 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 07:42:36.959720 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 07:42:36.959720 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 07:42:36.959720 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 07:42:36.959720 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 07:42:36.959720 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 07:42:36.959720 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application with Lock( Sep 16 07:42:36.959720 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 07:42:36.959720 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._enter() Sep 16 07:42:36.959720 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 07:42:36.959720 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 07:42:36.960609 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 07:42:36.960609 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.creator() Sep 16 07:42:36.960609 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 07:42:36.960609 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application created_value = creator( Sep 16 07:42:36.960609 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 07:42:36.960609 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 07:42:36.960609 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 07:42:36.960609 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 07:42:36.960609 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 07:42:36.960609 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 07:42:36.960609 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 16 07:42:36.960609 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Sep 16 07:42:36.960609 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 388/787] 10.222.0.57 () {56 vars in 1102 bytes} [Fri Sep 16 07:42:36 2022] GET /identity/v3/roles/service => generated 85 bytes in 334 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 07:42:36.968034 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22eb3c4-0169-426f-81b2-5d357bb00d05 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:42:37.007754 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5551e8f2-e48d-451c-9871-0a3ec1f67f34 None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:42:37.019068 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:42:37.051710 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fea30b-2b54-442f-a12d-73c6e0f8317f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:42:37.052726 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fea30b-2b54-442f-a12d-73c6e0f8317f None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:37.053309 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fea30b-2b54-442f-a12d-73c6e0f8317f None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:37.053835 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fea30b-2b54-442f-a12d-73c6e0f8317f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:37.066362 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1fea30b-2b54-442f-a12d-73c6e0f8317f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 07:42:37.072401 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application [None req-e1fea30b-2b54-442f-a12d-73c6e0f8317f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 16 07:42:37.072401 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 07:42:37.072401 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 07:42:37.072401 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 07:42:37.072401 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 07:42:37.072401 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 07:42:37.072401 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 07:42:37.072401 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 07:42:37.072401 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 07:42:37.072401 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 07:42:37.072401 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 07:42:37.072401 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 07:42:37.072401 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 07:42:37.072401 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 07:42:37.072401 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 07:42:37.072401 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 07:42:37.074237 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 07:42:37.074237 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 07:42:37.074237 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 07:42:37.074237 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 07:42:37.074237 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 07:42:37.074237 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 07:42:37.074237 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 07:42:37.074237 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 07:42:37.074237 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 07:42:37.074237 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 07:42:37.074237 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 07:42:37.074237 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application with Lock( Sep 16 07:42:37.074237 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 07:42:37.074237 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._enter() Sep 16 07:42:37.074237 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 07:42:37.074237 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 07:42:37.075191 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 07:42:37.075191 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.creator() Sep 16 07:42:37.075191 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 07:42:37.075191 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application created_value = creator( Sep 16 07:42:37.075191 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 07:42:37.075191 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 07:42:37.075191 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 07:42:37.075191 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 07:42:37.075191 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 07:42:37.075191 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 07:42:37.075191 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 16 07:42:37.075191 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Sep 16 07:42:37.078240 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 400/788] 10.222.0.57 () {56 vars in 1096 bytes} [Fri Sep 16 07:42:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 369 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 07:42:37.085001 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fea30b-2b54-442f-a12d-73c6e0f8317f None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:42:37.090180 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22eb3c4-0169-426f-81b2-5d357bb00d05 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:42:37.131141 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d94817-d1b3-4a8a-acbd-7b4a09753ca4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:42:37.131953 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d94817-d1b3-4a8a-acbd-7b4a09753ca4 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:37.133025 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d94817-d1b3-4a8a-acbd-7b4a09753ca4 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:37.133300 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d94817-d1b3-4a8a-acbd-7b4a09753ca4 None admin] PATH_INFO: `/v3/roles` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:37.134002 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d94817-d1b3-4a8a-acbd-7b4a09753ca4 None admin] RBAC: Adding query filter params (name=service) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:42:37.134302 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d94817-d1b3-4a8a-acbd-7b4a09753ca4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:42:37.136369 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d94817-d1b3-4a8a-acbd-7b4a09753ca4 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:42:37.147072 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 389/789] 10.222.0.57 () {56 vars in 1103 bytes} [Fri Sep 16 07:42:36 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 07:42:37.148238 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d94817-d1b3-4a8a-acbd-7b4a09753ca4 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:42:37.211616 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fea30b-2b54-442f-a12d-73c6e0f8317f None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:42:37.220161 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:42:37.250107 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f334659-dc80-4a80-b6d7-03bf22d835df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:42:37.250925 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f334659-dc80-4a80-b6d7-03bf22d835df None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:37.251276 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f334659-dc80-4a80-b6d7-03bf22d835df None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:37.251642 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f334659-dc80-4a80-b6d7-03bf22d835df None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:37.263222 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f334659-dc80-4a80-b6d7-03bf22d835df None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 07:42:37.268216 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application [None req-8f334659-dc80-4a80-b6d7-03bf22d835df None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 16 07:42:37.268216 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 07:42:37.268216 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 07:42:37.268216 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 07:42:37.268216 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 07:42:37.268216 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 07:42:37.268216 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 07:42:37.268216 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 07:42:37.268216 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 07:42:37.268216 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 07:42:37.268216 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 07:42:37.268216 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 07:42:37.268216 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 07:42:37.268216 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 07:42:37.268216 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 07:42:37.268216 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 07:42:37.269351 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 07:42:37.269351 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 07:42:37.269351 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 07:42:37.269351 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 07:42:37.269351 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 07:42:37.269351 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 07:42:37.269351 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 07:42:37.269351 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 07:42:37.269351 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 07:42:37.269351 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 07:42:37.269351 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 07:42:37.269351 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application with Lock( Sep 16 07:42:37.269351 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 07:42:37.269351 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._enter() Sep 16 07:42:37.269351 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 07:42:37.269351 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 07:42:37.270321 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 07:42:37.270321 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.creator() Sep 16 07:42:37.270321 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 07:42:37.270321 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application created_value = creator( Sep 16 07:42:37.270321 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 07:42:37.270321 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 07:42:37.270321 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 07:42:37.270321 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 07:42:37.270321 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 07:42:37.270321 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 07:42:37.270321 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 16 07:42:37.270321 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Sep 16 07:42:37.270321 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 401/790] 10.222.0.57 () {56 vars in 1096 bytes} [Fri Sep 16 07:42:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 07:42:37.271185 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f334659-dc80-4a80-b6d7-03bf22d835df None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:42:37.277974 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:42:37.282409 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d94817-d1b3-4a8a-acbd-7b4a09753ca4 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:42:37.326383 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49ce3dc-689f-48d6-bd34-bee586101328 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:42:37.327098 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49ce3dc-689f-48d6-bd34-bee586101328 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:37.327442 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49ce3dc-689f-48d6-bd34-bee586101328 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:37.327798 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49ce3dc-689f-48d6-bd34-bee586101328 None admin] PATH_INFO: `/v3/roles` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:37.328521 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49ce3dc-689f-48d6-bd34-bee586101328 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:42:37.328888 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49ce3dc-689f-48d6-bd34-bee586101328 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:42:37.330404 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49ce3dc-689f-48d6-bd34-bee586101328 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:42:37.339418 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 390/791] 10.222.0.57 () {56 vars in 1099 bytes} [Fri Sep 16 07:42:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:42:37.340372 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49ce3dc-689f-48d6-bd34-bee586101328 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:42:37.389462 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f334659-dc80-4a80-b6d7-03bf22d835df None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:42:37.425357 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18540026-4777-4cae-ad4b-170010177fb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:42:37.426008 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18540026-4777-4cae-ad4b-170010177fb9 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:37.426282 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18540026-4777-4cae-ad4b-170010177fb9 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:37.426549 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18540026-4777-4cae-ad4b-170010177fb9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:37.437942 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18540026-4777-4cae-ad4b-170010177fb9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:42:37.439373 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18540026-4777-4cae-ad4b-170010177fb9 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:42:37.446764 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49ce3dc-689f-48d6-bd34-bee586101328 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:42:37.455817 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application [None req-18540026-4777-4cae-ad4b-170010177fb9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 07:42:37.455817 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 07:42:37.455817 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 07:42:37.455817 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 07:42:37.455817 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 07:42:37.455817 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 07:42:37.455817 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 07:42:37.455817 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 07:42:37.455817 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 07:42:37.455817 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 07:42:37.455817 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 07:42:37.455817 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 07:42:37.455817 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 07:42:37.455817 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 07:42:37.455817 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 07:42:37.455817 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 07:42:37.457711 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 07:42:37.457711 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 07:42:37.457711 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 07:42:37.457711 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 07:42:37.457711 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 07:42:37.457711 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 07:42:37.457711 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 07:42:37.457711 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application with Lock( Sep 16 07:42:37.457711 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 07:42:37.457711 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._enter() Sep 16 07:42:37.457711 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 07:42:37.457711 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 07:42:37.457711 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 07:42:37.457711 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.creator() Sep 16 07:42:37.457711 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 07:42:37.457711 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application created_value = creator( Sep 16 07:42:37.457711 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 07:42:37.459951 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 07:42:37.459951 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 07:42:37.459951 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Sep 16 07:42:37.459951 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 402/792] 10.222.0.57 () {56 vars in 1108 bytes} [Fri Sep 16 07:42:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 07:42:37.459951 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18540026-4777-4cae-ad4b-170010177fb9 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:42:37.478422 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:42:37.487647 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b96529-db4f-473a-ba8e-64bfd06f5c32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:42:37.488258 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b96529-db4f-473a-ba8e-64bfd06f5c32 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:37.488534 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b96529-db4f-473a-ba8e-64bfd06f5c32 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:37.488804 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b96529-db4f-473a-ba8e-64bfd06f5c32 None admin] PATH_INFO: `/v3/roles` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:37.489457 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b96529-db4f-473a-ba8e-64bfd06f5c32 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:42:37.489791 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b96529-db4f-473a-ba8e-64bfd06f5c32 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:42:37.491156 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b96529-db4f-473a-ba8e-64bfd06f5c32 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:42:37.500382 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 391/793] 10.222.0.57 () {56 vars in 1099 bytes} [Fri Sep 16 07:42:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:42:37.501199 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b96529-db4f-473a-ba8e-64bfd06f5c32 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:42:37.528171 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:42:37.566427 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18540026-4777-4cae-ad4b-170010177fb9 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:42:37.602373 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13044acd-7b23-4a6e-af4c-6f5a92fa7a8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:42:37.602997 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13044acd-7b23-4a6e-af4c-6f5a92fa7a8e None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:37.603271 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13044acd-7b23-4a6e-af4c-6f5a92fa7a8e None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:37.603536 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13044acd-7b23-4a6e-af4c-6f5a92fa7a8e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:37.607701 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b96529-db4f-473a-ba8e-64bfd06f5c32 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:42:37.614685 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13044acd-7b23-4a6e-af4c-6f5a92fa7a8e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:42:37.616123 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13044acd-7b23-4a6e-af4c-6f5a92fa7a8e None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:42:37.631646 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application [None req-13044acd-7b23-4a6e-af4c-6f5a92fa7a8e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 07:42:37.631646 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 07:42:37.631646 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 07:42:37.631646 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 07:42:37.631646 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 07:42:37.631646 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 07:42:37.631646 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 07:42:37.631646 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 07:42:37.631646 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 07:42:37.631646 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 07:42:37.631646 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 07:42:37.631646 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 07:42:37.631646 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 07:42:37.631646 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 07:42:37.631646 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 07:42:37.631646 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 07:42:37.633847 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 07:42:37.633847 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 07:42:37.633847 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 07:42:37.633847 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 07:42:37.633847 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 07:42:37.633847 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 07:42:37.633847 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 07:42:37.633847 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application with Lock( Sep 16 07:42:37.633847 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 07:42:37.633847 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._enter() Sep 16 07:42:37.633847 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 07:42:37.633847 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 07:42:37.633847 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 07:42:37.633847 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.creator() Sep 16 07:42:37.633847 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 07:42:37.633847 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application created_value = creator( Sep 16 07:42:37.633847 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 07:42:37.636997 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 07:42:37.636997 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 07:42:37.636997 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Sep 16 07:42:37.645745 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 403/794] 10.222.0.57 () {56 vars in 1108 bytes} [Fri Sep 16 07:42:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 07:42:37.645745 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13044acd-7b23-4a6e-af4c-6f5a92fa7a8e None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:42:37.646115 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1624c0-db75-40cd-abb7-fa7588d627f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:42:37.646115 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1624c0-db75-40cd-abb7-fa7588d627f7 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:37.646115 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1624c0-db75-40cd-abb7-fa7588d627f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:37.646115 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1624c0-db75-40cd-abb7-fa7588d627f7 None admin] PATH_INFO: `/v3/domains` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:37.646711 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1624c0-db75-40cd-abb7-fa7588d627f7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:42:37.646711 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1624c0-db75-40cd-abb7-fa7588d627f7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:42:37.647498 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1624c0-db75-40cd-abb7-fa7588d627f7 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:42:37.660018 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 392/795] 10.222.0.57 () {56 vars in 1109 bytes} [Fri Sep 16 07:42:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:42:37.660848 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1624c0-db75-40cd-abb7-fa7588d627f7 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:42:37.714120 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:42:37.749363 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13044acd-7b23-4a6e-af4c-6f5a92fa7a8e None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:42:37.750863 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:42:37.768980 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1624c0-db75-40cd-abb7-fa7588d627f7 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:42:37.785240 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f4d7a2-78bc-4dee-a4b9-52c5bf8409f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:42:37.785912 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f4d7a2-78bc-4dee-a4b9-52c5bf8409f2 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:37.786190 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f4d7a2-78bc-4dee-a4b9-52c5bf8409f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:37.786457 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f4d7a2-78bc-4dee-a4b9-52c5bf8409f2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:37.798553 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f4d7a2-78bc-4dee-a4b9-52c5bf8409f2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:42:37.799992 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f4d7a2-78bc-4dee-a4b9-52c5bf8409f2 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:42:37.805810 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcac79b-a6e1-4a27-8fd8-c86d97ed6fb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:42:37.806480 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcac79b-a6e1-4a27-8fd8-c86d97ed6fb1 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:37.806761 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcac79b-a6e1-4a27-8fd8-c86d97ed6fb1 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:37.807030 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcac79b-a6e1-4a27-8fd8-c86d97ed6fb1 None admin] PATH_INFO: `/v3/domains` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:37.808280 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dcac79b-a6e1-4a27-8fd8-c86d97ed6fb1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:42:37.808555 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dcac79b-a6e1-4a27-8fd8-c86d97ed6fb1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:42:37.809946 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dcac79b-a6e1-4a27-8fd8-c86d97ed6fb1 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:42:37.815701 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application [None req-b7f4d7a2-78bc-4dee-a4b9-52c5bf8409f2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 07:42:37.815701 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 07:42:37.815701 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 07:42:37.815701 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 07:42:37.815701 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 07:42:37.815701 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 07:42:37.815701 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 07:42:37.815701 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 07:42:37.815701 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 07:42:37.815701 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 07:42:37.815701 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 07:42:37.815701 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 07:42:37.815701 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 07:42:37.815701 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 07:42:37.815701 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 07:42:37.815701 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 07:42:37.817822 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 07:42:37.817822 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 07:42:37.817822 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 07:42:37.817822 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 07:42:37.817822 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 07:42:37.817822 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 07:42:37.817822 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 07:42:37.817822 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application with Lock( Sep 16 07:42:37.817822 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 07:42:37.817822 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._enter() Sep 16 07:42:37.817822 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 07:42:37.817822 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 07:42:37.817822 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 07:42:37.817822 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.creator() Sep 16 07:42:37.817822 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 07:42:37.817822 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application created_value = creator( Sep 16 07:42:37.817822 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 07:42:37.819912 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 07:42:37.819912 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 07:42:37.819912 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Sep 16 07:42:37.819912 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 404/796] 10.222.0.57 () {56 vars in 1108 bytes} [Fri Sep 16 07:42:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 07:42:37.819912 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f4d7a2-78bc-4dee-a4b9-52c5bf8409f2 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:42:37.826754 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 393/797] 10.222.0.57 () {56 vars in 1109 bytes} [Fri Sep 16 07:42:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:42:37.827684 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcac79b-a6e1-4a27-8fd8-c86d97ed6fb1 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:42:37.924955 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f4d7a2-78bc-4dee-a4b9-52c5bf8409f2 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:42:37.932135 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcac79b-a6e1-4a27-8fd8-c86d97ed6fb1 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:42:37.949141 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:42:37.962177 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8174d91-c280-4160-b286-81d42893a9d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:42:37.962802 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8174d91-c280-4160-b286-81d42893a9d1 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:37.963069 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8174d91-c280-4160-b286-81d42893a9d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:37.963336 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8174d91-c280-4160-b286-81d42893a9d1 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:37.969795 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa9a854-c861-416f-a887-dc3a743eec0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:42:37.970407 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa9a854-c861-416f-a887-dc3a743eec0c None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:37.970681 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa9a854-c861-416f-a887-dc3a743eec0c None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:37.970959 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa9a854-c861-416f-a887-dc3a743eec0c None admin] PATH_INFO: `/v3/domains` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:37.971515 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8174d91-c280-4160-b286-81d42893a9d1 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:42:37.971728 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa9a854-c861-416f-a887-dc3a743eec0c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:42:37.971968 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa9a854-c861-416f-a887-dc3a743eec0c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:42:37.973332 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa9a854-c861-416f-a887-dc3a743eec0c None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:42:37.973579 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8174d91-c280-4160-b286-81d42893a9d1 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:42:37.985527 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application [None req-c8174d91-c280-4160-b286-81d42893a9d1 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 16 07:42:37.985527 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 07:42:37.985527 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 07:42:37.985527 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 07:42:37.985527 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 07:42:37.985527 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 07:42:37.985527 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 07:42:37.985527 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 07:42:37.985527 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 07:42:37.985527 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 07:42:37.985527 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 07:42:37.985527 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 07:42:37.985527 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 16 07:42:37.985527 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 16 07:42:37.985527 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 16 07:42:37.985527 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 16 07:42:37.987846 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 07:42:37.987846 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 07:42:37.987846 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 16 07:42:37.987846 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 07:42:37.987846 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 16 07:42:37.987846 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 07:42:37.987846 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 07:42:37.987846 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 07:42:37.987846 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 07:42:37.987846 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 07:42:37.987846 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 07:42:37.987846 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application with Lock( Sep 16 07:42:37.987846 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 07:42:37.987846 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._enter() Sep 16 07:42:37.987846 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 07:42:37.987846 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 07:42:37.987846 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 07:42:37.987846 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.creator() Sep 16 07:42:37.989762 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 07:42:37.989762 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application created_value = creator( Sep 16 07:42:37.989762 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 16 07:42:37.989762 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 16 07:42:37.989762 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 16 07:42:37.989762 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 16 07:42:37.989762 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 16 07:42:37.989762 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 16 07:42:37.989762 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 16 07:42:37.989762 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Sep 16 07:42:37.989762 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 405/798] 10.222.0.57 () {56 vars in 1117 bytes} [Fri Sep 16 07:42:37 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 07:42:37.990945 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 394/799] 10.222.0.57 () {56 vars in 1109 bytes} [Fri Sep 16 07:42:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:42:37.991057 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8174d91-c280-4160-b286-81d42893a9d1 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:42:37.997749 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa9a854-c861-416f-a887-dc3a743eec0c None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:42:37.997749 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:42:38.097748 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8174d91-c280-4160-b286-81d42893a9d1 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:42:38.109750 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa9a854-c861-416f-a887-dc3a743eec0c None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:42:38.129868 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23b39bb-f5a8-4593-89db-79d0fd940e5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:42:38.131047 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23b39bb-f5a8-4593-89db-79d0fd940e5a None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:38.131528 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23b39bb-f5a8-4593-89db-79d0fd940e5a None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:38.131970 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23b39bb-f5a8-4593-89db-79d0fd940e5a None admin] PATH_INFO: `/v3/users/nova` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:38.140759 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23b39bb-f5a8-4593-89db-79d0fd940e5a None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:42:38.142438 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23b39bb-f5a8-4593-89db-79d0fd940e5a None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:42:38.145747 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7cdabc-4ed9-4eaa-b6ba-90e5694ba225 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:42:38.146910 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7cdabc-4ed9-4eaa-b6ba-90e5694ba225 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:38.147334 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7cdabc-4ed9-4eaa-b6ba-90e5694ba225 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:38.147751 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7cdabc-4ed9-4eaa-b6ba-90e5694ba225 None admin] PATH_INFO: `/v3/users` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:38.148625 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7cdabc-4ed9-4eaa-b6ba-90e5694ba225 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:42:38.149072 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7cdabc-4ed9-4eaa-b6ba-90e5694ba225 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:42:38.150735 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7cdabc-4ed9-4eaa-b6ba-90e5694ba225 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:42:38.155932 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application [None req-e23b39bb-f5a8-4593-89db-79d0fd940e5a None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 16 07:42:38.155932 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 07:42:38.155932 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 07:42:38.155932 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 07:42:38.155932 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 07:42:38.155932 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 07:42:38.155932 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 07:42:38.155932 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 07:42:38.155932 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 07:42:38.155932 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 07:42:38.155932 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 07:42:38.155932 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 07:42:38.155932 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 16 07:42:38.155932 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 16 07:42:38.155932 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 16 07:42:38.155932 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 16 07:42:38.157166 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 07:42:38.157166 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 07:42:38.157166 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 16 07:42:38.157166 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 07:42:38.157166 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 16 07:42:38.157166 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 07:42:38.157166 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 07:42:38.157166 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 07:42:38.157166 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 07:42:38.157166 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 07:42:38.157166 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 07:42:38.157166 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application with Lock( Sep 16 07:42:38.157166 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 07:42:38.157166 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._enter() Sep 16 07:42:38.157166 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 07:42:38.157166 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 07:42:38.157166 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 07:42:38.157166 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.creator() Sep 16 07:42:38.158382 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 07:42:38.158382 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application created_value = creator( Sep 16 07:42:38.158382 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 16 07:42:38.158382 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 16 07:42:38.158382 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 16 07:42:38.158382 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 16 07:42:38.158382 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 16 07:42:38.158382 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 16 07:42:38.158382 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 16 07:42:38.158382 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Sep 16 07:42:38.164732 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 406/800] 10.222.0.57 () {56 vars in 1093 bytes} [Fri Sep 16 07:42:37 2022] GET /identity/v3/users/nova => generated 82 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 07:42:38.164732 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23b39bb-f5a8-4593-89db-79d0fd940e5a None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:42:38.182722 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 395/801] 10.222.0.57 () {56 vars in 1149 bytes} [Fri Sep 16 07:42:37 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:42:38.184157 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7cdabc-4ed9-4eaa-b6ba-90e5694ba225 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:42:38.238251 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:42:38.268250 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:42:38.301789 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23b39bb-f5a8-4593-89db-79d0fd940e5a None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:42:38.313866 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7cdabc-4ed9-4eaa-b6ba-90e5694ba225 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:42:38.336800 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754d36d3-7c8d-49d8-9ea7-049cf0c78a8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:42:38.337421 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754d36d3-7c8d-49d8-9ea7-049cf0c78a8d None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:38.337698 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754d36d3-7c8d-49d8-9ea7-049cf0c78a8d None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:38.337990 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754d36d3-7c8d-49d8-9ea7-049cf0c78a8d None admin] PATH_INFO: `/v3/users/swift` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:38.345845 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754d36d3-7c8d-49d8-9ea7-049cf0c78a8d None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:42:38.347267 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754d36d3-7c8d-49d8-9ea7-049cf0c78a8d None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:42:38.348885 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4df5eb-1e6e-4029-a18a-1525c351704c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:42:38.349480 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4df5eb-1e6e-4029-a18a-1525c351704c None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:38.349778 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4df5eb-1e6e-4029-a18a-1525c351704c None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:38.350040 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4df5eb-1e6e-4029-a18a-1525c351704c None admin] PATH_INFO: `/v3/users` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:38.350738 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4df5eb-1e6e-4029-a18a-1525c351704c None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:42:38.351032 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4df5eb-1e6e-4029-a18a-1525c351704c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:42:38.352412 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4df5eb-1e6e-4029-a18a-1525c351704c None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:42:38.358708 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application [None req-754d36d3-7c8d-49d8-9ea7-049cf0c78a8d None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 16 07:42:38.358708 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 07:42:38.358708 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 07:42:38.358708 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 07:42:38.358708 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 07:42:38.358708 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 07:42:38.358708 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 07:42:38.358708 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 07:42:38.358708 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 07:42:38.358708 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 07:42:38.358708 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 07:42:38.358708 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 07:42:38.358708 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 16 07:42:38.358708 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 16 07:42:38.358708 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 16 07:42:38.358708 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 16 07:42:38.359640 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 07:42:38.359640 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 07:42:38.359640 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 16 07:42:38.359640 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 07:42:38.359640 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 16 07:42:38.359640 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 07:42:38.359640 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 07:42:38.359640 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 07:42:38.359640 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 07:42:38.359640 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 07:42:38.359640 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 07:42:38.359640 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application with Lock( Sep 16 07:42:38.359640 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 07:42:38.359640 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._enter() Sep 16 07:42:38.359640 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 07:42:38.359640 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 07:42:38.359640 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 07:42:38.359640 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.creator() Sep 16 07:42:38.360634 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 07:42:38.360634 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application created_value = creator( Sep 16 07:42:38.360634 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 16 07:42:38.360634 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 16 07:42:38.360634 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 16 07:42:38.360634 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 16 07:42:38.360634 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 16 07:42:38.360634 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 16 07:42:38.360634 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 16 07:42:38.360634 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Sep 16 07:42:38.360634 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 407/802] 10.222.0.57 () {56 vars in 1096 bytes} [Fri Sep 16 07:42:38 2022] GET /identity/v3/users/swift => generated 83 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 07:42:38.360634 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754d36d3-7c8d-49d8-9ea7-049cf0c78a8d None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:42:38.371960 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 396/803] 10.222.0.57 () {56 vars in 1133 bytes} [Fri Sep 16 07:42:38 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:42:38.373329 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88da5b78-fc72-442f-9fa5-ea99977559e0 None None] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:38.373614 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88da5b78-fc72-442f-9fa5-ea99977559e0 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:38.373906 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88da5b78-fc72-442f-9fa5-ea99977559e0 None None] PATH_INFO: `/` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:38.375214 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 397/804] 10.222.0.57 () {54 vars in 927 bytes} [Fri Sep 16 07:42:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 07:42:38.376107 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd8c68b-3b9e-4e39-b072-8985007e8203 None None] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:38.376447 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd8c68b-3b9e-4e39-b072-8985007e8203 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:38.376717 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd8c68b-3b9e-4e39-b072-8985007e8203 None None] PATH_INFO: `/` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:38.379215 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 398/805] 10.222.0.57 () {54 vars in 927 bytes} [Fri Sep 16 07:42:38 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 07:42:38.379215 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd8c68b-3b9e-4e39-b072-8985007e8203 None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:42:38.465913 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754d36d3-7c8d-49d8-9ea7-049cf0c78a8d None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:42:38.467317 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:42:38.479310 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd8c68b-3b9e-4e39-b072-8985007e8203 None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:42:38.499349 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:42:38.499820 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db81d4f1-a615-4ab6-8b2f-ead38888f477 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:42:38.500603 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db81d4f1-a615-4ab6-8b2f-ead38888f477 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:38.500773 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db81d4f1-a615-4ab6-8b2f-ead38888f477 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:38.501033 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db81d4f1-a615-4ab6-8b2f-ead38888f477 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:38.512327 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db81d4f1-a615-4ab6-8b2f-ead38888f477 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:42:38.513774 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db81d4f1-a615-4ab6-8b2f-ead38888f477 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:42:38.514376 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa04af1-554d-4e29-bdcb-48061638ee97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:42:38.514964 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa04af1-554d-4e29-bdcb-48061638ee97 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:38.515233 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa04af1-554d-4e29-bdcb-48061638ee97 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:38.515502 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa04af1-554d-4e29-bdcb-48061638ee97 None admin] PATH_INFO: `/v3/users` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:38.516211 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa04af1-554d-4e29-bdcb-48061638ee97 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:42:38.516509 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa04af1-554d-4e29-bdcb-48061638ee97 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:42:38.517923 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa04af1-554d-4e29-bdcb-48061638ee97 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:42:38.529009 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application [None req-db81d4f1-a615-4ab6-8b2f-ead38888f477 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 07:42:38.529009 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 07:42:38.529009 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 07:42:38.529009 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 07:42:38.529009 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 07:42:38.529009 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 07:42:38.529009 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 07:42:38.529009 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 07:42:38.529009 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 07:42:38.529009 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 07:42:38.529009 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 07:42:38.529009 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 07:42:38.529009 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 07:42:38.529009 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 07:42:38.529009 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 07:42:38.529009 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 07:42:38.530156 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 07:42:38.530156 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 07:42:38.530156 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 07:42:38.530156 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 07:42:38.530156 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 07:42:38.530156 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 07:42:38.530156 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 07:42:38.530156 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application with Lock( Sep 16 07:42:38.530156 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 07:42:38.530156 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._enter() Sep 16 07:42:38.530156 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 07:42:38.530156 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 07:42:38.530156 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 07:42:38.530156 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.creator() Sep 16 07:42:38.530156 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 07:42:38.530156 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application created_value = creator( Sep 16 07:42:38.530156 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 07:42:38.531059 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 07:42:38.531059 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 07:42:38.531059 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Sep 16 07:42:38.531059 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 408/806] 10.222.0.57 () {56 vars in 1108 bytes} [Fri Sep 16 07:42:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 07:42:38.531608 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de2a38c-3ce9-4f63-8fd2-9f78c5776e01 None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:38.531888 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de2a38c-3ce9-4f63-8fd2-9f78c5776e01 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:38.532159 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de2a38c-3ce9-4f63-8fd2-9f78c5776e01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:38.538267 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 399/807] 10.222.0.57 () {56 vars in 1135 bytes} [Fri Sep 16 07:42:38 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:42:38.539071 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa04af1-554d-4e29-bdcb-48061638ee97 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:42:38.553445 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-4de2a38c-3ce9-4f63-8fd2-9f78c5776e01 None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:42:38.554661 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-4de2a38c-3ce9-4f63-8fd2-9f78c5776e01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:42:38.619592 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 409/808] 10.222.0.57 () {58 vars in 1024 bytes} [Fri Sep 16 07:42:38 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 16 07:42:38.620857 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92124738-ec5d-4106-9302-cbb11415c4da None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:38.621141 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92124738-ec5d-4106-9302-cbb11415c4da None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:38.621418 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92124738-ec5d-4106-9302-cbb11415c4da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:38.644501 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa04af1-554d-4e29-bdcb-48061638ee97 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:42:38.652027 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-92124738-ec5d-4106-9302-cbb11415c4da None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:42:38.653303 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-92124738-ec5d-4106-9302-cbb11415c4da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:42:38.681131 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf9a97f-be1c-474e-8638-866904b631f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:42:38.682000 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf9a97f-be1c-474e-8638-866904b631f0 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:38.682663 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf9a97f-be1c-474e-8638-866904b631f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:38.683152 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf9a97f-be1c-474e-8638-866904b631f0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:38.720985 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 410/809] 10.222.0.57 () {58 vars in 1024 bytes} [Fri Sep 16 07:42:38 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 16 07:42:38.722077 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92124738-ec5d-4106-9302-cbb11415c4da None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:42:38.733777 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:42:38.749255 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:42:38.757246 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf9a97f-be1c-474e-8638-866904b631f0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:42:38.758854 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf9a97f-be1c-474e-8638-866904b631f0 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:42:38.856370 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92124738-ec5d-4106-9302-cbb11415c4da None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:42:38.881817 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 400/810] 10.222.0.57 () {58 vars in 1282 bytes} [Fri Sep 16 07:42:38 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 16 07:42:38.882912 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf9a97f-be1c-474e-8638-866904b631f0 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:42:38.898506 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b72f193-7e3d-4795-8cfc-b2405e92235e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:42:38.899236 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b72f193-7e3d-4795-8cfc-b2405e92235e None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:38.899583 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b72f193-7e3d-4795-8cfc-b2405e92235e None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:38.899946 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b72f193-7e3d-4795-8cfc-b2405e92235e None admin] PATH_INFO: `/v3/domains` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:38.900659 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b72f193-7e3d-4795-8cfc-b2405e92235e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:42:38.901089 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b72f193-7e3d-4795-8cfc-b2405e92235e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:42:38.903683 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b72f193-7e3d-4795-8cfc-b2405e92235e None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:42:38.916498 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 411/811] 10.222.0.57 () {56 vars in 1109 bytes} [Fri Sep 16 07:42:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:42:38.917543 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b72f193-7e3d-4795-8cfc-b2405e92235e None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:42:38.975932 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:42:39.000047 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf9a97f-be1c-474e-8638-866904b631f0 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:42:39.001050 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:42:39.027425 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b72f193-7e3d-4795-8cfc-b2405e92235e None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:42:39.034084 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db462881-3e07-424b-8c5d-d8f320434f5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:42:39.034704 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db462881-3e07-424b-8c5d-d8f320434f5e None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:39.034975 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db462881-3e07-424b-8c5d-d8f320434f5e None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:39.035240 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db462881-3e07-424b-8c5d-d8f320434f5e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:39.045652 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db462881-3e07-424b-8c5d-d8f320434f5e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:42:39.047100 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db462881-3e07-424b-8c5d-d8f320434f5e None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:42:39.061014 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c947cd7c-6538-47bd-b95b-ed48db905f18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:42:39.061639 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c947cd7c-6538-47bd-b95b-ed48db905f18 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:39.061764 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application [None req-db462881-3e07-424b-8c5d-d8f320434f5e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 07:42:39.061764 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 07:42:39.061764 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 07:42:39.061764 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 07:42:39.061764 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 07:42:39.061764 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 07:42:39.061764 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 07:42:39.061764 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 07:42:39.061764 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 07:42:39.061764 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 07:42:39.061764 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 07:42:39.061764 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 07:42:39.061764 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 07:42:39.061764 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 07:42:39.061764 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 07:42:39.061764 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 07:42:39.062682 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 07:42:39.062682 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 07:42:39.062682 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 07:42:39.062682 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 07:42:39.062682 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 07:42:39.062682 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 07:42:39.062682 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 07:42:39.062682 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application with Lock( Sep 16 07:42:39.062682 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 07:42:39.062682 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._enter() Sep 16 07:42:39.062682 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 07:42:39.062682 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 07:42:39.062682 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 07:42:39.062682 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.creator() Sep 16 07:42:39.062682 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 07:42:39.062682 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application created_value = creator( Sep 16 07:42:39.062682 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 07:42:39.063606 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 07:42:39.063606 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 07:42:39.063606 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Sep 16 07:42:39.063809 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c947cd7c-6538-47bd-b95b-ed48db905f18 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:39.063809 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c947cd7c-6538-47bd-b95b-ed48db905f18 None admin] PATH_INFO: `/v3/services/network` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:39.063809 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c947cd7c-6538-47bd-b95b-ed48db905f18 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:42:39.063988 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 401/812] 10.222.0.57 () {56 vars in 1108 bytes} [Fri Sep 16 07:42:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 07:42:39.063988 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db462881-3e07-424b-8c5d-d8f320434f5e None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:42:39.064121 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c947cd7c-6538-47bd-b95b-ed48db905f18 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:42:39.076841 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application [None req-c947cd7c-6538-47bd-b95b-ed48db905f18 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 16 07:42:39.076841 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 07:42:39.076841 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 16 07:42:39.076841 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 16 07:42:39.076841 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 16 07:42:39.076841 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 16 07:42:39.076841 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 16 07:42:39.076841 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 16 07:42:39.076841 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 16 07:42:39.076841 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Sep 16 07:42:39.076841 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 16 07:42:39.076841 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Sep 16 07:42:39.076841 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 07:42:39.076841 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 07:42:39.076841 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 07:42:39.076841 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 07:42:39.076841 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 07:42:39.077915 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 07:42:39.077915 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 07:42:39.077915 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 07:42:39.077915 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 07:42:39.077915 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 07:42:39.077915 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 07:42:39.077915 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 16 07:42:39.077915 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 16 07:42:39.077915 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 16 07:42:39.077915 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 16 07:42:39.077915 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 07:42:39.077915 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 07:42:39.077915 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 07:42:39.077915 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 07:42:39.077915 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 07:42:39.077915 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 07:42:39.078779 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 07:42:39.078779 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application with Lock( Sep 16 07:42:39.078779 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 07:42:39.078779 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._enter() Sep 16 07:42:39.078779 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 07:42:39.078779 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 07:42:39.078779 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 07:42:39.078779 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.creator() Sep 16 07:42:39.078779 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 07:42:39.078779 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application created_value = creator( Sep 16 07:42:39.078779 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 16 07:42:39.078779 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 16 07:42:39.078779 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 16 07:42:39.078779 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Sep 16 07:42:39.078779 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 412/813] 10.222.0.57 () {56 vars in 1111 bytes} [Fri Sep 16 07:42:38 2022] GET /identity/v3/services/network => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 07:42:39.079590 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c947cd7c-6538-47bd-b95b-ed48db905f18 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:42:39.167824 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db462881-3e07-424b-8c5d-d8f320434f5e None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:42:39.180074 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c947cd7c-6538-47bd-b95b-ed48db905f18 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:42:39.195447 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:42:39.202419 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f13a09a-c9db-482c-be63-a100d1b43d5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:42:39.203094 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f13a09a-c9db-482c-be63-a100d1b43d5a None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:39.203377 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f13a09a-c9db-482c-be63-a100d1b43d5a None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:39.203664 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f13a09a-c9db-482c-be63-a100d1b43d5a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:39.214237 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4096d9a-daab-468c-97fa-3c8b614503fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:42:39.214641 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f13a09a-c9db-482c-be63-a100d1b43d5a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:42:39.214862 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4096d9a-daab-468c-97fa-3c8b614503fd None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:39.215144 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4096d9a-daab-468c-97fa-3c8b614503fd None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:39.215418 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4096d9a-daab-468c-97fa-3c8b614503fd None admin] PATH_INFO: `/v3/projects/service` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:39.216085 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f13a09a-c9db-482c-be63-a100d1b43d5a None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:42:39.222796 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4096d9a-daab-468c-97fa-3c8b614503fd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:42:39.224606 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4096d9a-daab-468c-97fa-3c8b614503fd None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:42:39.226495 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:42:39.231078 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application [None req-5f13a09a-c9db-482c-be63-a100d1b43d5a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 07:42:39.231078 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 07:42:39.231078 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 07:42:39.231078 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 07:42:39.231078 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 07:42:39.231078 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 07:42:39.231078 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 07:42:39.231078 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 07:42:39.231078 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 07:42:39.231078 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 07:42:39.231078 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 07:42:39.231078 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 07:42:39.231078 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 07:42:39.231078 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 07:42:39.231078 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 07:42:39.231078 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 07:42:39.232139 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 07:42:39.232139 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 07:42:39.232139 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 07:42:39.232139 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 07:42:39.232139 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 07:42:39.232139 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 07:42:39.232139 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 07:42:39.232139 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application with Lock( Sep 16 07:42:39.232139 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 07:42:39.232139 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._enter() Sep 16 07:42:39.232139 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 07:42:39.232139 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 07:42:39.232139 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 07:42:39.232139 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.creator() Sep 16 07:42:39.232139 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 07:42:39.232139 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application created_value = creator( Sep 16 07:42:39.232139 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 07:42:39.233490 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 07:42:39.233490 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 07:42:39.233490 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Sep 16 07:42:39.233490 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 402/814] 10.222.0.57 () {56 vars in 1108 bytes} [Fri Sep 16 07:42:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 07:42:39.233490 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f13a09a-c9db-482c-be63-a100d1b43d5a None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:42:39.240761 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application [None req-c4096d9a-daab-468c-97fa-3c8b614503fd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 07:42:39.240761 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 07:42:39.240761 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 07:42:39.240761 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 07:42:39.240761 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 07:42:39.240761 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 07:42:39.240761 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 07:42:39.240761 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 07:42:39.240761 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 07:42:39.240761 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 07:42:39.240761 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 07:42:39.240761 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 07:42:39.240761 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 16 07:42:39.240761 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 16 07:42:39.240761 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 16 07:42:39.241815 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 16 07:42:39.241815 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 07:42:39.241815 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 07:42:39.241815 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 07:42:39.241815 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 07:42:39.241815 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 07:42:39.241815 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 07:42:39.241815 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 07:42:39.241815 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application with Lock( Sep 16 07:42:39.241815 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 07:42:39.241815 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._enter() Sep 16 07:42:39.241815 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 07:42:39.241815 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 07:42:39.241815 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 07:42:39.241815 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.creator() Sep 16 07:42:39.241815 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 07:42:39.241815 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application created_value = creator( Sep 16 07:42:39.248251 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 16 07:42:39.248251 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 16 07:42:39.248251 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 16 07:42:39.248251 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 16 07:42:39.248251 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 16 07:42:39.248251 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 16 07:42:39.248251 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 07:42:39.248251 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Sep 16 07:42:39.248251 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 413/815] 10.222.0.57 () {56 vars in 1111 bytes} [Fri Sep 16 07:42:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 07:42:39.248251 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4096d9a-daab-468c-97fa-3c8b614503fd None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:42:39.331272 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f13a09a-c9db-482c-be63-a100d1b43d5a None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:42:39.344420 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4096d9a-daab-468c-97fa-3c8b614503fd None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:42:39.365617 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d235c0-e5a9-4ed3-992a-a161cb166f4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:42:39.366273 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d235c0-e5a9-4ed3-992a-a161cb166f4b None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:39.366553 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d235c0-e5a9-4ed3-992a-a161cb166f4b None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:39.366824 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d235c0-e5a9-4ed3-992a-a161cb166f4b None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:39.367393 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d235c0-e5a9-4ed3-992a-a161cb166f4b None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:42:39.368750 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d235c0-e5a9-4ed3-992a-a161cb166f4b None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:42:39.376222 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5243fbb3-01d6-4527-9521-9d33dcc967d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:42:39.376817 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5243fbb3-01d6-4527-9521-9d33dcc967d6 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:39.377093 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5243fbb3-01d6-4527-9521-9d33dcc967d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:39.377361 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5243fbb3-01d6-4527-9521-9d33dcc967d6 None admin] PATH_INFO: `/v3/domains` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:39.378015 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5243fbb3-01d6-4527-9521-9d33dcc967d6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:42:39.378161 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application [None req-35d235c0-e5a9-4ed3-992a-a161cb166f4b None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 16 07:42:39.378161 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 07:42:39.378161 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 16 07:42:39.378161 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 16 07:42:39.378161 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 16 07:42:39.378161 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 16 07:42:39.378161 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 16 07:42:39.378161 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 16 07:42:39.378161 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 16 07:42:39.378161 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Sep 16 07:42:39.378161 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 16 07:42:39.378161 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Sep 16 07:42:39.378161 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 07:42:39.378161 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 07:42:39.378161 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 07:42:39.378161 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 07:42:39.378161 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 07:42:39.381837 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 07:42:39.381837 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 07:42:39.381837 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 07:42:39.381837 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 07:42:39.381837 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 07:42:39.381837 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 07:42:39.381837 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 16 07:42:39.381837 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 16 07:42:39.381837 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 16 07:42:39.381837 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 16 07:42:39.381837 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 07:42:39.381837 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 07:42:39.381837 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 07:42:39.381837 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 07:42:39.381837 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 07:42:39.381837 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 07:42:39.382731 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 07:42:39.382731 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application with Lock( Sep 16 07:42:39.382731 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 07:42:39.382731 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._enter() Sep 16 07:42:39.382731 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 07:42:39.382731 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 07:42:39.382731 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 07:42:39.382731 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.creator() Sep 16 07:42:39.382731 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 07:42:39.382731 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application created_value = creator( Sep 16 07:42:39.382731 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 16 07:42:39.382731 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 16 07:42:39.382731 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 16 07:42:39.382731 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Sep 16 07:42:39.383465 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5243fbb3-01d6-4527-9521-9d33dcc967d6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:42:39.383537 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 403/816] 10.222.0.57 () {56 vars in 1129 bytes} [Fri Sep 16 07:42:39 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 07:42:39.383690 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5243fbb3-01d6-4527-9521-9d33dcc967d6 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:42:39.383768 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d235c0-e5a9-4ed3-992a-a161cb166f4b None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:42:39.392335 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 414/817] 10.222.0.57 () {56 vars in 1109 bytes} [Fri Sep 16 07:42:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:42:39.393136 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5243fbb3-01d6-4527-9521-9d33dcc967d6 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:42:39.428587 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:42:39.454229 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:42:39.483791 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d235c0-e5a9-4ed3-992a-a161cb166f4b None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:42:39.494720 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5243fbb3-01d6-4527-9521-9d33dcc967d6 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:42:39.518532 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f16bed-4d3d-4eab-9938-127dac3052ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:42:39.519131 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f16bed-4d3d-4eab-9938-127dac3052ad None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:39.519402 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f16bed-4d3d-4eab-9938-127dac3052ad None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:39.519669 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f16bed-4d3d-4eab-9938-127dac3052ad None admin] PATH_INFO: `/v3/services` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:39.520275 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f16bed-4d3d-4eab-9938-127dac3052ad None admin] RBAC: Adding query filter params (name=network) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:42:39.520570 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f16bed-4d3d-4eab-9938-127dac3052ad None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:42:39.521947 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f16bed-4d3d-4eab-9938-127dac3052ad None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:42:39.527123 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 404/818] 10.222.0.57 () {56 vars in 1112 bytes} [Fri Sep 16 07:42:39 2022] GET /identity/v3/services?name=network => generated 124 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:42:39.527898 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f16bed-4d3d-4eab-9938-127dac3052ad None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:42:39.533365 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8003da4-0467-4373-99be-fcaa0051dbac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:42:39.534001 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8003da4-0467-4373-99be-fcaa0051dbac None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:39.534284 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8003da4-0467-4373-99be-fcaa0051dbac None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:39.534560 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8003da4-0467-4373-99be-fcaa0051dbac None admin] PATH_INFO: `/v3/domains` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:39.535201 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8003da4-0467-4373-99be-fcaa0051dbac None admin] RBAC: Adding query filter params (name=Default) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:42:39.535504 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8003da4-0467-4373-99be-fcaa0051dbac None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:42:39.536869 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8003da4-0467-4373-99be-fcaa0051dbac None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:42:39.548273 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 415/819] 10.222.0.57 () {56 vars in 1109 bytes} [Fri Sep 16 07:42:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:42:39.549071 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8003da4-0467-4373-99be-fcaa0051dbac None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:42:39.634549 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f16bed-4d3d-4eab-9938-127dac3052ad None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:42:39.646886 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:42:39.671811 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485347ec-b33d-4e9f-b209-a00b994aa92e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:42:39.672426 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485347ec-b33d-4e9f-b209-a00b994aa92e None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:39.672699 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485347ec-b33d-4e9f-b209-a00b994aa92e None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:39.672965 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485347ec-b33d-4e9f-b209-a00b994aa92e None admin] PATH_INFO: `/v3/projects` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:39.673655 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485347ec-b33d-4e9f-b209-a00b994aa92e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:42:39.673984 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485347ec-b33d-4e9f-b209-a00b994aa92e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:42:39.675440 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485347ec-b33d-4e9f-b209-a00b994aa92e None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:42:39.688510 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 405/820] 10.222.0.57 () {56 vars in 1148 bytes} [Fri Sep 16 07:42:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:42:39.689383 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485347ec-b33d-4e9f-b209-a00b994aa92e None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:42:39.761954 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8003da4-0467-4373-99be-fcaa0051dbac None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:42:39.778640 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:42:39.791634 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485347ec-b33d-4e9f-b209-a00b994aa92e None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:42:39.795889 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e4b7ff-b7bb-4cc3-b255-52e6221d8756 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:42:39.796487 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e4b7ff-b7bb-4cc3-b255-52e6221d8756 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:39.796763 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e4b7ff-b7bb-4cc3-b255-52e6221d8756 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:39.797035 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e4b7ff-b7bb-4cc3-b255-52e6221d8756 None admin] PATH_INFO: `/v3/services` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:39.797660 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e4b7ff-b7bb-4cc3-b255-52e6221d8756 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:42:39.797992 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e4b7ff-b7bb-4cc3-b255-52e6221d8756 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:42:39.799358 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e4b7ff-b7bb-4cc3-b255-52e6221d8756 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:42:39.803908 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 416/821] 10.222.0.57 () {56 vars in 1124 bytes} [Fri Sep 16 07:42:39 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:42:39.804687 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e4b7ff-b7bb-4cc3-b255-52e6221d8756 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:42:39.829464 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13baf279-c656-4b85-af6a-d7bcd73c6de2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:42:39.830119 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13baf279-c656-4b85-af6a-d7bcd73c6de2 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:39.830394 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13baf279-c656-4b85-af6a-d7bcd73c6de2 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:39.830667 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13baf279-c656-4b85-af6a-d7bcd73c6de2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:39.837161 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13baf279-c656-4b85-af6a-d7bcd73c6de2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:42:39.839163 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13baf279-c656-4b85-af6a-d7bcd73c6de2 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:42:39.850225 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application [None req-13baf279-c656-4b85-af6a-d7bcd73c6de2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 07:42:39.850225 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 07:42:39.850225 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 07:42:39.850225 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 07:42:39.850225 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 07:42:39.850225 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 07:42:39.850225 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 07:42:39.850225 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 07:42:39.850225 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 07:42:39.850225 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 07:42:39.850225 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 07:42:39.850225 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 07:42:39.850225 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 16 07:42:39.850225 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 16 07:42:39.850225 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 16 07:42:39.851278 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 16 07:42:39.851278 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 07:42:39.851278 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 07:42:39.851278 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 07:42:39.851278 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 07:42:39.851278 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 07:42:39.851278 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 07:42:39.851278 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 07:42:39.851278 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application with Lock( Sep 16 07:42:39.851278 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 07:42:39.851278 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._enter() Sep 16 07:42:39.851278 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 07:42:39.851278 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 07:42:39.851278 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 07:42:39.851278 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.creator() Sep 16 07:42:39.851278 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 07:42:39.851278 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application created_value = creator( Sep 16 07:42:39.852346 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 16 07:42:39.852346 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 16 07:42:39.852346 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 16 07:42:39.852346 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 16 07:42:39.852346 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 16 07:42:39.852346 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 16 07:42:39.852346 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 07:42:39.852346 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Sep 16 07:42:39.852346 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 406/822] 10.222.0.57 () {56 vars in 1111 bytes} [Fri Sep 16 07:42:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 07:42:39.852346 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13baf279-c656-4b85-af6a-d7bcd73c6de2 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:42:39.882657 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:42:39.906024 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e4b7ff-b7bb-4cc3-b255-52e6221d8756 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:42:39.939416 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcb5fca-85e9-41db-aab7-8c965f3df35a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:42:39.940031 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcb5fca-85e9-41db-aab7-8c965f3df35a None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:39.940334 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcb5fca-85e9-41db-aab7-8c965f3df35a None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:39.940603 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcb5fca-85e9-41db-aab7-8c965f3df35a None admin] PATH_INFO: `/v3/services` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:39.941220 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dcb5fca-85e9-41db-aab7-8c965f3df35a None admin] RBAC: Adding query filter params (type=network) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:42:39.941518 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dcb5fca-85e9-41db-aab7-8c965f3df35a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:42:39.942895 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dcb5fca-85e9-41db-aab7-8c965f3df35a None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:42:39.947464 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 417/823] 10.222.0.57 () {56 vars in 1112 bytes} [Fri Sep 16 07:42:39 2022] GET /identity/v3/services?type=network => generated 350 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:42:39.948737 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcb5fca-85e9-41db-aab7-8c965f3df35a None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:42:39.953227 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13baf279-c656-4b85-af6a-d7bcd73c6de2 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:42:39.987113 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a26650-14b4-42dc-a880-3bf76703140d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:42:39.987845 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a26650-14b4-42dc-a880-3bf76703140d None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:39.988126 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a26650-14b4-42dc-a880-3bf76703140d None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:39.988401 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a26650-14b4-42dc-a880-3bf76703140d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:39.994413 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:42:39.996322 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a26650-14b4-42dc-a880-3bf76703140d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:42:39.998119 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a26650-14b4-42dc-a880-3bf76703140d None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:42:40.009468 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application [None req-91a26650-14b4-42dc-a880-3bf76703140d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 07:42:40.009468 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 07:42:40.009468 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 07:42:40.009468 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 07:42:40.009468 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 07:42:40.009468 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 07:42:40.009468 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 07:42:40.009468 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 07:42:40.009468 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 07:42:40.009468 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 07:42:40.009468 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 07:42:40.009468 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 07:42:40.009468 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 16 07:42:40.009468 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 16 07:42:40.009468 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 16 07:42:40.010601 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 16 07:42:40.010601 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 07:42:40.010601 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 07:42:40.010601 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 07:42:40.010601 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 07:42:40.010601 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 07:42:40.010601 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 07:42:40.010601 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 07:42:40.010601 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application with Lock( Sep 16 07:42:40.010601 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 07:42:40.010601 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._enter() Sep 16 07:42:40.010601 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 07:42:40.010601 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 07:42:40.010601 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 07:42:40.010601 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.creator() Sep 16 07:42:40.010601 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 07:42:40.010601 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application created_value = creator( Sep 16 07:42:40.011555 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 16 07:42:40.011555 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 16 07:42:40.011555 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 16 07:42:40.011555 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 16 07:42:40.011555 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 16 07:42:40.011555 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 16 07:42:40.011555 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 07:42:40.011555 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Sep 16 07:42:40.011555 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 407/824] 10.222.0.57 () {56 vars in 1111 bytes} [Fri Sep 16 07:42:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 07:42:40.012070 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a26650-14b4-42dc-a880-3bf76703140d None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:42:40.050689 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcb5fca-85e9-41db-aab7-8c965f3df35a None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:42:40.084237 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f71b0d7-a6b8-43e6-ab6b-e05a16e30217 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:42:40.085136 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f71b0d7-a6b8-43e6-ab6b-e05a16e30217 None admin] REQUEST_METHOD: `PUT` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:40.085411 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f71b0d7-a6b8-43e6-ab6b-e05a16e30217 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:40.085678 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f71b0d7-a6b8-43e6-ab6b-e05a16e30217 None admin] PATH_INFO: `/v3/projects/4735f453c0c24cc4a1c14e9ac84a0b46/users/56eb9bbabb65436bb095952159df184c/roles/f59220af7e7f4a8dbc30ba6325c7827c` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:40.100192 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f71b0d7-a6b8-43e6-ab6b-e05a16e30217 None admin] RBAC: Authorizing `identity:create_grant(project_id=4735f453c0c24cc4a1c14e9ac84a0b46, user_id=56eb9bbabb65436bb095952159df184c, role_id=f59220af7e7f4a8dbc30ba6325c7827c)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:42:40.101087 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:42:40.101659 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f71b0d7-a6b8-43e6-ab6b-e05a16e30217 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:42:40.114808 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a26650-14b4-42dc-a880-3bf76703140d None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:42:40.115209 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 418/825] 10.222.0.57 () {58 vars in 1439 bytes} [Fri Sep 16 07:42:39 2022] PUT /identity/v3/projects/4735f453c0c24cc4a1c14e9ac84a0b46/users/56eb9bbabb65436bb095952159df184c/roles/f59220af7e7f4a8dbc30ba6325c7827c => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 07:42:40.116019 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f71b0d7-a6b8-43e6-ab6b-e05a16e30217 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:42:40.153772 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee341122-3da4-4a73-9e42-e1cbed54373b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:42:40.154512 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee341122-3da4-4a73-9e42-e1cbed54373b None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:40.154798 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee341122-3da4-4a73-9e42-e1cbed54373b None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:40.155098 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee341122-3da4-4a73-9e42-e1cbed54373b None admin] PATH_INFO: `/v3/services` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:40.155736 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee341122-3da4-4a73-9e42-e1cbed54373b None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:42:40.156033 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee341122-3da4-4a73-9e42-e1cbed54373b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:42:40.157444 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee341122-3da4-4a73-9e42-e1cbed54373b None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:42:40.170187 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 408/826] 10.222.0.57 () {56 vars in 1124 bytes} [Fri Sep 16 07:42:40 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:42:40.170187 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee341122-3da4-4a73-9e42-e1cbed54373b None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:42:40.227964 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:42:40.238053 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f71b0d7-a6b8-43e6-ab6b-e05a16e30217 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:42:40.278897 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fec270-78b8-4f4b-9e6d-b1aafae05d26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:42:40.279774 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fec270-78b8-4f4b-9e6d-b1aafae05d26 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:40.280225 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fec270-78b8-4f4b-9e6d-b1aafae05d26 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:40.280649 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fec270-78b8-4f4b-9e6d-b1aafae05d26 None admin] PATH_INFO: `/v3/projects` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:40.281363 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fec270-78b8-4f4b-9e6d-b1aafae05d26 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:42:40.281669 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fec270-78b8-4f4b-9e6d-b1aafae05d26 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:42:40.283161 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fec270-78b8-4f4b-9e6d-b1aafae05d26 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:42:40.283739 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee341122-3da4-4a73-9e42-e1cbed54373b None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:42:40.296570 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 419/827] 10.222.0.57 () {56 vars in 1148 bytes} [Fri Sep 16 07:42:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:42:40.297259 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fec270-78b8-4f4b-9e6d-b1aafae05d26 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:42:40.327118 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947c309d-4831-4104-aea2-0747f0a08541 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:42:40.327718 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947c309d-4831-4104-aea2-0747f0a08541 None admin] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:40.327989 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947c309d-4831-4104-aea2-0747f0a08541 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:40.328253 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947c309d-4831-4104-aea2-0747f0a08541 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:40.328904 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947c309d-4831-4104-aea2-0747f0a08541 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:42:40.330281 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947c309d-4831-4104-aea2-0747f0a08541 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:42:40.353544 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 409/828] 10.222.0.57 () {60 vars in 1144 bytes} [Fri Sep 16 07:42:40 2022] POST /identity/v3/endpoints => generated 337 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 07:42:40.355249 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947c309d-4831-4104-aea2-0747f0a08541 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:42:40.376907 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:42:40.427696 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fec270-78b8-4f4b-9e6d-b1aafae05d26 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:42:40.486771 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14ad2d1-95f5-4370-b0d1-a2b045ea52c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:42:40.487660 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14ad2d1-95f5-4370-b0d1-a2b045ea52c3 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:40.488201 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14ad2d1-95f5-4370-b0d1-a2b045ea52c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:40.488630 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14ad2d1-95f5-4370-b0d1-a2b045ea52c3 None admin] PATH_INFO: `/v3/projects` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:40.489996 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14ad2d1-95f5-4370-b0d1-a2b045ea52c3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:42:40.490481 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14ad2d1-95f5-4370-b0d1-a2b045ea52c3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:42:40.491156 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947c309d-4831-4104-aea2-0747f0a08541 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:42:40.492368 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14ad2d1-95f5-4370-b0d1-a2b045ea52c3 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:42:40.511999 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 420/829] 10.222.0.57 () {56 vars in 1148 bytes} [Fri Sep 16 07:42:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:42:40.513573 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14ad2d1-95f5-4370-b0d1-a2b045ea52c3 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:42:40.532545 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:42:40.533856 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfa1e0e-8825-4f68-a55b-79ad22a416cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:42:40.535137 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfa1e0e-8825-4f68-a55b-79ad22a416cf None admin] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:40.535622 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfa1e0e-8825-4f68-a55b-79ad22a416cf None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:40.536042 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfa1e0e-8825-4f68-a55b-79ad22a416cf None admin] PATH_INFO: `/v3/endpoints` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:40.537140 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adfa1e0e-8825-4f68-a55b-79ad22a416cf None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:42:40.538693 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adfa1e0e-8825-4f68-a55b-79ad22a416cf None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:42:40.565200 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 410/830] 10.222.0.57 () {60 vars in 1144 bytes} [Fri Sep 16 07:42:40 2022] POST /identity/v3/endpoints => generated 346 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 07:42:40.566313 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfa1e0e-8825-4f68-a55b-79ad22a416cf None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:42:40.654520 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14ad2d1-95f5-4370-b0d1-a2b045ea52c3 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:42:40.678116 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:42:40.711007 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb1cde6-240a-4f02-98b3-70944717cf24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:42:40.711680 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb1cde6-240a-4f02-98b3-70944717cf24 None admin] REQUEST_METHOD: `PUT` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:40.711961 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb1cde6-240a-4f02-98b3-70944717cf24 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:40.712237 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb1cde6-240a-4f02-98b3-70944717cf24 None admin] PATH_INFO: `/v3/projects/4735f453c0c24cc4a1c14e9ac84a0b46/users/38abb0283b41449d8183b88912f2574a/roles/567db03c91854ad9af1e9a87ec1bd275` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:40.713664 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfa1e0e-8825-4f68-a55b-79ad22a416cf None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:42:40.714339 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb1cde6-240a-4f02-98b3-70944717cf24 None admin] RBAC: Authorizing `identity:create_grant(project_id=4735f453c0c24cc4a1c14e9ac84a0b46, user_id=38abb0283b41449d8183b88912f2574a, role_id=567db03c91854ad9af1e9a87ec1bd275)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:42:40.716019 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb1cde6-240a-4f02-98b3-70944717cf24 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:42:40.735341 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 421/831] 10.222.0.57 () {58 vars in 1439 bytes} [Fri Sep 16 07:42:40 2022] PUT /identity/v3/projects/4735f453c0c24cc4a1c14e9ac84a0b46/users/38abb0283b41449d8183b88912f2574a/roles/567db03c91854ad9af1e9a87ec1bd275 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 07:42:40.757501 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d321ecf-c2b0-479e-ac0e-4346f4f4a3dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:42:40.758313 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d321ecf-c2b0-479e-ac0e-4346f4f4a3dd None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:40.758656 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d321ecf-c2b0-479e-ac0e-4346f4f4a3dd None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:40.759027 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d321ecf-c2b0-479e-ac0e-4346f4f4a3dd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:40.759835 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d321ecf-c2b0-479e-ac0e-4346f4f4a3dd None admin] RBAC: Adding query filter params (role.id=567db03c91854ad9af1e9a87ec1bd275, scope.project.id=4735f453c0c24cc4a1c14e9ac84a0b46, user.id=9bec4d9b08514461a1bf63c6b88f53b2) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:42:40.760289 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d321ecf-c2b0-479e-ac0e-4346f4f4a3dd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:42:40.765822 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d321ecf-c2b0-479e-ac0e-4346f4f4a3dd None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:42:40.775718 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 411/832] 10.222.0.57 () {56 vars in 1374 bytes} [Fri Sep 16 07:42:40 2022] GET /identity/v3/role_assignments?user.id=9bec4d9b08514461a1bf63c6b88f53b2&scope.project.id=4735f453c0c24cc4a1c14e9ac84a0b46&role.id=567db03c91854ad9af1e9a87ec1bd275 => generated 608 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:42:42.380328 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49794479-23c7-4cc7-b6ff-2ee253a82908 None None] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:42.381192 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49794479-23c7-4cc7-b6ff-2ee253a82908 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:42.381619 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49794479-23c7-4cc7-b6ff-2ee253a82908 None None] PATH_INFO: `/` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:42.383448 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 422/833] 10.222.0.57 () {54 vars in 927 bytes} [Fri Sep 16 07:42:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 07:42:42.389535 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70713c65-ab1a-4262-9ac6-5c299a829377 None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:42.390471 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70713c65-ab1a-4262-9ac6-5c299a829377 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:42.390967 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70713c65-ab1a-4262-9ac6-5c299a829377 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:42.409887 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-70713c65-ab1a-4262-9ac6-5c299a829377 None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:42:42.411404 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-70713c65-ab1a-4262-9ac6-5c299a829377 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:42:42.483026 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 412/834] 10.222.0.57 () {58 vars in 1024 bytes} [Fri Sep 16 07:42:42 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 16 07:42:42.758337 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49794479-23c7-4cc7-b6ff-2ee253a82908 None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:42:42.831995 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:42:42.868064 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49794479-23c7-4cc7-b6ff-2ee253a82908 None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:42:42.871711 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901f8a6b-88ff-4984-ac42-8beb537bdb41 None None] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:42.872001 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901f8a6b-88ff-4984-ac42-8beb537bdb41 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:42.872254 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901f8a6b-88ff-4984-ac42-8beb537bdb41 None None] PATH_INFO: `/` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:42.875272 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 413/835] 10.222.0.57 () {54 vars in 927 bytes} [Fri Sep 16 07:42:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 07:42:42.880322 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5f4a7e-2b38-4851-a444-50766751e7be None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:42.880612 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5f4a7e-2b38-4851-a444-50766751e7be None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:42.880862 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5f4a7e-2b38-4851-a444-50766751e7be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:42.902144 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-0d5f4a7e-2b38-4851-a444-50766751e7be None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:42:42.903510 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-0d5f4a7e-2b38-4851-a444-50766751e7be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:42:42.919548 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff638479-1a2b-4311-b713-335bbb51be24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:42:42.920683 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff638479-1a2b-4311-b713-335bbb51be24 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:42.921123 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff638479-1a2b-4311-b713-335bbb51be24 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:42.921531 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff638479-1a2b-4311-b713-335bbb51be24 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:42.937953 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff638479-1a2b-4311-b713-335bbb51be24 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 07:42:42.944385 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application [None req-ff638479-1a2b-4311-b713-335bbb51be24 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 16 07:42:42.944385 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 07:42:42.944385 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 07:42:42.944385 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 07:42:42.944385 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 07:42:42.944385 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 07:42:42.944385 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 07:42:42.944385 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 07:42:42.944385 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 07:42:42.944385 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 07:42:42.944385 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 07:42:42.944385 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 07:42:42.944385 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 07:42:42.944385 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 07:42:42.944385 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 07:42:42.944385 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 07:42:42.945363 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 07:42:42.945363 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 07:42:42.945363 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 07:42:42.945363 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 07:42:42.945363 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 07:42:42.945363 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 07:42:42.945363 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 07:42:42.945363 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 07:42:42.945363 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 07:42:42.945363 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 07:42:42.945363 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 07:42:42.945363 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application with Lock( Sep 16 07:42:42.945363 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 07:42:42.945363 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._enter() Sep 16 07:42:42.945363 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 07:42:42.945363 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 07:42:42.946241 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 07:42:42.946241 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.creator() Sep 16 07:42:42.946241 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 07:42:42.946241 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application created_value = creator( Sep 16 07:42:42.946241 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 07:42:42.946241 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 07:42:42.946241 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 07:42:42.946241 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 07:42:42.946241 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 07:42:42.946241 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 07:42:42.946241 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 16 07:42:42.946241 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Sep 16 07:42:42.946241 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 423/836] 10.222.0.57 () {56 vars in 1102 bytes} [Fri Sep 16 07:42:42 2022] GET /identity/v3/roles/service => generated 85 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 07:42:42.953609 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff638479-1a2b-4311-b713-335bbb51be24 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:42:42.962881 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:42:42.989888 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 414/837] 10.222.0.57 () {58 vars in 1024 bytes} [Fri Sep 16 07:42:42 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 16 07:42:43.020049 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4c67ae-633d-4d9b-9d17-5f5ae0bf2779 None None] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:43.020285 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4c67ae-633d-4d9b-9d17-5f5ae0bf2779 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:43.021127 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4c67ae-633d-4d9b-9d17-5f5ae0bf2779 None None] PATH_INFO: `/` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:43.022578 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 415/838] 10.222.0.57 () {54 vars in 927 bytes} [Fri Sep 16 07:42:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 16 07:42:43.023678 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98d639e-c029-419d-bc8c-2d0c75f2d42c None None] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:43.024045 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98d639e-c029-419d-bc8c-2d0c75f2d42c None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:43.024390 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98d639e-c029-419d-bc8c-2d0c75f2d42c None None] PATH_INFO: `/` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:43.025998 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 416/839] 10.222.0.57 () {54 vars in 927 bytes} [Fri Sep 16 07:42:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 07:42:43.031344 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1320d7b-78ae-4fdf-8ddb-51dd372edaee None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:43.031774 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1320d7b-78ae-4fdf-8ddb-51dd372edaee None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:43.032051 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1320d7b-78ae-4fdf-8ddb-51dd372edaee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:43.051145 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-d1320d7b-78ae-4fdf-8ddb-51dd372edaee None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:42:43.052345 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-d1320d7b-78ae-4fdf-8ddb-51dd372edaee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:42:43.071145 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff638479-1a2b-4311-b713-335bbb51be24 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:42:43.102045 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:42:43.111843 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996bbe90-a73c-46b7-8bb6-85213c4efa70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:42:43.112529 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996bbe90-a73c-46b7-8bb6-85213c4efa70 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:43.112930 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996bbe90-a73c-46b7-8bb6-85213c4efa70 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:43.113209 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996bbe90-a73c-46b7-8bb6-85213c4efa70 None admin] PATH_INFO: `/v3/roles` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:43.113910 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996bbe90-a73c-46b7-8bb6-85213c4efa70 None admin] RBAC: Adding query filter params (name=service) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:42:43.114217 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996bbe90-a73c-46b7-8bb6-85213c4efa70 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:42:43.115587 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996bbe90-a73c-46b7-8bb6-85213c4efa70 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:42:43.129130 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 424/840] 10.222.0.57 () {56 vars in 1103 bytes} [Fri Sep 16 07:42:42 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 07:42:43.129130 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8191203e-84cc-4398-83aa-875db5f31ec8 None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:43.129130 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8191203e-84cc-4398-83aa-875db5f31ec8 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:43.129130 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8191203e-84cc-4398-83aa-875db5f31ec8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:43.135400 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 417/841] 10.222.0.57 () {58 vars in 1024 bytes} [Fri Sep 16 07:42:43 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 16 07:42:43.144496 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1320d7b-78ae-4fdf-8ddb-51dd372edaee None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:42:43.144862 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-8191203e-84cc-4398-83aa-875db5f31ec8 None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:42:43.146097 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-8191203e-84cc-4398-83aa-875db5f31ec8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:42:43.228101 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 425/842] 10.222.0.57 () {58 vars in 1024 bytes} [Fri Sep 16 07:42:43 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 16 07:42:43.253954 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8191203e-84cc-4398-83aa-875db5f31ec8 None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:42:43.262021 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1320d7b-78ae-4fdf-8ddb-51dd372edaee None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:42:43.278938 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:42:43.298788 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfeda40d-611d-42d1-a183-5a0ca2346d77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:42:43.299492 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfeda40d-611d-42d1-a183-5a0ca2346d77 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:43.299832 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfeda40d-611d-42d1-a183-5a0ca2346d77 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:43.300163 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfeda40d-611d-42d1-a183-5a0ca2346d77 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:43.311140 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfeda40d-611d-42d1-a183-5a0ca2346d77 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:42:43.312664 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfeda40d-611d-42d1-a183-5a0ca2346d77 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:42:43.327270 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application [None req-bfeda40d-611d-42d1-a183-5a0ca2346d77 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 07:42:43.327270 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 07:42:43.327270 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 07:42:43.327270 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 07:42:43.327270 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 07:42:43.327270 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 07:42:43.327270 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 07:42:43.327270 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 07:42:43.327270 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 07:42:43.327270 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 07:42:43.327270 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 07:42:43.327270 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 07:42:43.327270 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 07:42:43.327270 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 07:42:43.327270 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 07:42:43.327270 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 07:42:43.328398 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 07:42:43.328398 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 07:42:43.328398 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 07:42:43.328398 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 07:42:43.328398 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 07:42:43.328398 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 07:42:43.328398 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 07:42:43.328398 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application with Lock( Sep 16 07:42:43.328398 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 07:42:43.328398 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._enter() Sep 16 07:42:43.328398 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 07:42:43.328398 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 07:42:43.328398 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 07:42:43.328398 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.creator() Sep 16 07:42:43.328398 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 07:42:43.328398 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application created_value = creator( Sep 16 07:42:43.328398 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 07:42:43.329495 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 07:42:43.329495 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 07:42:43.329495 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Sep 16 07:42:43.330025 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 418/843] 10.222.0.57 () {56 vars in 1108 bytes} [Fri Sep 16 07:42:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 07:42:43.335493 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfeda40d-611d-42d1-a183-5a0ca2346d77 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:42:43.363904 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8191203e-84cc-4398-83aa-875db5f31ec8 None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:42:43.388117 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:42:43.412408 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f0d892-4e40-420f-b79f-b2c71a8705b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:42:43.413036 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f0d892-4e40-420f-b79f-b2c71a8705b1 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:43.413311 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f0d892-4e40-420f-b79f-b2c71a8705b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:43.413577 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f0d892-4e40-420f-b79f-b2c71a8705b1 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:43.414185 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f0d892-4e40-420f-b79f-b2c71a8705b1 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:42:43.415537 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f0d892-4e40-420f-b79f-b2c71a8705b1 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:42:43.426948 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application [None req-37f0d892-4e40-420f-b79f-b2c71a8705b1 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 16 07:42:43.426948 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 07:42:43.426948 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 16 07:42:43.426948 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 16 07:42:43.426948 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 16 07:42:43.426948 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 16 07:42:43.426948 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 16 07:42:43.426948 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 16 07:42:43.426948 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 16 07:42:43.426948 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Sep 16 07:42:43.426948 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 16 07:42:43.426948 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Sep 16 07:42:43.426948 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 07:42:43.426948 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 07:42:43.426948 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 07:42:43.426948 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 07:42:43.426948 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 07:42:43.428227 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 07:42:43.428227 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 07:42:43.428227 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 07:42:43.428227 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 07:42:43.428227 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 07:42:43.428227 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 07:42:43.428227 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 16 07:42:43.428227 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 16 07:42:43.428227 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 16 07:42:43.428227 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 16 07:42:43.428227 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 07:42:43.428227 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 07:42:43.428227 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 07:42:43.428227 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 07:42:43.428227 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 07:42:43.428227 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 07:42:43.429089 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 07:42:43.429089 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application with Lock( Sep 16 07:42:43.429089 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 07:42:43.429089 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._enter() Sep 16 07:42:43.429089 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 07:42:43.429089 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 07:42:43.429089 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 07:42:43.429089 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.creator() Sep 16 07:42:43.429089 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 07:42:43.429089 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application created_value = creator( Sep 16 07:42:43.429089 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 16 07:42:43.429089 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 16 07:42:43.429089 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 16 07:42:43.429089 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Sep 16 07:42:43.429089 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 426/844] 10.222.0.57 () {56 vars in 1114 bytes} [Fri Sep 16 07:42:43 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 07:42:43.429929 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f0d892-4e40-420f-b79f-b2c71a8705b1 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:42:43.463880 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfeda40d-611d-42d1-a183-5a0ca2346d77 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:42:43.500546 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0511156a-3154-436c-a18d-bd6bc889a532 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:42:43.501214 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0511156a-3154-436c-a18d-bd6bc889a532 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:43.501563 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0511156a-3154-436c-a18d-bd6bc889a532 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:43.501871 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0511156a-3154-436c-a18d-bd6bc889a532 None admin] PATH_INFO: `/v3/domains` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:43.502512 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0511156a-3154-436c-a18d-bd6bc889a532 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:42:43.502815 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0511156a-3154-436c-a18d-bd6bc889a532 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:42:43.504193 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0511156a-3154-436c-a18d-bd6bc889a532 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:42:43.516825 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 419/845] 10.222.0.57 () {56 vars in 1109 bytes} [Fri Sep 16 07:42:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 07:42:43.517638 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0511156a-3154-436c-a18d-bd6bc889a532 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:42:43.538537 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f0d892-4e40-420f-b79f-b2c71a8705b1 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:42:43.546712 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:42:43.574098 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79746b14-29fe-44b4-b579-3c5f3e2ecec1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:42:43.574714 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79746b14-29fe-44b4-b579-3c5f3e2ecec1 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:43.574989 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79746b14-29fe-44b4-b579-3c5f3e2ecec1 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:43.575254 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79746b14-29fe-44b4-b579-3c5f3e2ecec1 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:43.575824 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79746b14-29fe-44b4-b579-3c5f3e2ecec1 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:42:43.577169 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79746b14-29fe-44b4-b579-3c5f3e2ecec1 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:42:43.585923 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application [None req-79746b14-29fe-44b4-b579-3c5f3e2ecec1 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 16 07:42:43.585923 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 07:42:43.585923 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 16 07:42:43.585923 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 16 07:42:43.585923 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 16 07:42:43.585923 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 16 07:42:43.585923 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 16 07:42:43.585923 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 16 07:42:43.585923 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 16 07:42:43.585923 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Sep 16 07:42:43.585923 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 16 07:42:43.585923 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Sep 16 07:42:43.585923 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 07:42:43.585923 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 07:42:43.585923 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 07:42:43.585923 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 07:42:43.587020 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 07:42:43.587020 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 07:42:43.587020 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 07:42:43.587020 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 07:42:43.587020 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 07:42:43.587020 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 07:42:43.587020 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 07:42:43.587020 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 16 07:42:43.587020 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 16 07:42:43.587020 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 16 07:42:43.587020 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 16 07:42:43.587020 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 07:42:43.587020 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 07:42:43.587020 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 07:42:43.587020 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 07:42:43.587020 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 07:42:43.587020 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 07:42:43.587892 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 07:42:43.587892 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application with Lock( Sep 16 07:42:43.587892 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 07:42:43.587892 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._enter() Sep 16 07:42:43.587892 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 07:42:43.587892 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 07:42:43.587892 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 07:42:43.587892 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.creator() Sep 16 07:42:43.587892 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 07:42:43.587892 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application created_value = creator( Sep 16 07:42:43.587892 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 16 07:42:43.587892 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 16 07:42:43.587892 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 16 07:42:43.587892 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Sep 16 07:42:43.587892 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 427/846] 10.222.0.57 () {56 vars in 1132 bytes} [Fri Sep 16 07:42:43 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 07:42:43.589299 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79746b14-29fe-44b4-b579-3c5f3e2ecec1 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:42:43.622337 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0511156a-3154-436c-a18d-bd6bc889a532 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:42:43.636738 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:42:43.656324 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a89405-ca42-479f-8c70-35bc88ef51be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:42:43.656925 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a89405-ca42-479f-8c70-35bc88ef51be None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:43.657196 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a89405-ca42-479f-8c70-35bc88ef51be None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:43.657464 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a89405-ca42-479f-8c70-35bc88ef51be None admin] PATH_INFO: `/v3/services` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:43.658106 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a89405-ca42-479f-8c70-35bc88ef51be None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:42:43.658407 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a89405-ca42-479f-8c70-35bc88ef51be None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:42:43.659754 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a89405-ca42-479f-8c70-35bc88ef51be None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:42:43.664332 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 420/847] 10.222.0.57 () {56 vars in 1114 bytes} [Fri Sep 16 07:42:43 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:42:43.665010 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a89405-ca42-479f-8c70-35bc88ef51be None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:42:43.688102 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79746b14-29fe-44b4-b579-3c5f3e2ecec1 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:42:43.724780 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8928ff-35bd-4f7c-adc6-98913e672691 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:42:43.725399 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8928ff-35bd-4f7c-adc6-98913e672691 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:43.725769 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8928ff-35bd-4f7c-adc6-98913e672691 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:43.726140 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8928ff-35bd-4f7c-adc6-98913e672691 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:43.737506 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8928ff-35bd-4f7c-adc6-98913e672691 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 07:42:43.742759 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application [None req-8d8928ff-35bd-4f7c-adc6-98913e672691 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 16 07:42:43.742759 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 07:42:43.742759 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 07:42:43.742759 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 07:42:43.742759 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 07:42:43.742759 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 07:42:43.742759 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 07:42:43.742759 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 07:42:43.742759 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 07:42:43.742759 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 07:42:43.742759 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 07:42:43.742759 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 07:42:43.742759 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 07:42:43.742759 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 07:42:43.742759 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 07:42:43.742759 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 07:42:43.743821 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 07:42:43.743821 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 07:42:43.743821 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 07:42:43.743821 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 07:42:43.743821 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 07:42:43.743821 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 07:42:43.743821 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 07:42:43.743821 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 07:42:43.743821 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 07:42:43.743821 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 07:42:43.743821 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 07:42:43.743821 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application with Lock( Sep 16 07:42:43.743821 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 07:42:43.743821 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._enter() Sep 16 07:42:43.743821 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 07:42:43.743821 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 07:42:43.745274 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 07:42:43.745274 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.creator() Sep 16 07:42:43.745274 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 07:42:43.745274 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application created_value = creator( Sep 16 07:42:43.745274 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 07:42:43.745274 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 07:42:43.745274 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 07:42:43.745274 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 07:42:43.745274 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 07:42:43.745274 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 07:42:43.745274 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 16 07:42:43.745274 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Sep 16 07:42:43.745274 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 428/848] 10.222.0.57 () {56 vars in 1096 bytes} [Fri Sep 16 07:42:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 07:42:43.746156 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8928ff-35bd-4f7c-adc6-98913e672691 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:42:43.757348 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:42:43.766993 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a89405-ca42-479f-8c70-35bc88ef51be None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:42:43.800761 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b1d55d-0b05-4929-baa6-b647b4a893ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:42:43.801320 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b1d55d-0b05-4929-baa6-b647b4a893ea None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:43.801599 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b1d55d-0b05-4929-baa6-b647b4a893ea None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:43.801905 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b1d55d-0b05-4929-baa6-b647b4a893ea None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:43.809432 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b1d55d-0b05-4929-baa6-b647b4a893ea None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:42:43.810900 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b1d55d-0b05-4929-baa6-b647b4a893ea None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:42:43.822234 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application [None req-31b1d55d-0b05-4929-baa6-b647b4a893ea None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 16 07:42:43.822234 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 07:42:43.822234 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 07:42:43.822234 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 07:42:43.822234 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 07:42:43.822234 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 07:42:43.822234 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 07:42:43.822234 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 07:42:43.822234 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 07:42:43.822234 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 07:42:43.822234 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 07:42:43.822234 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 07:42:43.822234 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 16 07:42:43.822234 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 16 07:42:43.822234 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 16 07:42:43.822234 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 16 07:42:43.823834 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 07:42:43.823834 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 07:42:43.823834 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 16 07:42:43.823834 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 07:42:43.823834 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 16 07:42:43.823834 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 07:42:43.823834 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 07:42:43.823834 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 07:42:43.823834 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 07:42:43.823834 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 07:42:43.823834 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 07:42:43.823834 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application with Lock( Sep 16 07:42:43.823834 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 07:42:43.823834 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._enter() Sep 16 07:42:43.823834 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 07:42:43.823834 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 07:42:43.823834 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 07:42:43.823834 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.creator() Sep 16 07:42:43.824828 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 07:42:43.824828 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application created_value = creator( Sep 16 07:42:43.824828 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 16 07:42:43.824828 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 16 07:42:43.824828 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 16 07:42:43.824828 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 16 07:42:43.824828 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 16 07:42:43.824828 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 16 07:42:43.824828 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 16 07:42:43.824828 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Sep 16 07:42:43.824828 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 421/849] 10.222.0.57 () {56 vars in 1117 bytes} [Fri Sep 16 07:42:43 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 07:42:43.824828 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b1d55d-0b05-4929-baa6-b647b4a893ea None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:42:43.848808 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8928ff-35bd-4f7c-adc6-98913e672691 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:42:43.857933 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:42:43.882651 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4a1810-f9eb-433a-9727-ff0cea7ad31a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:42:43.883241 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4a1810-f9eb-433a-9727-ff0cea7ad31a None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:43.883516 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4a1810-f9eb-433a-9727-ff0cea7ad31a None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:43.883783 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4a1810-f9eb-433a-9727-ff0cea7ad31a None admin] PATH_INFO: `/v3/services` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:43.884396 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4a1810-f9eb-433a-9727-ff0cea7ad31a None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:42:43.884691 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4a1810-f9eb-433a-9727-ff0cea7ad31a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:42:43.886091 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4a1810-f9eb-433a-9727-ff0cea7ad31a None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:42:43.895574 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 429/850] 10.222.0.57 () {56 vars in 1126 bytes} [Fri Sep 16 07:42:43 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:42:43.895574 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4a1810-f9eb-433a-9727-ff0cea7ad31a None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:42:43.929077 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b1d55d-0b05-4929-baa6-b647b4a893ea None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:42:43.962423 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1980b140-f64a-46c8-b4ed-fa5368d6f875 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:42:43.963023 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1980b140-f64a-46c8-b4ed-fa5368d6f875 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:43.963367 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1980b140-f64a-46c8-b4ed-fa5368d6f875 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:43.963705 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1980b140-f64a-46c8-b4ed-fa5368d6f875 None admin] PATH_INFO: `/v3/services` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:43.964325 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1980b140-f64a-46c8-b4ed-fa5368d6f875 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:42:43.964622 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1980b140-f64a-46c8-b4ed-fa5368d6f875 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:42:43.966012 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1980b140-f64a-46c8-b4ed-fa5368d6f875 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:42:43.970353 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 422/851] 10.222.0.57 () {56 vars in 1114 bytes} [Fri Sep 16 07:42:43 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:42:43.971119 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1980b140-f64a-46c8-b4ed-fa5368d6f875 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:42:43.995714 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4a1810-f9eb-433a-9727-ff0cea7ad31a None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:42:43.999761 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:42:44.037118 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0bf661-55a2-4fe1-b449-ccb9a3b83c6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:42:44.037927 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0bf661-55a2-4fe1-b449-ccb9a3b83c6d None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:44.038309 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0bf661-55a2-4fe1-b449-ccb9a3b83c6d None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:44.038682 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0bf661-55a2-4fe1-b449-ccb9a3b83c6d None admin] PATH_INFO: `/v3/roles` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:44.039438 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0bf661-55a2-4fe1-b449-ccb9a3b83c6d None admin] RBAC: Adding query filter params (name=admin) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:42:44.039815 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0bf661-55a2-4fe1-b449-ccb9a3b83c6d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:42:44.041734 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0bf661-55a2-4fe1-b449-ccb9a3b83c6d None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:42:44.053856 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 430/852] 10.222.0.57 () {56 vars in 1099 bytes} [Fri Sep 16 07:42:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:42:44.053856 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0bf661-55a2-4fe1-b449-ccb9a3b83c6d None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:42:44.095197 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1980b140-f64a-46c8-b4ed-fa5368d6f875 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:42:44.096062 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:42:44.135448 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16468805-980c-4b91-91fb-b28332b280ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:42:44.136159 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16468805-980c-4b91-91fb-b28332b280ab None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:44.136390 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16468805-980c-4b91-91fb-b28332b280ab None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:44.136664 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16468805-980c-4b91-91fb-b28332b280ab None admin] PATH_INFO: `/v3/users` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:44.137465 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16468805-980c-4b91-91fb-b28332b280ab None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:42:44.137695 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16468805-980c-4b91-91fb-b28332b280ab None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:42:44.139158 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16468805-980c-4b91-91fb-b28332b280ab None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:42:44.159416 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 423/853] 10.222.0.57 () {56 vars in 1149 bytes} [Fri Sep 16 07:42:43 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:42:44.160437 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16468805-980c-4b91-91fb-b28332b280ab None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:42:44.182770 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0bf661-55a2-4fe1-b449-ccb9a3b83c6d None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:42:44.218635 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e852fb72-8555-4e20-8847-83fd8f032f70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:42:44.221633 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e852fb72-8555-4e20-8847-83fd8f032f70 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:44.221633 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e852fb72-8555-4e20-8847-83fd8f032f70 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:44.221633 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e852fb72-8555-4e20-8847-83fd8f032f70 None admin] PATH_INFO: `/v3/services` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:44.221633 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e852fb72-8555-4e20-8847-83fd8f032f70 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:42:44.221633 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e852fb72-8555-4e20-8847-83fd8f032f70 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:42:44.222999 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e852fb72-8555-4e20-8847-83fd8f032f70 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:42:44.228250 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 431/854] 10.222.0.57 () {56 vars in 1126 bytes} [Fri Sep 16 07:42:44 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:42:44.234816 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e852fb72-8555-4e20-8847-83fd8f032f70 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:42:44.252684 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:42:44.290782 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16468805-980c-4b91-91fb-b28332b280ab None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:42:44.341995 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804cafe3-c14c-47da-8a15-d14c3678e9ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:42:44.343205 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804cafe3-c14c-47da-8a15-d14c3678e9ce None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:44.343647 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804cafe3-c14c-47da-8a15-d14c3678e9ce None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:44.344068 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804cafe3-c14c-47da-8a15-d14c3678e9ce None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:44.356574 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:42:44.359562 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804cafe3-c14c-47da-8a15-d14c3678e9ce None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:42:44.361426 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804cafe3-c14c-47da-8a15-d14c3678e9ce None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:42:44.362028 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e852fb72-8555-4e20-8847-83fd8f032f70 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:42:44.382015 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application [None req-804cafe3-c14c-47da-8a15-d14c3678e9ce None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 07:42:44.382015 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 07:42:44.382015 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 07:42:44.382015 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 07:42:44.382015 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 07:42:44.382015 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 07:42:44.382015 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 07:42:44.382015 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 07:42:44.382015 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 07:42:44.382015 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 07:42:44.382015 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 07:42:44.382015 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 07:42:44.382015 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 07:42:44.382015 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 07:42:44.382015 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 07:42:44.382015 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 07:42:44.383338 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 07:42:44.383338 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 07:42:44.383338 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 07:42:44.383338 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 07:42:44.383338 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 07:42:44.383338 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 07:42:44.383338 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 07:42:44.383338 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application with Lock( Sep 16 07:42:44.383338 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 07:42:44.383338 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._enter() Sep 16 07:42:44.383338 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 07:42:44.383338 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 07:42:44.383338 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 07:42:44.383338 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.creator() Sep 16 07:42:44.383338 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 07:42:44.383338 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application created_value = creator( Sep 16 07:42:44.383338 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 07:42:44.384413 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 07:42:44.384413 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 07:42:44.384413 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Sep 16 07:42:44.390607 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 424/855] 10.222.0.57 () {56 vars in 1108 bytes} [Fri Sep 16 07:42:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 07:42:44.391351 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804cafe3-c14c-47da-8a15-d14c3678e9ce None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:42:44.412613 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a38dd60-cb1b-4461-9d95-934231bec87d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:42:44.413234 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a38dd60-cb1b-4461-9d95-934231bec87d None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:44.413517 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a38dd60-cb1b-4461-9d95-934231bec87d None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:44.413825 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a38dd60-cb1b-4461-9d95-934231bec87d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:44.493473 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a38dd60-cb1b-4461-9d95-934231bec87d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:42:44.495483 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a38dd60-cb1b-4461-9d95-934231bec87d None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:42:44.507394 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804cafe3-c14c-47da-8a15-d14c3678e9ce None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:42:44.535971 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:42:44.547641 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ae8b5e-aa91-4442-89e2-fe05acd4d50d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:42:44.548725 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ae8b5e-aa91-4442-89e2-fe05acd4d50d None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:44.549317 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ae8b5e-aa91-4442-89e2-fe05acd4d50d None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:44.549874 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ae8b5e-aa91-4442-89e2-fe05acd4d50d None admin] PATH_INFO: `/v3/domains` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:44.550732 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ae8b5e-aa91-4442-89e2-fe05acd4d50d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:42:44.551294 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ae8b5e-aa91-4442-89e2-fe05acd4d50d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:42:44.552974 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ae8b5e-aa91-4442-89e2-fe05acd4d50d None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:42:44.567347 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 425/856] 10.222.0.57 () {56 vars in 1109 bytes} [Fri Sep 16 07:42:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 07:42:44.576052 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ae8b5e-aa91-4442-89e2-fe05acd4d50d None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:42:44.600493 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:42:44.606427 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 432/857] 10.222.0.57 () {58 vars in 1282 bytes} [Fri Sep 16 07:42:44 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 16 07:42:44.611813 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a38dd60-cb1b-4461-9d95-934231bec87d None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:42:44.691008 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ae8b5e-aa91-4442-89e2-fe05acd4d50d None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:42:44.719653 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a38dd60-cb1b-4461-9d95-934231bec87d None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:42:44.732381 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c189fe0-c7cf-4afd-be44-afd49eb18e85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:42:44.733371 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c189fe0-c7cf-4afd-be44-afd49eb18e85 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:44.733894 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c189fe0-c7cf-4afd-be44-afd49eb18e85 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:44.734351 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c189fe0-c7cf-4afd-be44-afd49eb18e85 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:44.742662 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c189fe0-c7cf-4afd-be44-afd49eb18e85 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:42:44.744412 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c189fe0-c7cf-4afd-be44-afd49eb18e85 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:42:44.757708 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a277a3d4-7c09-4685-8f18-719eb82ec6f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:42:44.758526 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a277a3d4-7c09-4685-8f18-719eb82ec6f0 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:44.758868 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a277a3d4-7c09-4685-8f18-719eb82ec6f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:44.759206 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a277a3d4-7c09-4685-8f18-719eb82ec6f0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:44.759410 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application [None req-1c189fe0-c7cf-4afd-be44-afd49eb18e85 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 16 07:42:44.759410 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 07:42:44.759410 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 07:42:44.759410 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 07:42:44.759410 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 07:42:44.759410 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 07:42:44.759410 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 07:42:44.759410 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 07:42:44.759410 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 07:42:44.759410 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 07:42:44.759410 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 07:42:44.759410 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 07:42:44.759410 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 16 07:42:44.759410 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 16 07:42:44.759410 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 16 07:42:44.759410 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 16 07:42:44.760561 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 07:42:44.760561 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 07:42:44.760561 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 16 07:42:44.760561 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 07:42:44.760561 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 16 07:42:44.760561 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 07:42:44.760561 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 07:42:44.760561 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 07:42:44.760561 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 07:42:44.760561 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 07:42:44.760561 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 07:42:44.760561 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application with Lock( Sep 16 07:42:44.760561 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 07:42:44.760561 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._enter() Sep 16 07:42:44.760561 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 07:42:44.760561 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 07:42:44.760561 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 07:42:44.760561 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.creator() Sep 16 07:42:44.761542 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 07:42:44.761542 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application created_value = creator( Sep 16 07:42:44.761542 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 16 07:42:44.761542 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 16 07:42:44.761542 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 16 07:42:44.761542 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 16 07:42:44.761542 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 16 07:42:44.761542 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 16 07:42:44.761542 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 16 07:42:44.761542 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Sep 16 07:42:44.767867 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 426/858] 10.222.0.57 () {56 vars in 1096 bytes} [Fri Sep 16 07:42:44 2022] GET /identity/v3/users/swift => generated 83 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 07:42:44.769746 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c189fe0-c7cf-4afd-be44-afd49eb18e85 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:42:44.779070 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a277a3d4-7c09-4685-8f18-719eb82ec6f0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:42:44.780523 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a277a3d4-7c09-4685-8f18-719eb82ec6f0 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:42:44.796171 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application [None req-a277a3d4-7c09-4685-8f18-719eb82ec6f0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 07:42:44.796171 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 07:42:44.796171 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 07:42:44.796171 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 07:42:44.796171 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 07:42:44.796171 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 07:42:44.796171 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 07:42:44.796171 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 07:42:44.796171 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 07:42:44.796171 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 07:42:44.796171 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 07:42:44.796171 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 07:42:44.796171 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 07:42:44.796171 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 07:42:44.796171 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 07:42:44.796171 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 07:42:44.797182 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 07:42:44.797182 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 07:42:44.797182 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 07:42:44.797182 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 07:42:44.797182 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 07:42:44.797182 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 07:42:44.797182 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 07:42:44.797182 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application with Lock( Sep 16 07:42:44.797182 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 07:42:44.797182 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._enter() Sep 16 07:42:44.797182 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 07:42:44.797182 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 07:42:44.797182 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 07:42:44.797182 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.creator() Sep 16 07:42:44.797182 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 07:42:44.797182 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application created_value = creator( Sep 16 07:42:44.797182 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 07:42:44.798138 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 07:42:44.798138 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 07:42:44.798138 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Sep 16 07:42:44.801951 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 433/859] 10.222.0.57 () {56 vars in 1108 bytes} [Fri Sep 16 07:42:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 07:42:44.804952 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a277a3d4-7c09-4685-8f18-719eb82ec6f0 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:42:44.831214 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:42:44.856728 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:42:44.896048 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c189fe0-c7cf-4afd-be44-afd49eb18e85 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:42:44.910799 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a277a3d4-7c09-4685-8f18-719eb82ec6f0 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:42:44.934420 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e1ec1c-0844-4a48-b281-d802d7733fa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:42:44.935795 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e1ec1c-0844-4a48-b281-d802d7733fa3 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:44.936337 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e1ec1c-0844-4a48-b281-d802d7733fa3 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:44.936816 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e1ec1c-0844-4a48-b281-d802d7733fa3 None admin] PATH_INFO: `/v3/users` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:44.938104 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e1ec1c-0844-4a48-b281-d802d7733fa3 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:42:44.938837 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e1ec1c-0844-4a48-b281-d802d7733fa3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:42:44.941110 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e1ec1c-0844-4a48-b281-d802d7733fa3 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:42:44.946550 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5304b90e-6462-4735-926d-4eadadd31189 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:42:44.947158 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5304b90e-6462-4735-926d-4eadadd31189 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:44.947469 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5304b90e-6462-4735-926d-4eadadd31189 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:44.947741 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5304b90e-6462-4735-926d-4eadadd31189 None admin] PATH_INFO: `/v3/domains` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:44.948365 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5304b90e-6462-4735-926d-4eadadd31189 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:42:44.948664 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5304b90e-6462-4735-926d-4eadadd31189 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:42:44.950047 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5304b90e-6462-4735-926d-4eadadd31189 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:42:44.966784 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 427/860] 10.222.0.57 () {56 vars in 1135 bytes} [Fri Sep 16 07:42:44 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:42:44.967179 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 434/861] 10.222.0.57 () {56 vars in 1109 bytes} [Fri Sep 16 07:42:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:42:44.968052 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e1ec1c-0844-4a48-b281-d802d7733fa3 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:42:44.974743 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5304b90e-6462-4735-926d-4eadadd31189 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:42:45.092916 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5304b90e-6462-4735-926d-4eadadd31189 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:42:45.099773 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e1ec1c-0844-4a48-b281-d802d7733fa3 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:42:45.107532 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:42:45.116399 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:42:45.144554 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee5fc40-f8d0-49ec-b16a-996189f106ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:42:45.145198 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee5fc40-f8d0-49ec-b16a-996189f106ec None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:45.145452 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee5fc40-f8d0-49ec-b16a-996189f106ec None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:45.145788 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee5fc40-f8d0-49ec-b16a-996189f106ec None admin] PATH_INFO: `/v3/projects/service` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:45.152065 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c8a359-aca5-4faa-b208-9d6ff2479846 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:42:45.153135 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c8a359-aca5-4faa-b208-9d6ff2479846 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:45.153343 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee5fc40-f8d0-49ec-b16a-996189f106ec None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:42:45.153749 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c8a359-aca5-4faa-b208-9d6ff2479846 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:45.154185 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c8a359-aca5-4faa-b208-9d6ff2479846 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:45.155109 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee5fc40-f8d0-49ec-b16a-996189f106ec None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:42:45.171351 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application [None req-dee5fc40-f8d0-49ec-b16a-996189f106ec None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 07:42:45.171351 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 07:42:45.171351 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 07:42:45.171351 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 07:42:45.171351 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 07:42:45.171351 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 07:42:45.171351 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 07:42:45.171351 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 07:42:45.171351 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 07:42:45.171351 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 07:42:45.171351 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 07:42:45.171351 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 07:42:45.171351 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 16 07:42:45.171351 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 16 07:42:45.171351 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 16 07:42:45.172523 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 16 07:42:45.172523 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 07:42:45.172523 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 07:42:45.172523 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 07:42:45.172523 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 07:42:45.172523 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 07:42:45.172523 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 07:42:45.172523 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 07:42:45.172523 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application with Lock( Sep 16 07:42:45.172523 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 07:42:45.172523 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._enter() Sep 16 07:42:45.172523 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 07:42:45.172523 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 07:42:45.172523 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 07:42:45.172523 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.creator() Sep 16 07:42:45.172523 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 07:42:45.172523 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application created_value = creator( Sep 16 07:42:45.173628 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 16 07:42:45.173628 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 16 07:42:45.173628 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 16 07:42:45.173628 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 16 07:42:45.173628 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 16 07:42:45.173628 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 16 07:42:45.173628 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 07:42:45.173628 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Sep 16 07:42:45.175397 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 428/862] 10.222.0.57 () {56 vars in 1111 bytes} [Fri Sep 16 07:42:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 07:42:45.180844 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee5fc40-f8d0-49ec-b16a-996189f106ec None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:42:45.238885 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c8a359-aca5-4faa-b208-9d6ff2479846 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:42:45.240710 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c8a359-aca5-4faa-b208-9d6ff2479846 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:42:45.304987 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee5fc40-f8d0-49ec-b16a-996189f106ec None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:42:45.342619 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5669579b-164e-4fa2-acbc-af75bac59b60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:42:45.343158 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5669579b-164e-4fa2-acbc-af75bac59b60 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:45.343386 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5669579b-164e-4fa2-acbc-af75bac59b60 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:45.343494 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 435/863] 10.222.0.57 () {58 vars in 1282 bytes} [Fri Sep 16 07:42:44 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 16 07:42:45.343652 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5669579b-164e-4fa2-acbc-af75bac59b60 None admin] PATH_INFO: `/v3/projects` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:45.344330 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5669579b-164e-4fa2-acbc-af75bac59b60 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:42:45.344631 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5669579b-164e-4fa2-acbc-af75bac59b60 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:42:45.350569 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5669579b-164e-4fa2-acbc-af75bac59b60 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:42:45.351302 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c8a359-aca5-4faa-b208-9d6ff2479846 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:42:45.365409 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:42:45.371970 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 429/864] 10.222.0.57 () {56 vars in 1148 bytes} [Fri Sep 16 07:42:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 07:42:45.373254 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5669579b-164e-4fa2-acbc-af75bac59b60 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:42:45.403827 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:42:45.466968 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c8a359-aca5-4faa-b208-9d6ff2479846 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:42:45.487195 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5669579b-164e-4fa2-acbc-af75bac59b60 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:42:45.504083 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db265ff7-90f4-42ec-91a5-9f09001fe76d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:42:45.505096 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db265ff7-90f4-42ec-91a5-9f09001fe76d None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:45.505507 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db265ff7-90f4-42ec-91a5-9f09001fe76d None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:45.505910 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db265ff7-90f4-42ec-91a5-9f09001fe76d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:45.516942 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db265ff7-90f4-42ec-91a5-9f09001fe76d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:42:45.518620 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db265ff7-90f4-42ec-91a5-9f09001fe76d None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:42:45.526244 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47d82ef-6af1-4c8f-ac82-f87db12863f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:42:45.527416 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47d82ef-6af1-4c8f-ac82-f87db12863f1 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:45.527882 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47d82ef-6af1-4c8f-ac82-f87db12863f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:45.528417 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47d82ef-6af1-4c8f-ac82-f87db12863f1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:45.529326 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47d82ef-6af1-4c8f-ac82-f87db12863f1 None admin] RBAC: Adding query filter params (role.id=f59220af7e7f4a8dbc30ba6325c7827c, scope.project.id=4735f453c0c24cc4a1c14e9ac84a0b46, user.id=56eb9bbabb65436bb095952159df184c) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:42:45.529847 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47d82ef-6af1-4c8f-ac82-f87db12863f1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:42:45.531437 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47d82ef-6af1-4c8f-ac82-f87db12863f1 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:42:45.534869 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application [None req-db265ff7-90f4-42ec-91a5-9f09001fe76d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 07:42:45.534869 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 07:42:45.534869 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 07:42:45.534869 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 07:42:45.534869 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 07:42:45.534869 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 07:42:45.534869 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 07:42:45.534869 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 07:42:45.534869 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 07:42:45.534869 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 07:42:45.534869 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 07:42:45.534869 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 07:42:45.534869 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 07:42:45.534869 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 07:42:45.534869 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 07:42:45.534869 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 07:42:45.535835 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 07:42:45.535835 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 07:42:45.535835 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 07:42:45.535835 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 07:42:45.535835 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 07:42:45.535835 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 07:42:45.535835 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 07:42:45.535835 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application with Lock( Sep 16 07:42:45.535835 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 07:42:45.535835 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._enter() Sep 16 07:42:45.535835 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 07:42:45.535835 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 07:42:45.535835 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 07:42:45.535835 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.creator() Sep 16 07:42:45.535835 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 07:42:45.535835 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application created_value = creator( Sep 16 07:42:45.535835 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 07:42:45.536730 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 07:42:45.536730 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 07:42:45.536730 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Sep 16 07:42:45.540422 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 430/866] 10.222.0.57 () {56 vars in 1374 bytes} [Fri Sep 16 07:42:45 2022] GET /identity/v3/role_assignments?user.id=56eb9bbabb65436bb095952159df184c&scope.project.id=4735f453c0c24cc4a1c14e9ac84a0b46&role.id=f59220af7e7f4a8dbc30ba6325c7827c => generated 608 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 07:42:45.541795 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 436/866] 10.222.0.57 () {56 vars in 1108 bytes} [Fri Sep 16 07:42:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 16 07:42:45.547757 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47d82ef-6af1-4c8f-ac82-f87db12863f1 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:42:45.650087 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:42:45.664225 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47d82ef-6af1-4c8f-ac82-f87db12863f1 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:42:45.703619 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa30082e-567f-4f08-8f61-7f891d1d1a2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:42:45.704284 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa30082e-567f-4f08-8f61-7f891d1d1a2f None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:45.704566 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa30082e-567f-4f08-8f61-7f891d1d1a2f None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:45.704837 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa30082e-567f-4f08-8f61-7f891d1d1a2f None admin] PATH_INFO: `/v3/domains` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:45.705483 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa30082e-567f-4f08-8f61-7f891d1d1a2f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:42:45.705810 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa30082e-567f-4f08-8f61-7f891d1d1a2f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:42:45.707199 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa30082e-567f-4f08-8f61-7f891d1d1a2f None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:42:45.720659 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 431/867] 10.222.0.57 () {56 vars in 1109 bytes} [Fri Sep 16 07:42:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:42:45.726352 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db265ff7-90f4-42ec-91a5-9f09001fe76d None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:42:45.792821 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:42:45.833660 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db265ff7-90f4-42ec-91a5-9f09001fe76d None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:42:45.869962 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0190ff95-9e47-47fe-bffa-fc42cb8bf124 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:42:45.870649 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0190ff95-9e47-47fe-bffa-fc42cb8bf124 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:45.870933 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0190ff95-9e47-47fe-bffa-fc42cb8bf124 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:45.871204 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0190ff95-9e47-47fe-bffa-fc42cb8bf124 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:45.878575 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0190ff95-9e47-47fe-bffa-fc42cb8bf124 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:42:45.880272 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0190ff95-9e47-47fe-bffa-fc42cb8bf124 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:42:45.892219 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application [None req-0190ff95-9e47-47fe-bffa-fc42cb8bf124 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 07:42:45.892219 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 07:42:45.892219 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 07:42:45.892219 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 07:42:45.892219 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 07:42:45.892219 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 07:42:45.892219 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 07:42:45.892219 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 07:42:45.892219 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 07:42:45.892219 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 07:42:45.892219 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 07:42:45.892219 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 07:42:45.892219 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 16 07:42:45.892219 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 16 07:42:45.892219 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 16 07:42:45.893135 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 16 07:42:45.893135 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 07:42:45.893135 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 07:42:45.893135 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 07:42:45.893135 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 07:42:45.893135 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 07:42:45.893135 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 07:42:45.893135 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 07:42:45.893135 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application with Lock( Sep 16 07:42:45.893135 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 07:42:45.893135 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._enter() Sep 16 07:42:45.893135 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 07:42:45.893135 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 07:42:45.893135 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 07:42:45.893135 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.creator() Sep 16 07:42:45.893135 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 07:42:45.893135 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application created_value = creator( Sep 16 07:42:45.894078 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 16 07:42:45.894078 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 16 07:42:45.894078 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 16 07:42:45.894078 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 16 07:42:45.894078 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 16 07:42:45.894078 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 16 07:42:45.894078 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 07:42:45.894078 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Sep 16 07:42:45.894078 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 437/868] 10.222.0.57 () {56 vars in 1111 bytes} [Fri Sep 16 07:42:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 07:42:45.901494 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa30082e-567f-4f08-8f61-7f891d1d1a2f None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:42:46.007507 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa30082e-567f-4f08-8f61-7f891d1d1a2f None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:42:46.043819 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b68d5eb-b69b-4a91-9977-29c8bf4629ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:42:46.044488 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b68d5eb-b69b-4a91-9977-29c8bf4629ad None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:46.044765 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b68d5eb-b69b-4a91-9977-29c8bf4629ad None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:46.045036 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b68d5eb-b69b-4a91-9977-29c8bf4629ad None admin] PATH_INFO: `/v3/projects` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:46.045797 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b68d5eb-b69b-4a91-9977-29c8bf4629ad None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:42:46.046105 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b68d5eb-b69b-4a91-9977-29c8bf4629ad None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:42:46.047602 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b68d5eb-b69b-4a91-9977-29c8bf4629ad None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:42:46.060890 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 432/869] 10.222.0.57 () {56 vars in 1148 bytes} [Fri Sep 16 07:42:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 07:42:46.066882 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0190ff95-9e47-47fe-bffa-fc42cb8bf124 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:42:46.193856 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0190ff95-9e47-47fe-bffa-fc42cb8bf124 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:42:46.212105 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:42:46.225062 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fda5c7f-db05-43ae-8201-ec7169629664 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:42:46.225668 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fda5c7f-db05-43ae-8201-ec7169629664 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:46.225976 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fda5c7f-db05-43ae-8201-ec7169629664 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:46.226249 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fda5c7f-db05-43ae-8201-ec7169629664 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:46.226976 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fda5c7f-db05-43ae-8201-ec7169629664 None admin] RBAC: Adding query filter params (role.id=567db03c91854ad9af1e9a87ec1bd275, scope.project.id=4735f453c0c24cc4a1c14e9ac84a0b46, user.id=38abb0283b41449d8183b88912f2574a) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:42:46.227285 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fda5c7f-db05-43ae-8201-ec7169629664 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:42:46.228897 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fda5c7f-db05-43ae-8201-ec7169629664 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:42:46.234843 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387bd6a0-cd4e-4bba-96e5-461e1b9be63c None None] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:46.235126 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387bd6a0-cd4e-4bba-96e5-461e1b9be63c None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:46.235359 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 438/870] 10.222.0.57 () {56 vars in 1374 bytes} [Fri Sep 16 07:42:46 2022] GET /identity/v3/role_assignments?user.id=38abb0283b41449d8183b88912f2574a&scope.project.id=4735f453c0c24cc4a1c14e9ac84a0b46&role.id=567db03c91854ad9af1e9a87ec1bd275 => generated 608 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:42:46.235483 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387bd6a0-cd4e-4bba-96e5-461e1b9be63c None None] PATH_INFO: `/` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:46.236892 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 433/871] 10.222.0.57 () {54 vars in 927 bytes} [Fri Sep 16 07:42:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 16 07:42:46.242835 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa89a02d-f98f-4316-bbcf-ad905e905b19 None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:46.243152 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa89a02d-f98f-4316-bbcf-ad905e905b19 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:46.243394 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa89a02d-f98f-4316-bbcf-ad905e905b19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:46.267877 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-aa89a02d-f98f-4316-bbcf-ad905e905b19 None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:42:46.269112 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-aa89a02d-f98f-4316-bbcf-ad905e905b19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:42:46.349251 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 439/872] 10.222.0.57 () {58 vars in 1024 bytes} [Fri Sep 16 07:42:46 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 16 07:42:46.505503 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6dc7a5-69f0-4995-9d89-14a16add810a None None] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:46.505694 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6dc7a5-69f0-4995-9d89-14a16add810a None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:46.506000 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6dc7a5-69f0-4995-9d89-14a16add810a None None] PATH_INFO: `/` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:46.507597 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 434/873] 10.222.0.57 () {54 vars in 927 bytes} [Fri Sep 16 07:42:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 07:42:46.515273 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197b3b6d-075b-4e33-b8cd-22f7cc2377e2 None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:46.515733 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197b3b6d-075b-4e33-b8cd-22f7cc2377e2 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:46.515985 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197b3b6d-075b-4e33-b8cd-22f7cc2377e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:46.535758 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-197b3b6d-075b-4e33-b8cd-22f7cc2377e2 None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:42:46.536949 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-197b3b6d-075b-4e33-b8cd-22f7cc2377e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:42:46.609837 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 440/874] 10.222.0.57 () {58 vars in 1024 bytes} [Fri Sep 16 07:42:46 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 16 07:42:46.625842 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6dc7a5-69f0-4995-9d89-14a16add810a None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:42:46.639862 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:42:46.741313 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6dc7a5-69f0-4995-9d89-14a16add810a None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:42:46.777506 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db803019-0e6e-4e4a-a479-458b2942cc4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:42:46.778062 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db803019-0e6e-4e4a-a479-458b2942cc4c None admin] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:46.778337 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db803019-0e6e-4e4a-a479-458b2942cc4c None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:46.778612 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db803019-0e6e-4e4a-a479-458b2942cc4c None admin] PATH_INFO: `/v3/services` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:46.779304 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db803019-0e6e-4e4a-a479-458b2942cc4c None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:42:46.780669 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db803019-0e6e-4e4a-a479-458b2942cc4c None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:42:46.795477 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 435/875] 10.222.0.57 () {60 vars in 1141 bytes} [Fri Sep 16 07:42:46 2022] POST /identity/v3/services => generated 251 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 07:42:46.889983 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197b3b6d-075b-4e33-b8cd-22f7cc2377e2 None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:42:46.940356 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:42:46.996986 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197b3b6d-075b-4e33-b8cd-22f7cc2377e2 None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:42:47.039063 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619c91de-1e20-4ad7-b616-858814faf3dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:42:47.039603 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619c91de-1e20-4ad7-b616-858814faf3dd None admin] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:47.039880 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619c91de-1e20-4ad7-b616-858814faf3dd None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:47.040152 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619c91de-1e20-4ad7-b616-858814faf3dd None admin] PATH_INFO: `/v3/services` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:47.040806 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619c91de-1e20-4ad7-b616-858814faf3dd None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:42:47.042513 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619c91de-1e20-4ad7-b616-858814faf3dd None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:42:47.059041 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 441/876] 10.222.0.57 () {60 vars in 1141 bytes} [Fri Sep 16 07:42:46 2022] POST /identity/v3/services => generated 269 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 07:42:48.011008 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd3c82c-643b-40ea-9c25-bb43a57d3c06 None None] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:48.011580 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd3c82c-643b-40ea-9c25-bb43a57d3c06 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:48.011850 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd3c82c-643b-40ea-9c25-bb43a57d3c06 None None] PATH_INFO: `/` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:48.013537 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 436/877] 10.222.0.57 () {54 vars in 927 bytes} [Fri Sep 16 07:42:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 07:42:48.018849 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2846b4a-ac85-490a-9c27-ea1a0b2f8863 None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:48.019245 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2846b4a-ac85-490a-9c27-ea1a0b2f8863 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:48.019585 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2846b4a-ac85-490a-9c27-ea1a0b2f8863 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:48.038490 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-e2846b4a-ac85-490a-9c27-ea1a0b2f8863 None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:42:48.039675 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-e2846b4a-ac85-490a-9c27-ea1a0b2f8863 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:42:48.116118 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 442/878] 10.222.0.57 () {58 vars in 1024 bytes} [Fri Sep 16 07:42:48 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 16 07:42:48.395396 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd3c82c-643b-40ea-9c25-bb43a57d3c06 None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:42:48.474662 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:42:48.512067 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd3c82c-643b-40ea-9c25-bb43a57d3c06 None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:42:48.546732 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47206ff-cb62-4b24-b6c9-5f44ea911d29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:42:48.547367 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47206ff-cb62-4b24-b6c9-5f44ea911d29 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:48.547643 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47206ff-cb62-4b24-b6c9-5f44ea911d29 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:48.547916 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47206ff-cb62-4b24-b6c9-5f44ea911d29 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:48.559378 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47206ff-cb62-4b24-b6c9-5f44ea911d29 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 07:42:48.564172 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application [None req-e47206ff-cb62-4b24-b6c9-5f44ea911d29 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 16 07:42:48.564172 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 07:42:48.564172 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 07:42:48.564172 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 07:42:48.564172 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 07:42:48.564172 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 07:42:48.564172 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 07:42:48.564172 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 07:42:48.564172 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 07:42:48.564172 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 07:42:48.564172 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 07:42:48.564172 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 07:42:48.564172 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 07:42:48.564172 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 07:42:48.564172 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 07:42:48.564172 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 07:42:48.565135 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 07:42:48.565135 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 07:42:48.565135 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 07:42:48.565135 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 07:42:48.565135 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 07:42:48.565135 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 07:42:48.565135 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 07:42:48.565135 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 07:42:48.565135 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 07:42:48.565135 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 07:42:48.565135 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 07:42:48.565135 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application with Lock( Sep 16 07:42:48.565135 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 07:42:48.565135 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._enter() Sep 16 07:42:48.565135 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 07:42:48.565135 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 07:42:48.565990 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 07:42:48.565990 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.creator() Sep 16 07:42:48.565990 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 07:42:48.565990 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application created_value = creator( Sep 16 07:42:48.565990 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 07:42:48.565990 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 07:42:48.565990 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 07:42:48.565990 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 07:42:48.565990 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 07:42:48.565990 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 07:42:48.565990 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 16 07:42:48.565990 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Sep 16 07:42:48.565990 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 437/879] 10.222.0.57 () {56 vars in 1120 bytes} [Fri Sep 16 07:42:48 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 07:42:48.571440 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2846b4a-ac85-490a-9c27-ea1a0b2f8863 None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:42:48.574325 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf0bdc2-b2e1-4f1d-8b2e-86f6f1316a59 None None] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:48.574611 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf0bdc2-b2e1-4f1d-8b2e-86f6f1316a59 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:48.574888 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf0bdc2-b2e1-4f1d-8b2e-86f6f1316a59 None None] PATH_INFO: `/` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:48.576540 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 438/880] 10.222.0.57 () {54 vars in 927 bytes} [Fri Sep 16 07:42:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 07:42:48.581500 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecb46aa-fb5f-4bd7-b49e-c79c2291d701 None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:48.581808 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecb46aa-fb5f-4bd7-b49e-c79c2291d701 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:48.582086 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecb46aa-fb5f-4bd7-b49e-c79c2291d701 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:48.601087 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-5ecb46aa-fb5f-4bd7-b49e-c79c2291d701 None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:42:48.602484 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:42:48.603638 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-5ecb46aa-fb5f-4bd7-b49e-c79c2291d701 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:42:48.686225 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 439/881] 10.222.0.57 () {58 vars in 1024 bytes} [Fri Sep 16 07:42:48 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 16 07:42:48.691918 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2846b4a-ac85-490a-9c27-ea1a0b2f8863 None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:42:48.727369 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361c2930-6ad2-4839-a2fd-e420e4aace51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:42:48.728132 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361c2930-6ad2-4839-a2fd-e420e4aace51 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:48.728456 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361c2930-6ad2-4839-a2fd-e420e4aace51 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:48.728838 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361c2930-6ad2-4839-a2fd-e420e4aace51 None admin] PATH_INFO: `/v3/roles` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:48.729503 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361c2930-6ad2-4839-a2fd-e420e4aace51 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:42:48.729854 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361c2930-6ad2-4839-a2fd-e420e4aace51 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:42:48.731229 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361c2930-6ad2-4839-a2fd-e420e4aace51 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:42:48.739676 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 443/882] 10.222.0.57 () {56 vars in 1115 bytes} [Fri Sep 16 07:42:48 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:42:48.746094 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecb46aa-fb5f-4bd7-b49e-c79c2291d701 None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:42:48.810391 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:42:48.848637 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecb46aa-fb5f-4bd7-b49e-c79c2291d701 None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:42:48.884107 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9495a7-a780-4cb0-91e2-a7bbb5c2add2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:42:48.885290 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9495a7-a780-4cb0-91e2-a7bbb5c2add2 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:48.885572 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9495a7-a780-4cb0-91e2-a7bbb5c2add2 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:48.886012 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9495a7-a780-4cb0-91e2-a7bbb5c2add2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:48.896329 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9495a7-a780-4cb0-91e2-a7bbb5c2add2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:42:48.897803 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9495a7-a780-4cb0-91e2-a7bbb5c2add2 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:42:48.912771 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application [None req-0b9495a7-a780-4cb0-91e2-a7bbb5c2add2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 07:42:48.912771 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 07:42:48.912771 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 07:42:48.912771 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 07:42:48.912771 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 07:42:48.912771 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 07:42:48.912771 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 07:42:48.912771 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 07:42:48.912771 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 07:42:48.912771 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 07:42:48.912771 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 07:42:48.912771 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 07:42:48.912771 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 07:42:48.912771 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 07:42:48.912771 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 07:42:48.912771 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 07:42:48.914983 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 07:42:48.914983 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 07:42:48.914983 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 07:42:48.914983 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 07:42:48.914983 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 07:42:48.914983 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 07:42:48.914983 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 07:42:48.914983 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application with Lock( Sep 16 07:42:48.914983 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 07:42:48.914983 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._enter() Sep 16 07:42:48.914983 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 07:42:48.914983 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 07:42:48.914983 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 07:42:48.914983 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.creator() Sep 16 07:42:48.914983 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 07:42:48.914983 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application created_value = creator( Sep 16 07:42:48.914983 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 07:42:48.917150 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 07:42:48.917150 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 07:42:48.917150 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Sep 16 07:42:48.917150 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 440/883] 10.222.0.57 () {56 vars in 1108 bytes} [Fri Sep 16 07:42:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 16 07:42:48.920072 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361c2930-6ad2-4839-a2fd-e420e4aace51 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:42:48.966536 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9495a7-a780-4cb0-91e2-a7bbb5c2add2 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:42:49.029230 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:42:49.042901 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361c2930-6ad2-4839-a2fd-e420e4aace51 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:42:49.083936 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6793ca63-4c98-448c-bf4c-3a797169be1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:42:49.084844 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6793ca63-4c98-448c-bf4c-3a797169be1f None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:49.085309 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6793ca63-4c98-448c-bf4c-3a797169be1f None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:49.085579 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6793ca63-4c98-448c-bf4c-3a797169be1f None admin] PATH_INFO: `/v3/domains` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:49.086252 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6793ca63-4c98-448c-bf4c-3a797169be1f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:42:49.086352 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9495a7-a780-4cb0-91e2-a7bbb5c2add2 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:42:49.086762 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6793ca63-4c98-448c-bf4c-3a797169be1f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:42:49.087923 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6793ca63-4c98-448c-bf4c-3a797169be1f None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:42:49.098003 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:42:49.104885 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 444/884] 10.222.0.57 () {56 vars in 1109 bytes} [Fri Sep 16 07:42:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:42:49.104885 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d482237-a8a4-494a-858a-2ae2fead82e1 None None] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:49.104885 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d482237-a8a4-494a-858a-2ae2fead82e1 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:49.104885 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d482237-a8a4-494a-858a-2ae2fead82e1 None None] PATH_INFO: `/` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:49.104885 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 445/885] 10.222.0.57 () {54 vars in 927 bytes} [Fri Sep 16 07:42:49 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 07:42:49.108219 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d482237-a8a4-494a-858a-2ae2fead82e1 None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:42:49.135663 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f10d08-c681-4dd2-810e-68072d75c955 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:42:49.136326 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f10d08-c681-4dd2-810e-68072d75c955 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:49.136604 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f10d08-c681-4dd2-810e-68072d75c955 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:49.136877 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f10d08-c681-4dd2-810e-68072d75c955 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:49.137452 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f10d08-c681-4dd2-810e-68072d75c955 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:42:49.138849 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f10d08-c681-4dd2-810e-68072d75c955 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:42:49.150442 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application [None req-01f10d08-c681-4dd2-810e-68072d75c955 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 16 07:42:49.150442 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 07:42:49.150442 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 16 07:42:49.150442 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 16 07:42:49.150442 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 16 07:42:49.150442 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 16 07:42:49.150442 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 16 07:42:49.150442 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 16 07:42:49.150442 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 16 07:42:49.150442 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Sep 16 07:42:49.150442 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 16 07:42:49.150442 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Sep 16 07:42:49.150442 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 07:42:49.150442 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 07:42:49.150442 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 07:42:49.150442 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 07:42:49.150442 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 07:42:49.151598 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 07:42:49.151598 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 07:42:49.151598 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 07:42:49.151598 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 07:42:49.151598 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 07:42:49.151598 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 07:42:49.151598 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 16 07:42:49.151598 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 16 07:42:49.151598 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 16 07:42:49.151598 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 16 07:42:49.151598 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 07:42:49.151598 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 07:42:49.151598 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 07:42:49.151598 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 07:42:49.151598 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 07:42:49.151598 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 07:42:49.152448 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 07:42:49.152448 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application with Lock( Sep 16 07:42:49.152448 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 07:42:49.152448 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._enter() Sep 16 07:42:49.152448 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 07:42:49.152448 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 07:42:49.152448 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 07:42:49.152448 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.creator() Sep 16 07:42:49.152448 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 07:42:49.152448 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application created_value = creator( Sep 16 07:42:49.152448 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 16 07:42:49.152448 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 16 07:42:49.152448 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 16 07:42:49.152448 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Sep 16 07:42:49.152448 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 441/886] 10.222.0.57 () {56 vars in 1126 bytes} [Fri Sep 16 07:42:48 2022] GET /identity/v3/services/object-store => generated 93 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 16 07:42:49.153335 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5865a9f6-51c3-4268-b18e-8720f65498a5 None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:49.153335 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5865a9f6-51c3-4268-b18e-8720f65498a5 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:49.153335 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5865a9f6-51c3-4268-b18e-8720f65498a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:49.177485 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-5865a9f6-51c3-4268-b18e-8720f65498a5 None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:42:49.179427 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-5865a9f6-51c3-4268-b18e-8720f65498a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:42:49.224895 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d482237-a8a4-494a-858a-2ae2fead82e1 None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:42:49.273758 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 442/887] 10.222.0.57 () {58 vars in 1024 bytes} [Fri Sep 16 07:42:49 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 16 07:42:49.273758 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5865a9f6-51c3-4268-b18e-8720f65498a5 None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:42:49.276273 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11388046-2a45-407e-b9e0-7350f80dfefc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:42:49.277043 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11388046-2a45-407e-b9e0-7350f80dfefc None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:49.277379 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11388046-2a45-407e-b9e0-7350f80dfefc None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:49.277768 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11388046-2a45-407e-b9e0-7350f80dfefc None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:49.286200 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11388046-2a45-407e-b9e0-7350f80dfefc None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:42:49.287928 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11388046-2a45-407e-b9e0-7350f80dfefc None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:42:49.301100 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application [None req-11388046-2a45-407e-b9e0-7350f80dfefc None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 16 07:42:49.301100 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 07:42:49.301100 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 07:42:49.301100 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 07:42:49.301100 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 07:42:49.301100 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 07:42:49.301100 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 07:42:49.301100 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 07:42:49.301100 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 07:42:49.301100 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 07:42:49.301100 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 07:42:49.301100 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 07:42:49.301100 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 16 07:42:49.301100 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 16 07:42:49.301100 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 16 07:42:49.301100 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 16 07:42:49.302121 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 07:42:49.302121 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 07:42:49.302121 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 16 07:42:49.302121 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 07:42:49.302121 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 16 07:42:49.302121 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 07:42:49.302121 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 07:42:49.302121 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 07:42:49.302121 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 07:42:49.302121 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 07:42:49.302121 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 07:42:49.302121 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application with Lock( Sep 16 07:42:49.302121 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 07:42:49.302121 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._enter() Sep 16 07:42:49.302121 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 07:42:49.302121 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 07:42:49.302121 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 07:42:49.302121 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.creator() Sep 16 07:42:49.303075 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 07:42:49.303075 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application created_value = creator( Sep 16 07:42:49.303075 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 16 07:42:49.303075 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 16 07:42:49.303075 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 16 07:42:49.303075 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 16 07:42:49.303075 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 16 07:42:49.303075 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 16 07:42:49.303075 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 16 07:42:49.303075 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Sep 16 07:42:49.303075 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 446/888] 10.222.0.57 () {56 vars in 1117 bytes} [Fri Sep 16 07:42:49 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 07:42:49.308527 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11388046-2a45-407e-b9e0-7350f80dfefc None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:42:49.321832 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:42:49.382925 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5865a9f6-51c3-4268-b18e-8720f65498a5 None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:42:49.387033 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:42:49.418932 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11388046-2a45-407e-b9e0-7350f80dfefc None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:42:49.421826 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a92714-6078-42ff-bc3f-a21dfa0d7afc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:42:49.422305 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a92714-6078-42ff-bc3f-a21dfa0d7afc None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:49.422580 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a92714-6078-42ff-bc3f-a21dfa0d7afc None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:49.422852 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a92714-6078-42ff-bc3f-a21dfa0d7afc None admin] PATH_INFO: `/v3/services` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:49.423468 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a92714-6078-42ff-bc3f-a21dfa0d7afc None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:42:49.423765 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a92714-6078-42ff-bc3f-a21dfa0d7afc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:42:49.425133 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a92714-6078-42ff-bc3f-a21dfa0d7afc None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:42:49.430926 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 443/889] 10.222.0.57 () {56 vars in 1122 bytes} [Fri Sep 16 07:42:49 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:42:49.432454 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f777bd18-7216-4892-995f-f60505de5152 None None] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:49.432964 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f777bd18-7216-4892-995f-f60505de5152 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:49.433442 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f777bd18-7216-4892-995f-f60505de5152 None None] PATH_INFO: `/` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:49.435068 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 444/890] 10.222.0.57 () {54 vars in 927 bytes} [Fri Sep 16 07:42:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 07:42:49.436064 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f777bd18-7216-4892-995f-f60505de5152 None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:42:49.463774 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58a7aec-05ac-425b-a689-2e2f66886fe3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:42:49.464657 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58a7aec-05ac-425b-a689-2e2f66886fe3 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:49.464836 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58a7aec-05ac-425b-a689-2e2f66886fe3 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:49.465088 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58a7aec-05ac-425b-a689-2e2f66886fe3 None admin] PATH_INFO: `/v3/users` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:49.465991 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58a7aec-05ac-425b-a689-2e2f66886fe3 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:42:49.466201 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58a7aec-05ac-425b-a689-2e2f66886fe3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:42:49.467732 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58a7aec-05ac-425b-a689-2e2f66886fe3 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:42:49.486096 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 447/891] 10.222.0.57 () {56 vars in 1149 bytes} [Fri Sep 16 07:42:49 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 07:42:49.487291 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c21548-dee1-4180-bbe6-4ad0d6398404 None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:49.487583 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c21548-dee1-4180-bbe6-4ad0d6398404 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:49.487855 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c21548-dee1-4180-bbe6-4ad0d6398404 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:49.507089 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-74c21548-dee1-4180-bbe6-4ad0d6398404 None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:42:49.508270 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-74c21548-dee1-4180-bbe6-4ad0d6398404 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:42:49.548881 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f777bd18-7216-4892-995f-f60505de5152 None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:42:49.572753 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:42:49.578958 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 448/892] 10.222.0.57 () {58 vars in 1024 bytes} [Fri Sep 16 07:42:49 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 16 07:42:49.579783 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c21548-dee1-4180-bbe6-4ad0d6398404 None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:42:49.596947 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31329530-387a-47d9-b3f9-dd9460211cb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:42:49.597912 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31329530-387a-47d9-b3f9-dd9460211cb9 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:49.598390 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31329530-387a-47d9-b3f9-dd9460211cb9 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:49.598832 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31329530-387a-47d9-b3f9-dd9460211cb9 None admin] PATH_INFO: `/v3/services` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:49.599622 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31329530-387a-47d9-b3f9-dd9460211cb9 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:42:49.600088 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31329530-387a-47d9-b3f9-dd9460211cb9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:42:49.601676 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31329530-387a-47d9-b3f9-dd9460211cb9 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:42:49.607862 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 445/893] 10.222.0.57 () {56 vars in 1122 bytes} [Fri Sep 16 07:42:49 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 07:42:49.608777 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31329530-387a-47d9-b3f9-dd9460211cb9 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:42:49.652581 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:42:49.723027 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c21548-dee1-4180-bbe6-4ad0d6398404 None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:42:49.735053 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31329530-387a-47d9-b3f9-dd9460211cb9 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:42:49.772072 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f882e9ed-b439-477c-8214-b24068730d6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:42:49.772614 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f882e9ed-b439-477c-8214-b24068730d6d None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:49.772891 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f882e9ed-b439-477c-8214-b24068730d6d None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:49.773160 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f882e9ed-b439-477c-8214-b24068730d6d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:49.785698 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189be30d-089d-4115-8dd8-2a31fd9da7d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:42:49.787156 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189be30d-089d-4115-8dd8-2a31fd9da7d5 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:49.787628 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189be30d-089d-4115-8dd8-2a31fd9da7d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:49.788496 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189be30d-089d-4115-8dd8-2a31fd9da7d5 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:49.789551 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189be30d-089d-4115-8dd8-2a31fd9da7d5 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:42:49.791461 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189be30d-089d-4115-8dd8-2a31fd9da7d5 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:42:49.805193 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application [None req-189be30d-089d-4115-8dd8-2a31fd9da7d5 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 16 07:42:49.805193 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 07:42:49.805193 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 16 07:42:49.805193 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 16 07:42:49.805193 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 16 07:42:49.805193 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 16 07:42:49.805193 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 16 07:42:49.805193 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 16 07:42:49.805193 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 16 07:42:49.805193 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Sep 16 07:42:49.805193 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 16 07:42:49.805193 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Sep 16 07:42:49.805193 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 07:42:49.805193 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 07:42:49.805193 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 07:42:49.805193 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 07:42:49.805193 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 07:42:49.806561 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 07:42:49.806561 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 07:42:49.806561 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 07:42:49.806561 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 07:42:49.806561 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 07:42:49.806561 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 07:42:49.806561 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 16 07:42:49.806561 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 16 07:42:49.806561 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 16 07:42:49.806561 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 16 07:42:49.806561 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 07:42:49.806561 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 07:42:49.806561 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 07:42:49.806561 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 07:42:49.806561 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 07:42:49.806561 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 07:42:49.807693 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 07:42:49.807693 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application with Lock( Sep 16 07:42:49.807693 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 07:42:49.807693 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._enter() Sep 16 07:42:49.807693 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 07:42:49.807693 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 07:42:49.807693 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 07:42:49.807693 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.creator() Sep 16 07:42:49.807693 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 07:42:49.807693 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application created_value = creator( Sep 16 07:42:49.807693 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 16 07:42:49.807693 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 16 07:42:49.807693 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 16 07:42:49.807693 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Sep 16 07:42:49.810272 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 446/894] 10.222.0.57 () {56 vars in 1114 bytes} [Fri Sep 16 07:42:49 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 07:42:49.815761 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189be30d-089d-4115-8dd8-2a31fd9da7d5 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:42:49.856899 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:42:49.860430 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f882e9ed-b439-477c-8214-b24068730d6d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:42:49.862088 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f882e9ed-b439-477c-8214-b24068730d6d None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:42:49.933681 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:42:49.940598 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189be30d-089d-4115-8dd8-2a31fd9da7d5 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:42:49.968274 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 449/895] 10.222.0.57 () {58 vars in 1282 bytes} [Fri Sep 16 07:42:49 2022] GET /identity/v3/auth/tokens => generated 1372 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 16 07:42:49.968995 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f882e9ed-b439-477c-8214-b24068730d6d None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:42:49.984560 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba792a86-a7b5-4c92-9bf3-e8c2116be37c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:42:49.985173 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba792a86-a7b5-4c92-9bf3-e8c2116be37c None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:49.985456 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba792a86-a7b5-4c92-9bf3-e8c2116be37c None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:49.985749 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba792a86-a7b5-4c92-9bf3-e8c2116be37c None admin] PATH_INFO: `/v3/services` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:49.986389 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba792a86-a7b5-4c92-9bf3-e8c2116be37c None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:42:49.986687 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba792a86-a7b5-4c92-9bf3-e8c2116be37c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:42:49.988055 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba792a86-a7b5-4c92-9bf3-e8c2116be37c None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:42:49.992800 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 447/896] 10.222.0.57 () {56 vars in 1114 bytes} [Fri Sep 16 07:42:49 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:42:49.993577 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba792a86-a7b5-4c92-9bf3-e8c2116be37c None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:42:50.075053 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:42:50.084786 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f882e9ed-b439-477c-8214-b24068730d6d None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:42:50.110478 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba792a86-a7b5-4c92-9bf3-e8c2116be37c None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:42:50.127991 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a341eed-a11c-4467-b515-bfd3ce4def76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:42:50.128835 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a341eed-a11c-4467-b515-bfd3ce4def76 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:50.128970 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a341eed-a11c-4467-b515-bfd3ce4def76 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:50.129141 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a341eed-a11c-4467-b515-bfd3ce4def76 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:50.129994 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a341eed-a11c-4467-b515-bfd3ce4def76 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:42:50.131342 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a341eed-a11c-4467-b515-bfd3ce4def76 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:42:50.140241 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application [None req-3a341eed-a11c-4467-b515-bfd3ce4def76 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 16 07:42:50.140241 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 07:42:50.140241 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 16 07:42:50.140241 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 16 07:42:50.140241 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 16 07:42:50.140241 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 16 07:42:50.140241 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 16 07:42:50.140241 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 16 07:42:50.140241 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 16 07:42:50.140241 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Sep 16 07:42:50.140241 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 16 07:42:50.140241 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Sep 16 07:42:50.140241 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 07:42:50.140241 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 07:42:50.140241 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 07:42:50.140241 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 07:42:50.141182 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 07:42:50.141182 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 07:42:50.141182 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 07:42:50.141182 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 07:42:50.141182 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 07:42:50.141182 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 07:42:50.141182 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 07:42:50.141182 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 16 07:42:50.141182 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 16 07:42:50.141182 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 16 07:42:50.141182 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 16 07:42:50.141182 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 07:42:50.141182 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 07:42:50.141182 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 07:42:50.141182 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 07:42:50.141182 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 07:42:50.141182 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 07:42:50.142228 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 07:42:50.142228 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application with Lock( Sep 16 07:42:50.142228 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 07:42:50.142228 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._enter() Sep 16 07:42:50.142228 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 07:42:50.142228 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 07:42:50.142228 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 07:42:50.142228 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.creator() Sep 16 07:42:50.142228 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 07:42:50.142228 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application created_value = creator( Sep 16 07:42:50.142228 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 16 07:42:50.142228 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 16 07:42:50.142228 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 16 07:42:50.142228 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Sep 16 07:42:50.142228 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 450/897] 10.222.0.57 () {56 vars in 1132 bytes} [Fri Sep 16 07:42:49 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 07:42:50.143012 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a341eed-a11c-4467-b515-bfd3ce4def76 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:42:50.149144 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30599e0-0a94-42bc-a310-e032554b19a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:42:50.149881 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30599e0-0a94-42bc-a310-e032554b19a2 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:50.150758 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30599e0-0a94-42bc-a310-e032554b19a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:50.151199 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30599e0-0a94-42bc-a310-e032554b19a2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:50.162663 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30599e0-0a94-42bc-a310-e032554b19a2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:42:50.164109 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30599e0-0a94-42bc-a310-e032554b19a2 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:42:50.179648 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application [None req-f30599e0-0a94-42bc-a310-e032554b19a2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 07:42:50.179648 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 07:42:50.179648 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 07:42:50.179648 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 07:42:50.179648 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 07:42:50.179648 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 07:42:50.179648 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 07:42:50.179648 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 07:42:50.179648 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 07:42:50.179648 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 07:42:50.179648 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 07:42:50.179648 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 07:42:50.179648 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 07:42:50.179648 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 07:42:50.179648 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 07:42:50.179648 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 07:42:50.180624 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 07:42:50.180624 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 07:42:50.180624 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 07:42:50.180624 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 07:42:50.180624 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 07:42:50.180624 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 07:42:50.180624 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 07:42:50.180624 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application with Lock( Sep 16 07:42:50.180624 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 07:42:50.180624 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._enter() Sep 16 07:42:50.180624 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 07:42:50.180624 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 07:42:50.180624 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 07:42:50.180624 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.creator() Sep 16 07:42:50.180624 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 07:42:50.180624 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application created_value = creator( Sep 16 07:42:50.180624 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 07:42:50.181564 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 07:42:50.181564 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 07:42:50.181564 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Sep 16 07:42:50.181564 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 448/898] 10.222.0.57 () {56 vars in 1108 bytes} [Fri Sep 16 07:42:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 07:42:50.181564 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30599e0-0a94-42bc-a310-e032554b19a2 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:42:50.203756 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:42:50.255049 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a341eed-a11c-4467-b515-bfd3ce4def76 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:42:50.290505 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec07707-06a0-41b1-ae38-7ad9d8492caa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:42:50.291711 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec07707-06a0-41b1-ae38-7ad9d8492caa None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:50.291987 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec07707-06a0-41b1-ae38-7ad9d8492caa None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:50.292257 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec07707-06a0-41b1-ae38-7ad9d8492caa None admin] PATH_INFO: `/v3/services` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:50.292887 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec07707-06a0-41b1-ae38-7ad9d8492caa None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:42:50.293185 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec07707-06a0-41b1-ae38-7ad9d8492caa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:42:50.294572 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec07707-06a0-41b1-ae38-7ad9d8492caa None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:42:50.304156 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 451/899] 10.222.0.57 () {56 vars in 1114 bytes} [Fri Sep 16 07:42:50 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:42:50.304156 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec07707-06a0-41b1-ae38-7ad9d8492caa None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:42:50.312995 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30599e0-0a94-42bc-a310-e032554b19a2 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:42:50.331916 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:42:50.349563 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f386be2-9415-4249-8cd0-7ad76425b755 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:42:50.350387 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f386be2-9415-4249-8cd0-7ad76425b755 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:50.350523 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f386be2-9415-4249-8cd0-7ad76425b755 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:50.350701 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f386be2-9415-4249-8cd0-7ad76425b755 None admin] PATH_INFO: `/v3/services` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:50.351316 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f386be2-9415-4249-8cd0-7ad76425b755 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:42:50.351640 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f386be2-9415-4249-8cd0-7ad76425b755 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:42:50.352948 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f386be2-9415-4249-8cd0-7ad76425b755 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:42:50.364003 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 449/900] 10.222.0.57 () {56 vars in 1126 bytes} [Fri Sep 16 07:42:50 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:42:50.364003 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f386be2-9415-4249-8cd0-7ad76425b755 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:42:50.420787 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec07707-06a0-41b1-ae38-7ad9d8492caa None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:42:50.443992 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:42:50.458864 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed13c239-b8d4-4311-a65b-28092ced9e7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:42:50.459470 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed13c239-b8d4-4311-a65b-28092ced9e7e None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:50.459753 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed13c239-b8d4-4311-a65b-28092ced9e7e None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:50.460022 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed13c239-b8d4-4311-a65b-28092ced9e7e None admin] PATH_INFO: `/v3/domains` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:50.460662 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed13c239-b8d4-4311-a65b-28092ced9e7e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:42:50.460960 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed13c239-b8d4-4311-a65b-28092ced9e7e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:42:50.462376 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed13c239-b8d4-4311-a65b-28092ced9e7e None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:42:50.471213 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f386be2-9415-4249-8cd0-7ad76425b755 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:42:50.475089 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 452/901] 10.222.0.57 () {56 vars in 1109 bytes} [Fri Sep 16 07:42:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:42:50.475889 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed13c239-b8d4-4311-a65b-28092ced9e7e None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:42:50.508048 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98230137-546e-4508-9774-1a2d5316e56a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:42:50.508643 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98230137-546e-4508-9774-1a2d5316e56a None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:50.508920 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98230137-546e-4508-9774-1a2d5316e56a None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:50.509187 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98230137-546e-4508-9774-1a2d5316e56a None admin] PATH_INFO: `/v3/endpoints` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:50.510427 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98230137-546e-4508-9774-1a2d5316e56a None admin] RBAC: Adding query filter params (interface=public, service_id=9d9bb60dc9c54b00b9f65544e7f492ef, region_id=RegionOne) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:42:50.510734 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98230137-546e-4508-9774-1a2d5316e56a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:42:50.512273 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98230137-546e-4508-9774-1a2d5316e56a None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:42:50.522197 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 450/902] 10.222.0.57 () {56 vars in 1251 bytes} [Fri Sep 16 07:42:50 2022] GET /identity/v3/endpoints?service_id=9d9bb60dc9c54b00b9f65544e7f492ef&interface=public®ion_id=RegionOne => generated 194 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:42:50.522197 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98230137-546e-4508-9774-1a2d5316e56a None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:42:50.578898 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:42:50.596355 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed13c239-b8d4-4311-a65b-28092ced9e7e None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:42:50.630063 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b865397d-307f-44b4-8e56-d20785263740 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:42:50.630662 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b865397d-307f-44b4-8e56-d20785263740 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:50.630944 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b865397d-307f-44b4-8e56-d20785263740 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:50.631207 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b865397d-307f-44b4-8e56-d20785263740 None admin] PATH_INFO: `/v3/services` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:50.631828 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b865397d-307f-44b4-8e56-d20785263740 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:42:50.632129 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b865397d-307f-44b4-8e56-d20785263740 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:42:50.633471 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b865397d-307f-44b4-8e56-d20785263740 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:42:50.639788 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 453/903] 10.222.0.57 () {56 vars in 1126 bytes} [Fri Sep 16 07:42:50 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:42:50.640516 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b865397d-307f-44b4-8e56-d20785263740 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:42:50.645585 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98230137-546e-4508-9774-1a2d5316e56a None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:42:50.680488 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9047eccb-7036-4391-b286-71b4fd169945 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:42:50.681252 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9047eccb-7036-4391-b286-71b4fd169945 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:50.681850 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9047eccb-7036-4391-b286-71b4fd169945 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:50.682407 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9047eccb-7036-4391-b286-71b4fd169945 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:50.689168 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9047eccb-7036-4391-b286-71b4fd169945 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:42:50.690722 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9047eccb-7036-4391-b286-71b4fd169945 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:42:50.693247 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:42:50.703009 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application [None req-9047eccb-7036-4391-b286-71b4fd169945 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 07:42:50.703009 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 07:42:50.703009 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 07:42:50.703009 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 07:42:50.703009 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 07:42:50.703009 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 07:42:50.703009 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 07:42:50.703009 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 07:42:50.703009 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 07:42:50.703009 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 07:42:50.703009 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 07:42:50.703009 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 07:42:50.703009 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 16 07:42:50.703009 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 16 07:42:50.703009 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 16 07:42:50.704055 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 16 07:42:50.704055 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 07:42:50.704055 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 07:42:50.704055 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 07:42:50.704055 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 07:42:50.704055 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 07:42:50.704055 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 07:42:50.704055 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 07:42:50.704055 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application with Lock( Sep 16 07:42:50.704055 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 07:42:50.704055 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._enter() Sep 16 07:42:50.704055 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 07:42:50.704055 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 07:42:50.704055 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 07:42:50.704055 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.creator() Sep 16 07:42:50.704055 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 07:42:50.704055 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application created_value = creator( Sep 16 07:42:50.705136 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 16 07:42:50.705136 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 16 07:42:50.705136 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 16 07:42:50.705136 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 16 07:42:50.705136 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 16 07:42:50.705136 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 16 07:42:50.705136 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 07:42:50.705136 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Sep 16 07:42:50.712288 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 451/904] 10.222.0.57 () {56 vars in 1111 bytes} [Fri Sep 16 07:42:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 07:42:50.712288 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9047eccb-7036-4391-b286-71b4fd169945 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:42:50.750946 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b865397d-307f-44b4-8e56-d20785263740 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:42:50.790222 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb54d2d2-37e7-4362-a86f-ba9c69d73a3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:42:50.790985 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb54d2d2-37e7-4362-a86f-ba9c69d73a3d None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:50.791337 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb54d2d2-37e7-4362-a86f-ba9c69d73a3d None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:50.791685 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb54d2d2-37e7-4362-a86f-ba9c69d73a3d None admin] PATH_INFO: `/v3/services` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:50.792370 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb54d2d2-37e7-4362-a86f-ba9c69d73a3d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:42:50.793831 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb54d2d2-37e7-4362-a86f-ba9c69d73a3d None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:42:50.800033 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 454/905] 10.222.0.57 () {56 vars in 1087 bytes} [Fri Sep 16 07:42:50 2022] GET /identity/v3/services => generated 1268 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 07:42:50.810828 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb54d2d2-37e7-4362-a86f-ba9c69d73a3d None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:42:50.823624 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9047eccb-7036-4391-b286-71b4fd169945 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:42:50.837795 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:42:50.868090 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5289e0e3-4ffc-41ca-9fe9-92e1d548d6f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:42:50.868800 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5289e0e3-4ffc-41ca-9fe9-92e1d548d6f7 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:50.869666 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5289e0e3-4ffc-41ca-9fe9-92e1d548d6f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:50.870033 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5289e0e3-4ffc-41ca-9fe9-92e1d548d6f7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:50.870802 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5289e0e3-4ffc-41ca-9fe9-92e1d548d6f7 None admin] RBAC: Adding query filter params (interface=public, service_id=21d1aa4868494ed5aeae02451cb79c8a, region_id=RegionOne) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:42:50.871169 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5289e0e3-4ffc-41ca-9fe9-92e1d548d6f7 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:42:50.872641 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5289e0e3-4ffc-41ca-9fe9-92e1d548d6f7 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:42:50.883498 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 452/906] 10.222.0.57 () {56 vars in 1251 bytes} [Fri Sep 16 07:42:50 2022] GET /identity/v3/endpoints?service_id=21d1aa4868494ed5aeae02451cb79c8a&interface=public®ion_id=RegionOne => generated 194 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:42:50.886080 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5289e0e3-4ffc-41ca-9fe9-92e1d548d6f7 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:42:50.956650 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:42:50.959324 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb54d2d2-37e7-4362-a86f-ba9c69d73a3d None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:42:51.006787 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53293e91-b509-40d2-8fbd-b3692853aa41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:42:51.007590 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53293e91-b509-40d2-8fbd-b3692853aa41 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:51.007962 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53293e91-b509-40d2-8fbd-b3692853aa41 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:51.008324 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53293e91-b509-40d2-8fbd-b3692853aa41 None admin] PATH_INFO: `/v3/projects` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:51.009116 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53293e91-b509-40d2-8fbd-b3692853aa41 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:42:51.009248 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5289e0e3-4ffc-41ca-9fe9-92e1d548d6f7 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:42:51.009514 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53293e91-b509-40d2-8fbd-b3692853aa41 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:42:51.012489 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53293e91-b509-40d2-8fbd-b3692853aa41 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:42:51.025055 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 455/907] 10.222.0.57 () {56 vars in 1148 bytes} [Fri Sep 16 07:42:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:42:51.031870 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53293e91-b509-40d2-8fbd-b3692853aa41 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:42:51.055986 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d490bc-6ad1-4e13-b2fb-7bd0e5146f59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:42:51.057861 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d490bc-6ad1-4e13-b2fb-7bd0e5146f59 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:51.058149 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d490bc-6ad1-4e13-b2fb-7bd0e5146f59 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:51.058426 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d490bc-6ad1-4e13-b2fb-7bd0e5146f59 None admin] PATH_INFO: `/v3/services` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:51.059312 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d490bc-6ad1-4e13-b2fb-7bd0e5146f59 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:42:51.061382 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d490bc-6ad1-4e13-b2fb-7bd0e5146f59 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:42:51.069864 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 453/908] 10.222.0.57 () {56 vars in 1087 bytes} [Fri Sep 16 07:42:50 2022] GET /identity/v3/services => generated 1268 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 16 07:42:51.120365 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:42:51.152509 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53293e91-b509-40d2-8fbd-b3692853aa41 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:42:51.192239 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fe4bcf-d194-4bc3-a509-1903c3c2bd8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:42:51.192847 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fe4bcf-d194-4bc3-a509-1903c3c2bd8a None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:51.193124 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fe4bcf-d194-4bc3-a509-1903c3c2bd8a None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:51.193392 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fe4bcf-d194-4bc3-a509-1903c3c2bd8a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:51.194166 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31fe4bcf-d194-4bc3-a509-1903c3c2bd8a None admin] RBAC: Adding query filter params (role.id=0f6db070ff104938a2112f6d80494dab, scope.project.id=4735f453c0c24cc4a1c14e9ac84a0b46, user.id=56eb9bbabb65436bb095952159df184c) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:42:51.194524 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31fe4bcf-d194-4bc3-a509-1903c3c2bd8a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:42:51.196020 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31fe4bcf-d194-4bc3-a509-1903c3c2bd8a None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:42:51.203389 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 456/909] 10.222.0.57 () {56 vars in 1374 bytes} [Fri Sep 16 07:42:51 2022] GET /identity/v3/role_assignments?user.id=56eb9bbabb65436bb095952159df184c&scope.project.id=4735f453c0c24cc4a1c14e9ac84a0b46&role.id=0f6db070ff104938a2112f6d80494dab => generated 259 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 07:42:51.877213 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606ad760-2d5b-4a21-ae4a-8b336b00e90d None None] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:51.877756 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606ad760-2d5b-4a21-ae4a-8b336b00e90d None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:51.877866 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606ad760-2d5b-4a21-ae4a-8b336b00e90d None None] PATH_INFO: `/` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:51.879357 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 454/910] 10.222.0.57 () {54 vars in 927 bytes} [Fri Sep 16 07:42:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 07:42:51.885198 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d796735-d317-48e8-8424-f73d821f7f5a None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:51.885493 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d796735-d317-48e8-8424-f73d821f7f5a None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:51.885775 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d796735-d317-48e8-8424-f73d821f7f5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:51.904812 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-8d796735-d317-48e8-8424-f73d821f7f5a None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:42:51.906040 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-8d796735-d317-48e8-8424-f73d821f7f5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:42:51.976636 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 457/911] 10.222.0.57 () {58 vars in 1024 bytes} [Fri Sep 16 07:42:51 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 16 07:42:52.250791 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606ad760-2d5b-4a21-ae4a-8b336b00e90d None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:42:52.360410 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606ad760-2d5b-4a21-ae4a-8b336b00e90d None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:42:52.389560 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:42:52.398336 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7032b0b5-470c-4533-8eaf-f30c892a91b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:42:52.398946 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7032b0b5-470c-4533-8eaf-f30c892a91b4 None admin] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:52.399264 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7032b0b5-470c-4533-8eaf-f30c892a91b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:52.399596 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7032b0b5-470c-4533-8eaf-f30c892a91b4 None admin] PATH_INFO: `/v3/services` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:52.400311 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7032b0b5-470c-4533-8eaf-f30c892a91b4 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:42:52.401782 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7032b0b5-470c-4533-8eaf-f30c892a91b4 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:42:52.417487 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 455/912] 10.222.0.57 () {60 vars in 1141 bytes} [Fri Sep 16 07:42:52 2022] POST /identity/v3/services => generated 241 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 07:42:53.030744 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1b273a-bab9-4e14-afa6-8ce331fe5373 None None] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:53.031268 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1b273a-bab9-4e14-afa6-8ce331fe5373 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:53.031268 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1b273a-bab9-4e14-afa6-8ce331fe5373 None None] PATH_INFO: `/` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:53.032927 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 458/913] 10.222.0.57 () {54 vars in 927 bytes} [Fri Sep 16 07:42:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 07:42:53.038246 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eac4546-eaf0-496c-851e-ffd681091f6e None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:53.038643 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eac4546-eaf0-496c-851e-ffd681091f6e None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:53.038830 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eac4546-eaf0-496c-851e-ffd681091f6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:53.058784 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-6eac4546-eaf0-496c-851e-ffd681091f6e None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:42:53.059969 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-6eac4546-eaf0-496c-851e-ffd681091f6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:42:53.140622 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 456/914] 10.222.0.57 () {58 vars in 1024 bytes} [Fri Sep 16 07:42:53 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 16 07:42:53.324808 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f53babc-8ef1-4105-91d8-1259edb8d9de None None] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:53.324987 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f53babc-8ef1-4105-91d8-1259edb8d9de None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:53.325259 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f53babc-8ef1-4105-91d8-1259edb8d9de None None] PATH_INFO: `/` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:53.327149 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 459/915] 10.222.0.57 () {54 vars in 927 bytes} [Fri Sep 16 07:42:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 07:42:53.332807 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db44c28-752b-45ff-9771-348856d31916 None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:53.333380 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db44c28-752b-45ff-9771-348856d31916 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:53.333885 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db44c28-752b-45ff-9771-348856d31916 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:53.355058 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-4db44c28-752b-45ff-9771-348856d31916 None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:42:53.356679 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-4db44c28-752b-45ff-9771-348856d31916 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:42:53.412380 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f53babc-8ef1-4105-91d8-1259edb8d9de None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:42:53.430266 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 457/916] 10.222.0.57 () {58 vars in 1024 bytes} [Fri Sep 16 07:42:53 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 16 07:42:53.432347 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c81bc0d-23d2-484d-baf9-e987c4f6245a None None] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:53.432649 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c81bc0d-23d2-484d-baf9-e987c4f6245a None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:53.432925 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c81bc0d-23d2-484d-baf9-e987c4f6245a None None] PATH_INFO: `/` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:53.434466 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 458/917] 10.222.0.57 () {54 vars in 927 bytes} [Fri Sep 16 07:42:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 07:42:53.439150 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867dc345-b47d-447c-8db4-df0c5f303002 None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:53.439427 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867dc345-b47d-447c-8db4-df0c5f303002 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:53.439696 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867dc345-b47d-447c-8db4-df0c5f303002 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:53.458726 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-867dc345-b47d-447c-8db4-df0c5f303002 None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:42:53.459912 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-867dc345-b47d-447c-8db4-df0c5f303002 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:42:53.488900 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:42:53.505293 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:42:53.525665 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f53babc-8ef1-4105-91d8-1259edb8d9de None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:42:53.538426 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 459/918] 10.222.0.57 () {58 vars in 1024 bytes} [Fri Sep 16 07:42:53 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 16 07:42:53.561169 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc0cdd5-5000-491b-9cd4-6636c7011e4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:42:53.562187 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc0cdd5-5000-491b-9cd4-6636c7011e4d None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:53.562712 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc0cdd5-5000-491b-9cd4-6636c7011e4d None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:53.563179 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc0cdd5-5000-491b-9cd4-6636c7011e4d None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:53.563955 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc0cdd5-5000-491b-9cd4-6636c7011e4d None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:42:53.565559 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc0cdd5-5000-491b-9cd4-6636c7011e4d None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:42:53.575393 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application [None req-0dc0cdd5-5000-491b-9cd4-6636c7011e4d None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 16 07:42:53.575393 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 07:42:53.575393 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 16 07:42:53.575393 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 16 07:42:53.575393 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 16 07:42:53.575393 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 16 07:42:53.575393 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 16 07:42:53.575393 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 16 07:42:53.575393 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 16 07:42:53.575393 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Sep 16 07:42:53.575393 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 16 07:42:53.575393 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Sep 16 07:42:53.575393 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 07:42:53.575393 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 07:42:53.575393 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 07:42:53.575393 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 07:42:53.575393 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 07:42:53.576374 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 07:42:53.576374 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 07:42:53.576374 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 07:42:53.576374 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 07:42:53.576374 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 07:42:53.576374 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 07:42:53.576374 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 16 07:42:53.576374 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 16 07:42:53.576374 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 16 07:42:53.576374 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 16 07:42:53.576374 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 07:42:53.576374 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 07:42:53.576374 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 07:42:53.576374 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 07:42:53.576374 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 07:42:53.576374 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 07:42:53.577218 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 07:42:53.577218 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application with Lock( Sep 16 07:42:53.577218 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 07:42:53.577218 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._enter() Sep 16 07:42:53.577218 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 07:42:53.577218 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 07:42:53.577218 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 07:42:53.577218 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.creator() Sep 16 07:42:53.577218 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 07:42:53.577218 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application created_value = creator( Sep 16 07:42:53.577218 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 16 07:42:53.577218 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 16 07:42:53.577218 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 16 07:42:53.577218 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Sep 16 07:42:53.579828 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 460/919] 10.222.0.57 () {56 vars in 1114 bytes} [Fri Sep 16 07:42:53 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 07:42:53.589773 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867dc345-b47d-447c-8db4-df0c5f303002 None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:42:53.694755 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867dc345-b47d-447c-8db4-df0c5f303002 None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:42:53.729501 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc0cdd5-5000-491b-9cd4-6636c7011e4d None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:42:53.735418 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8616fd-463c-4bdb-bb8e-5d3c6645ae6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:42:53.736042 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8616fd-463c-4bdb-bb8e-5d3c6645ae6e None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:53.736321 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8616fd-463c-4bdb-bb8e-5d3c6645ae6e None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:53.736590 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8616fd-463c-4bdb-bb8e-5d3c6645ae6e None admin] PATH_INFO: `/v3/services` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:53.737244 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8616fd-463c-4bdb-bb8e-5d3c6645ae6e None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:42:53.737543 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8616fd-463c-4bdb-bb8e-5d3c6645ae6e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:42:53.738948 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8616fd-463c-4bdb-bb8e-5d3c6645ae6e None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:42:53.744441 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 460/920] 10.222.0.57 () {56 vars in 1114 bytes} [Fri Sep 16 07:42:53 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:42:53.751364 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8616fd-463c-4bdb-bb8e-5d3c6645ae6e None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:42:53.804026 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:42:53.859300 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc0cdd5-5000-491b-9cd4-6636c7011e4d None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:42:53.870893 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8616fd-463c-4bdb-bb8e-5d3c6645ae6e None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:42:53.890358 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:42:53.895785 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86826387-c97a-4fb7-9f2d-6efe66b64e0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:42:53.896415 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86826387-c97a-4fb7-9f2d-6efe66b64e0b None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:53.896689 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86826387-c97a-4fb7-9f2d-6efe66b64e0b None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:53.896957 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86826387-c97a-4fb7-9f2d-6efe66b64e0b None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:53.897544 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86826387-c97a-4fb7-9f2d-6efe66b64e0b None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:42:53.898953 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86826387-c97a-4fb7-9f2d-6efe66b64e0b None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:42:53.907770 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application [None req-86826387-c97a-4fb7-9f2d-6efe66b64e0b None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 16 07:42:53.907770 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 07:42:53.907770 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 16 07:42:53.907770 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 16 07:42:53.907770 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 16 07:42:53.907770 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 16 07:42:53.907770 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 16 07:42:53.907770 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 16 07:42:53.907770 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 16 07:42:53.907770 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Sep 16 07:42:53.907770 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 16 07:42:53.907770 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Sep 16 07:42:53.907770 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 07:42:53.907770 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 07:42:53.907770 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 07:42:53.907770 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 07:42:53.908713 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 07:42:53.908713 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 07:42:53.908713 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 07:42:53.908713 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 07:42:53.908713 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 07:42:53.908713 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 07:42:53.908713 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 07:42:53.908713 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 16 07:42:53.908713 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 16 07:42:53.908713 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 16 07:42:53.908713 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 16 07:42:53.908713 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 07:42:53.908713 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 07:42:53.908713 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 07:42:53.908713 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 07:42:53.908713 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 07:42:53.908713 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 07:42:53.909592 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 07:42:53.909592 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application with Lock( Sep 16 07:42:53.909592 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 07:42:53.909592 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._enter() Sep 16 07:42:53.909592 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 07:42:53.909592 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 07:42:53.909592 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 07:42:53.909592 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.creator() Sep 16 07:42:53.909592 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 07:42:53.909592 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application created_value = creator( Sep 16 07:42:53.909592 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 16 07:42:53.909592 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 16 07:42:53.909592 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 16 07:42:53.909592 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Sep 16 07:42:53.909592 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 461/921] 10.222.0.57 () {56 vars in 1132 bytes} [Fri Sep 16 07:42:53 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 07:42:53.910920 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86826387-c97a-4fb7-9f2d-6efe66b64e0b None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:42:53.916962 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508ca492-030c-463d-adde-e3a676a30d63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:42:53.918434 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508ca492-030c-463d-adde-e3a676a30d63 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:53.918710 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508ca492-030c-463d-adde-e3a676a30d63 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:53.918977 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508ca492-030c-463d-adde-e3a676a30d63 None admin] PATH_INFO: `/v3/services` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:53.919595 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508ca492-030c-463d-adde-e3a676a30d63 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:42:53.919888 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508ca492-030c-463d-adde-e3a676a30d63 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:42:53.921349 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508ca492-030c-463d-adde-e3a676a30d63 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:42:53.930960 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 461/922] 10.222.0.57 () {56 vars in 1114 bytes} [Fri Sep 16 07:42:53 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 07:42:53.930960 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508ca492-030c-463d-adde-e3a676a30d63 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:42:54.024337 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86826387-c97a-4fb7-9f2d-6efe66b64e0b None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:42:54.034005 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508ca492-030c-463d-adde-e3a676a30d63 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:42:54.035635 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:42:54.061080 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdc8d7f-b258-42fa-8382-9eb782004a57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:42:54.061710 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdc8d7f-b258-42fa-8382-9eb782004a57 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:54.062029 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdc8d7f-b258-42fa-8382-9eb782004a57 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:54.062307 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdc8d7f-b258-42fa-8382-9eb782004a57 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:54.072873 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48542f4-9087-43c9-bbd3-4a427feeaec1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:42:54.073485 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebdc8d7f-b258-42fa-8382-9eb782004a57 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 07:42:54.074272 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48542f4-9087-43c9-bbd3-4a427feeaec1 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:54.074550 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48542f4-9087-43c9-bbd3-4a427feeaec1 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:54.074818 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48542f4-9087-43c9-bbd3-4a427feeaec1 None admin] PATH_INFO: `/v3/services` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:54.075430 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48542f4-9087-43c9-bbd3-4a427feeaec1 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:42:54.075729 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48542f4-9087-43c9-bbd3-4a427feeaec1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:42:54.077086 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48542f4-9087-43c9-bbd3-4a427feeaec1 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:42:54.078099 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application [None req-ebdc8d7f-b258-42fa-8382-9eb782004a57 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 16 07:42:54.078099 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 07:42:54.078099 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 07:42:54.078099 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 07:42:54.078099 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 07:42:54.078099 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 07:42:54.078099 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 07:42:54.078099 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 07:42:54.078099 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 07:42:54.078099 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 07:42:54.078099 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 07:42:54.078099 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 07:42:54.078099 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 07:42:54.078099 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 07:42:54.078099 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 07:42:54.078099 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 07:42:54.078982 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 07:42:54.078982 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 07:42:54.078982 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 07:42:54.078982 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 07:42:54.078982 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 07:42:54.078982 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 07:42:54.078982 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 07:42:54.078982 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 07:42:54.078982 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 07:42:54.078982 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 07:42:54.078982 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 07:42:54.078982 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application with Lock( Sep 16 07:42:54.078982 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 07:42:54.078982 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._enter() Sep 16 07:42:54.078982 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 07:42:54.078982 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 07:42:54.082647 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 07:42:54.082647 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.creator() Sep 16 07:42:54.082647 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 07:42:54.082647 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application created_value = creator( Sep 16 07:42:54.082647 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 07:42:54.082647 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 07:42:54.082647 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 07:42:54.082647 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 07:42:54.082647 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 07:42:54.082647 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 07:42:54.082647 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 16 07:42:54.082647 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Sep 16 07:42:54.082647 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 462/923] 10.222.0.57 () {56 vars in 1120 bytes} [Fri Sep 16 07:42:53 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 07:42:54.082647 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdc8d7f-b258-42fa-8382-9eb782004a57 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:42:54.089870 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 462/924] 10.222.0.57 () {56 vars in 1126 bytes} [Fri Sep 16 07:42:53 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:42:54.093039 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48542f4-9087-43c9-bbd3-4a427feeaec1 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:42:54.148474 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:42:54.195957 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdc8d7f-b258-42fa-8382-9eb782004a57 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:42:54.200297 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48542f4-9087-43c9-bbd3-4a427feeaec1 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:42:54.233301 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc0b2fb-18f7-4f8e-bc9e-93ad173060b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:42:54.233938 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc0b2fb-18f7-4f8e-bc9e-93ad173060b1 None admin] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:54.234218 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc0b2fb-18f7-4f8e-bc9e-93ad173060b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:54.234320 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ede54d-5ff2-4cb9-9e0c-8118cdc6ee3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:42:54.234514 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc0b2fb-18f7-4f8e-bc9e-93ad173060b1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:54.234895 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ede54d-5ff2-4cb9-9e0c-8118cdc6ee3d None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:54.235142 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc0b2fb-18f7-4f8e-bc9e-93ad173060b1 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:42:54.235246 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ede54d-5ff2-4cb9-9e0c-8118cdc6ee3d None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:54.235421 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ede54d-5ff2-4cb9-9e0c-8118cdc6ee3d None admin] PATH_INFO: `/v3/roles` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:54.236064 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ede54d-5ff2-4cb9-9e0c-8118cdc6ee3d None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:42:54.236359 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ede54d-5ff2-4cb9-9e0c-8118cdc6ee3d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:42:54.236558 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc0b2fb-18f7-4f8e-bc9e-93ad173060b1 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:42:54.237693 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ede54d-5ff2-4cb9-9e0c-8118cdc6ee3d None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:42:54.250855 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 463/925] 10.222.0.57 () {56 vars in 1115 bytes} [Fri Sep 16 07:42:54 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:42:54.250855 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ede54d-5ff2-4cb9-9e0c-8118cdc6ee3d None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:42:54.264643 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 463/926] 10.222.0.57 () {60 vars in 1144 bytes} [Fri Sep 16 07:42:54 2022] POST /identity/v3/endpoints => generated 346 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 07:42:54.274809 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc0b2fb-18f7-4f8e-bc9e-93ad173060b1 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:42:54.293553 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:42:54.386723 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ede54d-5ff2-4cb9-9e0c-8118cdc6ee3d None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:42:54.432884 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc0b2fb-18f7-4f8e-bc9e-93ad173060b1 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:42:54.438774 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d2d3b3-220c-4415-b39a-33648dab8aa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:42:54.439626 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d2d3b3-220c-4415-b39a-33648dab8aa0 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:54.440070 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d2d3b3-220c-4415-b39a-33648dab8aa0 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:54.440493 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d2d3b3-220c-4415-b39a-33648dab8aa0 None admin] PATH_INFO: `/v3/services` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:54.441891 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d2d3b3-220c-4415-b39a-33648dab8aa0 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:42:54.442368 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d2d3b3-220c-4415-b39a-33648dab8aa0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:42:54.444484 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:42:54.445378 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d2d3b3-220c-4415-b39a-33648dab8aa0 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:42:54.451674 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 464/927] 10.222.0.57 () {56 vars in 1126 bytes} [Fri Sep 16 07:42:54 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:42:54.457919 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d2d3b3-220c-4415-b39a-33648dab8aa0 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:42:54.490225 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b40aa8-5353-4dad-a9dc-2c035cfd8bd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:42:54.491161 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b40aa8-5353-4dad-a9dc-2c035cfd8bd3 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:54.491441 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b40aa8-5353-4dad-a9dc-2c035cfd8bd3 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:54.491718 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b40aa8-5353-4dad-a9dc-2c035cfd8bd3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:54.504887 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b40aa8-5353-4dad-a9dc-2c035cfd8bd3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:42:54.506618 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b40aa8-5353-4dad-a9dc-2c035cfd8bd3 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:42:54.521421 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application [None req-94b40aa8-5353-4dad-a9dc-2c035cfd8bd3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 07:42:54.521421 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 07:42:54.521421 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 07:42:54.521421 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 07:42:54.521421 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 07:42:54.521421 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 07:42:54.521421 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 07:42:54.521421 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 07:42:54.521421 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 07:42:54.521421 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 07:42:54.521421 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 07:42:54.521421 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 07:42:54.521421 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 07:42:54.521421 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 07:42:54.521421 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 07:42:54.521421 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 07:42:54.522593 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 07:42:54.522593 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 07:42:54.522593 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 07:42:54.522593 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 07:42:54.522593 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 07:42:54.522593 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 07:42:54.522593 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 07:42:54.522593 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application with Lock( Sep 16 07:42:54.522593 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 07:42:54.522593 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._enter() Sep 16 07:42:54.522593 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 07:42:54.522593 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 07:42:54.522593 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 07:42:54.522593 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.creator() Sep 16 07:42:54.522593 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 07:42:54.522593 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application created_value = creator( Sep 16 07:42:54.522593 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 07:42:54.523686 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 07:42:54.523686 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 07:42:54.523686 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Sep 16 07:42:54.523686 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 464/928] 10.222.0.57 () {56 vars in 1108 bytes} [Fri Sep 16 07:42:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 07:42:54.531126 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b40aa8-5353-4dad-a9dc-2c035cfd8bd3 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:42:54.578379 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:42:54.590928 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d2d3b3-220c-4415-b39a-33648dab8aa0 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:42:54.639390 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5274030-1f37-43c5-8cd5-d1e334399dfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:42:54.640346 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5274030-1f37-43c5-8cd5-d1e334399dfa None admin] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:54.640692 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5274030-1f37-43c5-8cd5-d1e334399dfa None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:54.641026 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5274030-1f37-43c5-8cd5-d1e334399dfa None admin] PATH_INFO: `/v3/endpoints` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:54.642184 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5274030-1f37-43c5-8cd5-d1e334399dfa None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:42:54.643615 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5274030-1f37-43c5-8cd5-d1e334399dfa None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:42:54.658880 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b40aa8-5353-4dad-a9dc-2c035cfd8bd3 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:42:54.681857 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 465/929] 10.222.0.57 () {60 vars in 1144 bytes} [Fri Sep 16 07:42:54 2022] POST /identity/v3/endpoints => generated 347 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 16 07:42:54.719080 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67691b13-eef3-4e4a-a9f4-b86b5143952d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:42:54.720008 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67691b13-eef3-4e4a-a9f4-b86b5143952d None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:54.720501 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67691b13-eef3-4e4a-a9f4-b86b5143952d None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:54.720944 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67691b13-eef3-4e4a-a9f4-b86b5143952d None admin] PATH_INFO: `/v3/domains` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:54.721803 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67691b13-eef3-4e4a-a9f4-b86b5143952d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:42:54.722316 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67691b13-eef3-4e4a-a9f4-b86b5143952d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:42:54.723998 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67691b13-eef3-4e4a-a9f4-b86b5143952d None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:42:54.739743 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 465/930] 10.222.0.57 () {56 vars in 1109 bytes} [Fri Sep 16 07:42:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 07:42:54.746966 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5274030-1f37-43c5-8cd5-d1e334399dfa None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:42:54.787980 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24dd3ad-7a53-4556-a1e9-b3a387895e18 None None] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:54.788592 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24dd3ad-7a53-4556-a1e9-b3a387895e18 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:54.789086 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24dd3ad-7a53-4556-a1e9-b3a387895e18 None None] PATH_INFO: `/` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:54.791724 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 466/931] 10.222.0.57 () {54 vars in 927 bytes} [Fri Sep 16 07:42:54 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 07:42:54.797806 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce07a8e-c714-4c48-9e83-508d41d5cf95 None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:54.798397 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce07a8e-c714-4c48-9e83-508d41d5cf95 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:54.798896 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce07a8e-c714-4c48-9e83-508d41d5cf95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:54.818369 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-2ce07a8e-c714-4c48-9e83-508d41d5cf95 None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:42:54.819938 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-2ce07a8e-c714-4c48-9e83-508d41d5cf95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:42:54.833172 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:42:54.874339 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5274030-1f37-43c5-8cd5-d1e334399dfa None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:42:54.913316 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 467/932] 10.222.0.57 () {58 vars in 1024 bytes} [Fri Sep 16 07:42:54 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 16 07:42:54.917750 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2423e9-065e-4bd4-a356-f7916fbf4ea3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:42:54.917750 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2423e9-065e-4bd4-a356-f7916fbf4ea3 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:54.917750 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2423e9-065e-4bd4-a356-f7916fbf4ea3 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:54.917750 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2423e9-065e-4bd4-a356-f7916fbf4ea3 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:54.924882 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2423e9-065e-4bd4-a356-f7916fbf4ea3 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:42:54.926370 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2423e9-065e-4bd4-a356-f7916fbf4ea3 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:42:54.943487 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application [None req-6e2423e9-065e-4bd4-a356-f7916fbf4ea3 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 16 07:42:54.943487 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 07:42:54.943487 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 07:42:54.943487 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 07:42:54.943487 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 07:42:54.943487 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 07:42:54.943487 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 07:42:54.943487 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 07:42:54.943487 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 07:42:54.943487 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 07:42:54.943487 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 07:42:54.943487 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 07:42:54.943487 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 16 07:42:54.943487 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 16 07:42:54.943487 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 16 07:42:54.943487 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 16 07:42:54.944500 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 07:42:54.944500 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 07:42:54.944500 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 16 07:42:54.944500 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 07:42:54.944500 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 16 07:42:54.944500 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 07:42:54.944500 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 07:42:54.944500 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 07:42:54.944500 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 07:42:54.944500 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 07:42:54.944500 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 07:42:54.944500 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application with Lock( Sep 16 07:42:54.944500 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 07:42:54.944500 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._enter() Sep 16 07:42:54.944500 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 07:42:54.944500 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 07:42:54.944500 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 07:42:54.944500 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.creator() Sep 16 07:42:54.945444 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 07:42:54.945444 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application created_value = creator( Sep 16 07:42:54.945444 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 16 07:42:54.945444 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 16 07:42:54.945444 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 16 07:42:54.945444 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 16 07:42:54.945444 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 16 07:42:54.945444 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 16 07:42:54.945444 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 16 07:42:54.945444 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Sep 16 07:42:54.945444 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 466/933] 10.222.0.57 () {56 vars in 1117 bytes} [Fri Sep 16 07:42:54 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 07:42:54.955059 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce07a8e-c714-4c48-9e83-508d41d5cf95 None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:42:55.061598 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce07a8e-c714-4c48-9e83-508d41d5cf95 None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:42:55.113609 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d60182-9ced-40b9-8ee1-18c180c477bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:42:55.113609 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d60182-9ced-40b9-8ee1-18c180c477bf None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:55.113609 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d60182-9ced-40b9-8ee1-18c180c477bf None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:55.113609 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d60182-9ced-40b9-8ee1-18c180c477bf None admin] PATH_INFO: `/v3/users` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:55.114035 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d60182-9ced-40b9-8ee1-18c180c477bf None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:42:55.114035 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d60182-9ced-40b9-8ee1-18c180c477bf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:42:55.114035 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d60182-9ced-40b9-8ee1-18c180c477bf None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:42:55.132591 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 468/934] 10.222.0.57 () {56 vars in 1149 bytes} [Fri Sep 16 07:42:54 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:42:55.139076 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2423e9-065e-4bd4-a356-f7916fbf4ea3 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:42:55.153901 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:42:55.227169 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d60182-9ced-40b9-8ee1-18c180c477bf None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:42:55.231467 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:42:55.278203 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2423e9-065e-4bd4-a356-f7916fbf4ea3 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:42:55.332145 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805a153d-b864-456d-9443-aabf73bbcdff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:42:55.333600 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805a153d-b864-456d-9443-aabf73bbcdff None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:55.334113 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805a153d-b864-456d-9443-aabf73bbcdff None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:55.334738 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805a153d-b864-456d-9443-aabf73bbcdff None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:55.351748 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805a153d-b864-456d-9443-aabf73bbcdff None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:42:55.355018 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805a153d-b864-456d-9443-aabf73bbcdff None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:42:55.363420 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d60182-9ced-40b9-8ee1-18c180c477bf None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:42:55.376854 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application [None req-805a153d-b864-456d-9443-aabf73bbcdff None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 07:42:55.376854 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 07:42:55.376854 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 07:42:55.376854 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 07:42:55.376854 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 07:42:55.376854 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 07:42:55.376854 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 07:42:55.376854 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 07:42:55.376854 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 07:42:55.376854 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 07:42:55.376854 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 07:42:55.376854 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 07:42:55.376854 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 07:42:55.376854 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 07:42:55.376854 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 07:42:55.376854 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 07:42:55.377909 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 07:42:55.377909 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 07:42:55.377909 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 07:42:55.377909 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 07:42:55.377909 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 07:42:55.377909 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 07:42:55.377909 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 07:42:55.377909 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application with Lock( Sep 16 07:42:55.377909 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 07:42:55.377909 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._enter() Sep 16 07:42:55.377909 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 07:42:55.377909 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 07:42:55.377909 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 07:42:55.377909 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.creator() Sep 16 07:42:55.377909 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 07:42:55.377909 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application created_value = creator( Sep 16 07:42:55.377909 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 07:42:55.378808 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 07:42:55.378808 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 07:42:55.378808 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Sep 16 07:42:55.382994 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 467/935] 10.222.0.57 () {56 vars in 1108 bytes} [Fri Sep 16 07:42:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 07:42:55.392309 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805a153d-b864-456d-9443-aabf73bbcdff None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:42:55.409524 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693c0156-6623-4f62-80ba-7d70cb35b32b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:42:55.410185 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693c0156-6623-4f62-80ba-7d70cb35b32b None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:55.410462 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693c0156-6623-4f62-80ba-7d70cb35b32b None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:55.410727 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693c0156-6623-4f62-80ba-7d70cb35b32b None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:55.411306 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693c0156-6623-4f62-80ba-7d70cb35b32b None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:42:55.412731 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693c0156-6623-4f62-80ba-7d70cb35b32b None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:42:55.423153 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application [None req-693c0156-6623-4f62-80ba-7d70cb35b32b None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 16 07:42:55.423153 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 07:42:55.423153 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 16 07:42:55.423153 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 16 07:42:55.423153 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 16 07:42:55.423153 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 16 07:42:55.423153 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 16 07:42:55.423153 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 16 07:42:55.423153 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 16 07:42:55.423153 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Sep 16 07:42:55.423153 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 16 07:42:55.423153 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Sep 16 07:42:55.423153 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 07:42:55.423153 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 07:42:55.423153 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 07:42:55.423153 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 07:42:55.423153 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 07:42:55.424221 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 07:42:55.424221 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 07:42:55.424221 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 07:42:55.424221 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 07:42:55.424221 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 07:42:55.424221 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 07:42:55.424221 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 16 07:42:55.424221 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 16 07:42:55.424221 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 16 07:42:55.424221 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 16 07:42:55.424221 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 07:42:55.424221 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 07:42:55.424221 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 07:42:55.424221 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 07:42:55.424221 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 07:42:55.424221 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 07:42:55.425103 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 07:42:55.425103 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application with Lock( Sep 16 07:42:55.425103 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 07:42:55.425103 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._enter() Sep 16 07:42:55.425103 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 07:42:55.425103 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 07:42:55.425103 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 07:42:55.425103 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.creator() Sep 16 07:42:55.425103 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 07:42:55.425103 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application created_value = creator( Sep 16 07:42:55.425103 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 16 07:42:55.425103 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 16 07:42:55.425103 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 16 07:42:55.425103 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Sep 16 07:42:55.425103 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 469/936] 10.222.0.57 () {56 vars in 1126 bytes} [Fri Sep 16 07:42:55 2022] GET /identity/v3/services/object-store => generated 93 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 07:42:55.430968 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693c0156-6623-4f62-80ba-7d70cb35b32b None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:42:55.469368 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:42:55.529761 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805a153d-b864-456d-9443-aabf73bbcdff None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:42:55.530145 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:42:55.549844 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693c0156-6623-4f62-80ba-7d70cb35b32b None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:42:55.574718 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cdb5df-1d41-477c-b62d-0dc950940f7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:42:55.575618 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cdb5df-1d41-477c-b62d-0dc950940f7f None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:55.576060 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cdb5df-1d41-477c-b62d-0dc950940f7f None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:55.576484 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cdb5df-1d41-477c-b62d-0dc950940f7f None admin] PATH_INFO: `/v3/domains` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:55.577273 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7cdb5df-1d41-477c-b62d-0dc950940f7f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:42:55.577743 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7cdb5df-1d41-477c-b62d-0dc950940f7f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:42:55.579328 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7cdb5df-1d41-477c-b62d-0dc950940f7f None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:42:55.599959 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64c2df6-c5c8-4651-acb0-262c862b5497 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:42:55.599959 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64c2df6-c5c8-4651-acb0-262c862b5497 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:55.599959 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64c2df6-c5c8-4651-acb0-262c862b5497 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:55.599959 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64c2df6-c5c8-4651-acb0-262c862b5497 None admin] PATH_INFO: `/v3/services` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:55.600395 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64c2df6-c5c8-4651-acb0-262c862b5497 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:42:55.600395 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64c2df6-c5c8-4651-acb0-262c862b5497 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:42:55.600395 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64c2df6-c5c8-4651-acb0-262c862b5497 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:42:55.601273 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 468/937] 10.222.0.57 () {56 vars in 1109 bytes} [Fri Sep 16 07:42:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:42:55.603043 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cdb5df-1d41-477c-b62d-0dc950940f7f None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:42:55.605012 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 470/938] 10.222.0.57 () {56 vars in 1122 bytes} [Fri Sep 16 07:42:55 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 07:42:55.610798 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64c2df6-c5c8-4651-acb0-262c862b5497 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:42:55.725554 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cdb5df-1d41-477c-b62d-0dc950940f7f None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:42:55.750633 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:42:55.765088 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fd494a-ec71-4e84-8256-824724b4e393 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:42:55.765771 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fd494a-ec71-4e84-8256-824724b4e393 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:55.766054 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fd494a-ec71-4e84-8256-824724b4e393 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:55.766331 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fd494a-ec71-4e84-8256-824724b4e393 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:55.766666 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64c2df6-c5c8-4651-acb0-262c862b5497 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:42:55.775833 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0fd494a-ec71-4e84-8256-824724b4e393 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:42:55.778034 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0fd494a-ec71-4e84-8256-824724b4e393 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:42:55.795038 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application [None req-a0fd494a-ec71-4e84-8256-824724b4e393 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 07:42:55.795038 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 07:42:55.795038 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 07:42:55.795038 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 07:42:55.795038 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 07:42:55.795038 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 07:42:55.795038 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 07:42:55.795038 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 07:42:55.795038 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 07:42:55.795038 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 07:42:55.795038 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 07:42:55.795038 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 07:42:55.795038 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 16 07:42:55.795038 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 16 07:42:55.795038 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 16 07:42:55.796426 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 16 07:42:55.796426 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 07:42:55.796426 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 07:42:55.796426 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 07:42:55.796426 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 07:42:55.796426 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 07:42:55.796426 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 07:42:55.796426 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 07:42:55.796426 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application with Lock( Sep 16 07:42:55.796426 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 07:42:55.796426 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._enter() Sep 16 07:42:55.796426 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 07:42:55.796426 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 07:42:55.796426 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 07:42:55.796426 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.creator() Sep 16 07:42:55.796426 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 07:42:55.796426 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application created_value = creator( Sep 16 07:42:55.798062 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 16 07:42:55.798062 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 16 07:42:55.798062 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 16 07:42:55.798062 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 16 07:42:55.798062 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 16 07:42:55.798062 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 16 07:42:55.798062 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 07:42:55.798062 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Sep 16 07:42:55.798062 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 469/939] 10.222.0.57 () {56 vars in 1111 bytes} [Fri Sep 16 07:42:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 07:42:55.802294 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fd494a-ec71-4e84-8256-824724b4e393 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:42:55.810143 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:42:55.815627 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7237c9f-3849-4825-ad08-ccaef22e2a1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:42:55.816253 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7237c9f-3849-4825-ad08-ccaef22e2a1b None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:55.816535 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7237c9f-3849-4825-ad08-ccaef22e2a1b None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:55.816895 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7237c9f-3849-4825-ad08-ccaef22e2a1b None admin] PATH_INFO: `/v3/services` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:55.817692 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7237c9f-3849-4825-ad08-ccaef22e2a1b None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:42:55.818050 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7237c9f-3849-4825-ad08-ccaef22e2a1b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:42:55.820090 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7237c9f-3849-4825-ad08-ccaef22e2a1b None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:42:55.829808 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 471/940] 10.222.0.57 () {56 vars in 1122 bytes} [Fri Sep 16 07:42:55 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:42:55.833180 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7237c9f-3849-4825-ad08-ccaef22e2a1b None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:42:55.946031 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fd494a-ec71-4e84-8256-824724b4e393 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:42:55.978992 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7237c9f-3849-4825-ad08-ccaef22e2a1b None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:42:55.993385 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16e2ba8-2316-49fb-8173-93a77793bd43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:42:55.995454 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16e2ba8-2316-49fb-8173-93a77793bd43 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:55.995885 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16e2ba8-2316-49fb-8173-93a77793bd43 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:55.996399 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16e2ba8-2316-49fb-8173-93a77793bd43 None admin] PATH_INFO: `/v3/projects` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:55.997233 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16e2ba8-2316-49fb-8173-93a77793bd43 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:42:55.997686 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16e2ba8-2316-49fb-8173-93a77793bd43 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:42:55.999524 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16e2ba8-2316-49fb-8173-93a77793bd43 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:42:56.013422 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 470/941] 10.222.0.57 () {56 vars in 1148 bytes} [Fri Sep 16 07:42:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 07:42:56.021523 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16e2ba8-2316-49fb-8173-93a77793bd43 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:42:56.021686 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125413f8-ceb1-48d7-91da-816eb6cfb0f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:42:56.021686 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125413f8-ceb1-48d7-91da-816eb6cfb0f8 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:56.021686 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125413f8-ceb1-48d7-91da-816eb6cfb0f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:56.021686 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125413f8-ceb1-48d7-91da-816eb6cfb0f8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:56.022076 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125413f8-ceb1-48d7-91da-816eb6cfb0f8 None admin] RBAC: Adding query filter params (interface=public, service_id=1e901c4035834dc0a498eabb908130ef, region_id=RegionOne) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:42:56.022076 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125413f8-ceb1-48d7-91da-816eb6cfb0f8 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:42:56.024101 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125413f8-ceb1-48d7-91da-816eb6cfb0f8 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:42:56.034825 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 472/942] 10.222.0.57 () {56 vars in 1251 bytes} [Fri Sep 16 07:42:55 2022] GET /identity/v3/endpoints?service_id=1e901c4035834dc0a498eabb908130ef&interface=public®ion_id=RegionOne => generated 194 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 07:42:56.037846 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125413f8-ceb1-48d7-91da-816eb6cfb0f8 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:42:56.070723 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:42:56.124174 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:42:56.136773 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16e2ba8-2316-49fb-8173-93a77793bd43 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:42:56.181930 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097dd9b2-0086-4090-9a39-d51762e38645 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:42:56.182600 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097dd9b2-0086-4090-9a39-d51762e38645 None admin] REQUEST_METHOD: `PUT` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:56.182875 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097dd9b2-0086-4090-9a39-d51762e38645 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:56.183107 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097dd9b2-0086-4090-9a39-d51762e38645 None admin] PATH_INFO: `/v3/projects/4735f453c0c24cc4a1c14e9ac84a0b46/users/56eb9bbabb65436bb095952159df184c/roles/0f6db070ff104938a2112f6d80494dab` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:56.186060 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125413f8-ceb1-48d7-91da-816eb6cfb0f8 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:42:56.187281 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097dd9b2-0086-4090-9a39-d51762e38645 None admin] RBAC: Authorizing `identity:create_grant(project_id=4735f453c0c24cc4a1c14e9ac84a0b46, user_id=56eb9bbabb65436bb095952159df184c, role_id=0f6db070ff104938a2112f6d80494dab)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:42:56.190256 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097dd9b2-0086-4090-9a39-d51762e38645 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:42:56.208363 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 471/943] 10.222.0.57 () {58 vars in 1439 bytes} [Fri Sep 16 07:42:56 2022] PUT /identity/v3/projects/4735f453c0c24cc4a1c14e9ac84a0b46/users/56eb9bbabb65436bb095952159df184c/roles/0f6db070ff104938a2112f6d80494dab => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 07:42:56.241913 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ea6da9-8667-4b3f-9f00-c9710f37b116 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:42:56.242571 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ea6da9-8667-4b3f-9f00-c9710f37b116 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:56.242888 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ea6da9-8667-4b3f-9f00-c9710f37b116 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:56.243166 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ea6da9-8667-4b3f-9f00-c9710f37b116 None admin] PATH_INFO: `/v3/services` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:56.244171 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ea6da9-8667-4b3f-9f00-c9710f37b116 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:42:56.246088 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ea6da9-8667-4b3f-9f00-c9710f37b116 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:42:56.257906 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 473/944] 10.222.0.57 () {56 vars in 1087 bytes} [Fri Sep 16 07:42:56 2022] GET /identity/v3/services => generated 1497 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 16 07:42:56.667181 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7884fc52-3501-4bb4-aaa0-1cb1ac9001ee None None] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:56.667563 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7884fc52-3501-4bb4-aaa0-1cb1ac9001ee None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:56.667743 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7884fc52-3501-4bb4-aaa0-1cb1ac9001ee None None] PATH_INFO: `/` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:56.669342 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 472/945] 10.222.0.57 () {54 vars in 927 bytes} [Fri Sep 16 07:42:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 07:42:56.674697 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf1b688-474c-43af-8961-fc63d7d132e5 None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:56.674981 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf1b688-474c-43af-8961-fc63d7d132e5 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:56.675252 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf1b688-474c-43af-8961-fc63d7d132e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:56.695066 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-8bf1b688-474c-43af-8961-fc63d7d132e5 None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:42:56.696252 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-8bf1b688-474c-43af-8961-fc63d7d132e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:42:56.770707 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 474/946] 10.222.0.57 () {58 vars in 1024 bytes} [Fri Sep 16 07:42:56 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 16 07:42:57.046720 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7884fc52-3501-4bb4-aaa0-1cb1ac9001ee None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:42:57.166330 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:42:57.170444 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7884fc52-3501-4bb4-aaa0-1cb1ac9001ee None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:42:57.183272 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc54b75-5b81-4526-bece-5538195da754 None None] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:57.183862 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc54b75-5b81-4526-bece-5538195da754 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:57.184141 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc54b75-5b81-4526-bece-5538195da754 None None] PATH_INFO: `/` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:57.190297 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 475/947] 10.222.0.57 () {54 vars in 927 bytes} [Fri Sep 16 07:42:57 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 07:42:57.192710 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212defaa-2b9d-447a-921a-a8f5e26baadd None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:57.192998 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212defaa-2b9d-447a-921a-a8f5e26baadd None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:57.194070 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212defaa-2b9d-447a-921a-a8f5e26baadd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:57.216043 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3b9f2b-e93d-4d7a-bc4a-7c519f19c8d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:42:57.216713 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3b9f2b-e93d-4d7a-bc4a-7c519f19c8d2 None admin] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:57.216911 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3b9f2b-e93d-4d7a-bc4a-7c519f19c8d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:57.217231 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3b9f2b-e93d-4d7a-bc4a-7c519f19c8d2 None admin] PATH_INFO: `/v3/projects` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:57.217833 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3b9f2b-e93d-4d7a-bc4a-7c519f19c8d2 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:42:57.218170 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-212defaa-2b9d-447a-921a-a8f5e26baadd None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:42:57.219257 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3b9f2b-e93d-4d7a-bc4a-7c519f19c8d2 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:42:57.219366 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-212defaa-2b9d-447a-921a-a8f5e26baadd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:42:57.222959 dv-cinder-740146-20-smb devstack@keystone.service[81431]: WARNING keystone.server.flask.common [None req-fd3b9f2b-e93d-4d7a-bc4a-7c519f19c8d2 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Sep 16 07:42:57.244202 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.sql.core [None req-fd3b9f2b-e93d-4d7a-bc4a-7c519f19c8d2 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 16 07:42:57.244202 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Sep 16 07:42:57.244202 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [parameters: {'id': 'f7d04fb9fb9c4378af923d75eaad0752', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Sep 16 07:42:57.244202 dv-cinder-740146-20-smb devstack@keystone.service[81431]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81431) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 16 07:42:57.265706 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application [None req-fd3b9f2b-e93d-4d7a-bc4a-7c519f19c8d2 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id f7d04fb9fb9c4378af923d75eaad0752.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id f7d04fb9fb9c4378af923d75eaad0752. Sep 16 07:42:57.265706 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 07:42:57.265706 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 16 07:42:57.265706 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 16 07:42:57.265706 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 16 07:42:57.265706 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 16 07:42:57.265706 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 16 07:42:57.265706 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application result = self._query(query) Sep 16 07:42:57.265706 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 16 07:42:57.265706 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application conn.query(q) Sep 16 07:42:57.265706 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 16 07:42:57.265706 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 16 07:42:57.265706 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 16 07:42:57.266605 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application result.read() Sep 16 07:42:57.266605 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 16 07:42:57.266605 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 16 07:42:57.266605 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 16 07:42:57.266605 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 16 07:42:57.266605 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 16 07:42:57.266605 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 16 07:42:57.266605 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 16 07:42:57.266605 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 16 07:42:57.266605 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 16 07:42:57.266605 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Sep 16 07:42:57.266605 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 16 07:42:57.266605 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Sep 16 07:42:57.266605 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 07:42:57.266605 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 16 07:42:57.266605 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 16 07:42:57.266605 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Sep 16 07:42:57.266605 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return project_ref.to_dict() Sep 16 07:42:57.267549 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 16 07:42:57.267549 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application next(self.gen) Sep 16 07:42:57.267549 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 16 07:42:57.267549 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application yield resource Sep 16 07:42:57.267549 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 16 07:42:57.267549 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application next(self.gen) Sep 16 07:42:57.267549 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 16 07:42:57.267549 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application self.session.rollback() Sep 16 07:42:57.267549 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 16 07:42:57.267549 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application self.force_reraise() Sep 16 07:42:57.267549 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 16 07:42:57.267549 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application raise self.value Sep 16 07:42:57.267549 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 16 07:42:57.267549 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 16 07:42:57.267549 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 16 07:42:57.267549 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application session.commit() Sep 16 07:42:57.267549 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 16 07:42:57.268824 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 16 07:42:57.268824 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 16 07:42:57.268824 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application self._prepare_impl() Sep 16 07:42:57.268824 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 16 07:42:57.268824 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application self.session.flush() Sep 16 07:42:57.268824 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 16 07:42:57.268824 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application self._flush(objects) Sep 16 07:42:57.268824 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 16 07:42:57.268824 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 16 07:42:57.268824 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 16 07:42:57.268824 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application compat.raise_( Sep 16 07:42:57.268824 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 16 07:42:57.268824 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application raise exception Sep 16 07:42:57.268824 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 16 07:42:57.268824 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application flush_context.execute() Sep 16 07:42:57.268824 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 16 07:42:57.268824 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application rec.execute(self) Sep 16 07:42:57.270027 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 16 07:42:57.270027 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 16 07:42:57.270027 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 16 07:42:57.270027 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 16 07:42:57.270027 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Sep 16 07:42:57.270027 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application c = connection._execute_20( Sep 16 07:42:57.270027 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 16 07:42:57.270027 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 16 07:42:57.270027 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 16 07:42:57.270027 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 16 07:42:57.270027 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 16 07:42:57.270027 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 16 07:42:57.270027 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 16 07:42:57.270027 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 16 07:42:57.270027 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 16 07:42:57.270842 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 16 07:42:57.270842 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 16 07:42:57.270842 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application raise exception Sep 16 07:42:57.270842 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 16 07:42:57.270842 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 16 07:42:57.270842 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 16 07:42:57.270842 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 16 07:42:57.270842 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 16 07:42:57.270842 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application result = self._query(query) Sep 16 07:42:57.270842 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 16 07:42:57.270842 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application conn.query(q) Sep 16 07:42:57.270842 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 16 07:42:57.270842 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 16 07:42:57.270842 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 16 07:42:57.270842 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application result.read() Sep 16 07:42:57.270842 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 16 07:42:57.270842 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 16 07:42:57.271711 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 16 07:42:57.271711 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 16 07:42:57.271711 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 16 07:42:57.271711 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 16 07:42:57.271711 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 16 07:42:57.271711 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 16 07:42:57.271711 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 16 07:42:57.271711 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Sep 16 07:42:57.271711 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application [parameters: {'id': 'f7d04fb9fb9c4378af923d75eaad0752', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Sep 16 07:42:57.271711 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 16 07:42:57.271711 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Sep 16 07:42:57.271711 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 16 07:42:57.271711 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Sep 16 07:42:57.271711 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 07:42:57.271711 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Sep 16 07:42:57.272864 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Sep 16 07:42:57.272864 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 16 07:42:57.272864 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 16 07:42:57.272864 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Sep 16 07:42:57.272864 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Sep 16 07:42:57.272864 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 16 07:42:57.272864 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Sep 16 07:42:57.272864 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 07:42:57.272864 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 07:42:57.272864 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 07:42:57.272864 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 07:42:57.272864 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 07:42:57.272864 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 07:42:57.272864 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 07:42:57.272864 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 07:42:57.272864 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 07:42:57.272864 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 07:42:57.273846 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 07:42:57.273846 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Sep 16 07:42:57.273846 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Sep 16 07:42:57.273846 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 07:42:57.273846 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 07:42:57.273846 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Sep 16 07:42:57.273846 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application raise exception.Conflict( Sep 16 07:42:57.273846 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id f7d04fb9fb9c4378af923d75eaad0752. Sep 16 07:42:57.273846 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Sep 16 07:42:57.273846 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 473/948] 10.222.0.57 () {60 vars in 1140 bytes} [Fri Sep 16 07:42:57 2022] POST /identity/v3/projects => generated 262 bytes in 221 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Sep 16 07:42:57.273846 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3b9f2b-e93d-4d7a-bc4a-7c519f19c8d2 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:42:57.282276 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:42:57.306592 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 476/949] 10.222.0.57 () {58 vars in 1024 bytes} [Fri Sep 16 07:42:57 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 16 07:42:57.388046 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3b9f2b-e93d-4d7a-bc4a-7c519f19c8d2 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:42:57.423144 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d665a8f-518a-4819-a38f-30d59f9e6560 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:42:57.423774 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d665a8f-518a-4819-a38f-30d59f9e6560 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:57.424056 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d665a8f-518a-4819-a38f-30d59f9e6560 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:57.424331 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d665a8f-518a-4819-a38f-30d59f9e6560 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:57.431327 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d665a8f-518a-4819-a38f-30d59f9e6560 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:42:57.433174 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d665a8f-518a-4819-a38f-30d59f9e6560 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:42:57.444502 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application [None req-0d665a8f-518a-4819-a38f-30d59f9e6560 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 07:42:57.444502 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 07:42:57.444502 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 07:42:57.444502 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 07:42:57.444502 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 07:42:57.444502 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 07:42:57.444502 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 07:42:57.444502 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 07:42:57.444502 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 07:42:57.444502 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 07:42:57.444502 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 07:42:57.444502 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 07:42:57.444502 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 16 07:42:57.444502 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 16 07:42:57.444502 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 16 07:42:57.446305 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 16 07:42:57.446305 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 07:42:57.446305 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 07:42:57.446305 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 07:42:57.446305 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 07:42:57.446305 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 07:42:57.446305 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 07:42:57.446305 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 07:42:57.446305 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application with Lock( Sep 16 07:42:57.446305 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 07:42:57.446305 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._enter() Sep 16 07:42:57.446305 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 07:42:57.446305 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 07:42:57.446305 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 07:42:57.446305 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.creator() Sep 16 07:42:57.446305 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 07:42:57.446305 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application created_value = creator( Sep 16 07:42:57.448862 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 16 07:42:57.448862 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 16 07:42:57.448862 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 16 07:42:57.448862 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 16 07:42:57.448862 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 16 07:42:57.448862 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 16 07:42:57.448862 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 07:42:57.448862 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Sep 16 07:42:57.450303 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 474/950] 10.222.0.57 () {56 vars in 1111 bytes} [Fri Sep 16 07:42:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 16 07:42:57.453102 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212defaa-2b9d-447a-921a-a8f5e26baadd None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:42:57.563156 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212defaa-2b9d-447a-921a-a8f5e26baadd None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:42:57.599707 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e90e8f-ceed-4784-b270-a686495e7528 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:42:57.600318 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e90e8f-ceed-4784-b270-a686495e7528 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:57.600601 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e90e8f-ceed-4784-b270-a686495e7528 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:57.600882 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e90e8f-ceed-4784-b270-a686495e7528 None admin] PATH_INFO: `/v3/projects` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:57.601614 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e90e8f-ceed-4784-b270-a686495e7528 None admin] RBAC: Adding query filter params (name=service) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:42:57.601972 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e90e8f-ceed-4784-b270-a686495e7528 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:42:57.603937 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e90e8f-ceed-4784-b270-a686495e7528 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:42:57.614824 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d665a8f-518a-4819-a38f-30d59f9e6560 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:42:57.625760 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 477/951] 10.222.0.57 () {56 vars in 1112 bytes} [Fri Sep 16 07:42:57 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 07:42:57.642673 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:42:57.741888 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d665a8f-518a-4819-a38f-30d59f9e6560 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:42:57.782726 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7470400-21ec-4811-97c6-f18c2559316c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:42:57.783704 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7470400-21ec-4811-97c6-f18c2559316c None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:57.784158 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7470400-21ec-4811-97c6-f18c2559316c None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:57.784677 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7470400-21ec-4811-97c6-f18c2559316c None admin] PATH_INFO: `/v3/services/compute` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:57.785436 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7470400-21ec-4811-97c6-f18c2559316c None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:42:57.787112 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7470400-21ec-4811-97c6-f18c2559316c None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:42:57.798399 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application [None req-e7470400-21ec-4811-97c6-f18c2559316c None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 16 07:42:57.798399 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 07:42:57.798399 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 16 07:42:57.798399 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 16 07:42:57.798399 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 16 07:42:57.798399 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 16 07:42:57.798399 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 16 07:42:57.798399 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 16 07:42:57.798399 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 16 07:42:57.798399 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Sep 16 07:42:57.798399 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 16 07:42:57.798399 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Sep 16 07:42:57.798399 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 07:42:57.798399 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 07:42:57.798399 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 07:42:57.798399 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 07:42:57.798399 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 07:42:57.799686 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 07:42:57.799686 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 07:42:57.799686 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 07:42:57.799686 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 07:42:57.799686 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 07:42:57.799686 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 07:42:57.799686 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 16 07:42:57.799686 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 16 07:42:57.799686 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 16 07:42:57.799686 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 16 07:42:57.799686 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 07:42:57.799686 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 07:42:57.799686 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 07:42:57.799686 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 07:42:57.799686 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 07:42:57.799686 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 07:42:57.800965 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 07:42:57.800965 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application with Lock( Sep 16 07:42:57.800965 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 07:42:57.800965 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._enter() Sep 16 07:42:57.800965 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 07:42:57.800965 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 07:42:57.800965 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 07:42:57.800965 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.creator() Sep 16 07:42:57.800965 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 07:42:57.800965 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application created_value = creator( Sep 16 07:42:57.800965 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 16 07:42:57.800965 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 16 07:42:57.800965 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 16 07:42:57.800965 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Sep 16 07:42:57.803708 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 475/952] 10.222.0.57 () {56 vars in 1111 bytes} [Fri Sep 16 07:42:57 2022] GET /identity/v3/services/compute => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 16 07:42:57.809643 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e90e8f-ceed-4784-b270-a686495e7528 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:42:57.863200 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:42:57.925084 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e90e8f-ceed-4784-b270-a686495e7528 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:42:57.961994 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb49e6f-8bc7-4616-bd1a-4a378cf6e134 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:42:57.963598 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb49e6f-8bc7-4616-bd1a-4a378cf6e134 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:57.964018 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb49e6f-8bc7-4616-bd1a-4a378cf6e134 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:57.964298 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb49e6f-8bc7-4616-bd1a-4a378cf6e134 None admin] PATH_INFO: `/v3/services` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:57.964944 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb49e6f-8bc7-4616-bd1a-4a378cf6e134 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:42:57.965249 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb49e6f-8bc7-4616-bd1a-4a378cf6e134 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:42:57.966646 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb49e6f-8bc7-4616-bd1a-4a378cf6e134 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:42:57.972238 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 478/953] 10.222.0.57 () {56 vars in 1112 bytes} [Fri Sep 16 07:42:57 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 07:42:57.978029 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7470400-21ec-4811-97c6-f18c2559316c None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:42:58.065840 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:42:58.099335 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7470400-21ec-4811-97c6-f18c2559316c None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:42:58.137283 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6c17bc-041c-4777-b98a-1722eae88887 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:42:58.137843 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6c17bc-041c-4777-b98a-1722eae88887 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:58.138126 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6c17bc-041c-4777-b98a-1722eae88887 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:58.138400 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6c17bc-041c-4777-b98a-1722eae88887 None admin] PATH_INFO: `/v3/services` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:58.139029 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6c17bc-041c-4777-b98a-1722eae88887 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:42:58.139327 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6c17bc-041c-4777-b98a-1722eae88887 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:42:58.140693 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6c17bc-041c-4777-b98a-1722eae88887 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:42:58.148598 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 476/954] 10.222.0.57 () {56 vars in 1112 bytes} [Fri Sep 16 07:42:57 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:42:58.503545 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472c4f90-effd-4d73-a601-966a0f4e3ddd None None] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:58.504050 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472c4f90-effd-4d73-a601-966a0f4e3ddd None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:58.504050 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472c4f90-effd-4d73-a601-966a0f4e3ddd None None] PATH_INFO: `/` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:58.505872 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 479/955] 10.222.0.57 () {54 vars in 927 bytes} [Fri Sep 16 07:42:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 07:42:58.512006 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e420101-8618-46b2-8a5d-66ac6f57b616 None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:58.512509 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e420101-8618-46b2-8a5d-66ac6f57b616 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:58.512509 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e420101-8618-46b2-8a5d-66ac6f57b616 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:58.531835 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-6e420101-8618-46b2-8a5d-66ac6f57b616 None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:42:58.533364 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-6e420101-8618-46b2-8a5d-66ac6f57b616 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:42:58.587423 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9dcd49-eb1e-4671-838d-7bb52e941359 None None] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:58.587806 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9dcd49-eb1e-4671-838d-7bb52e941359 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:58.588085 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9dcd49-eb1e-4671-838d-7bb52e941359 None None] PATH_INFO: `/` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:58.590733 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 480/956] 10.222.0.57 () {54 vars in 927 bytes} [Fri Sep 16 07:42:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 16 07:42:58.594815 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096b9014-d486-4dbc-9d61-bc4d0a7cf935 None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:58.595098 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096b9014-d486-4dbc-9d61-bc4d0a7cf935 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:58.595370 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096b9014-d486-4dbc-9d61-bc4d0a7cf935 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:58.607227 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 477/957] 10.222.0.57 () {58 vars in 1024 bytes} [Fri Sep 16 07:42:58 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 16 07:42:58.620000 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-096b9014-d486-4dbc-9d61-bc4d0a7cf935 None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:42:58.621341 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-096b9014-d486-4dbc-9d61-bc4d0a7cf935 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:42:58.699347 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 481/958] 10.222.0.57 () {58 vars in 1024 bytes} [Fri Sep 16 07:42:58 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 16 07:42:58.887955 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e420101-8618-46b2-8a5d-66ac6f57b616 None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:42:58.968037 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:42:58.974705 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096b9014-d486-4dbc-9d61-bc4d0a7cf935 None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:42:59.003510 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e420101-8618-46b2-8a5d-66ac6f57b616 None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:42:59.030414 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:42:59.041064 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9426a3-c5c1-4c1f-a854-e5aedfc01f2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:42:59.041812 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9426a3-c5c1-4c1f-a854-e5aedfc01f2a None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:59.042416 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9426a3-c5c1-4c1f-a854-e5aedfc01f2a None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:59.042416 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9426a3-c5c1-4c1f-a854-e5aedfc01f2a None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:59.043013 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9426a3-c5c1-4c1f-a854-e5aedfc01f2a None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:42:59.044383 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9426a3-c5c1-4c1f-a854-e5aedfc01f2a None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:42:59.054008 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application [None req-8b9426a3-c5c1-4c1f-a854-e5aedfc01f2a None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 16 07:42:59.054008 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 07:42:59.054008 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 16 07:42:59.054008 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 16 07:42:59.054008 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 16 07:42:59.054008 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 16 07:42:59.054008 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 16 07:42:59.054008 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 16 07:42:59.054008 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 16 07:42:59.054008 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Sep 16 07:42:59.054008 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 16 07:42:59.054008 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Sep 16 07:42:59.054008 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 07:42:59.054008 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 07:42:59.054008 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 07:42:59.054008 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 07:42:59.054008 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 07:42:59.055094 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 07:42:59.055094 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 07:42:59.055094 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 07:42:59.055094 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 07:42:59.055094 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 07:42:59.055094 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 07:42:59.055094 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 16 07:42:59.055094 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 16 07:42:59.055094 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 16 07:42:59.055094 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 16 07:42:59.055094 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 07:42:59.055094 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 07:42:59.055094 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 07:42:59.055094 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 07:42:59.055094 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 07:42:59.055094 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 07:42:59.056710 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 07:42:59.056710 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application with Lock( Sep 16 07:42:59.056710 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 07:42:59.056710 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._enter() Sep 16 07:42:59.056710 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 07:42:59.056710 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 07:42:59.056710 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 07:42:59.056710 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.creator() Sep 16 07:42:59.056710 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 07:42:59.056710 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application created_value = creator( Sep 16 07:42:59.056710 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 16 07:42:59.056710 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 16 07:42:59.056710 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 16 07:42:59.056710 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Sep 16 07:42:59.060905 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 478/959] 10.222.0.57 () {56 vars in 1126 bytes} [Fri Sep 16 07:42:58 2022] GET /identity/v3/services/object-store => generated 93 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 07:42:59.062437 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9426a3-c5c1-4c1f-a854-e5aedfc01f2a None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:42:59.124675 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096b9014-d486-4dbc-9d61-bc4d0a7cf935 None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:42:59.164044 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85586e28-429c-482c-98a4-4d7dcf2b88f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:42:59.164716 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85586e28-429c-482c-98a4-4d7dcf2b88f9 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:59.165089 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85586e28-429c-482c-98a4-4d7dcf2b88f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:59.166093 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85586e28-429c-482c-98a4-4d7dcf2b88f9 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:59.177144 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85586e28-429c-482c-98a4-4d7dcf2b88f9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 07:42:59.182104 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application [None req-85586e28-429c-482c-98a4-4d7dcf2b88f9 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 16 07:42:59.182104 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 07:42:59.182104 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 07:42:59.182104 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 07:42:59.182104 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 07:42:59.182104 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 07:42:59.182104 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 07:42:59.182104 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 07:42:59.182104 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 07:42:59.182104 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 07:42:59.182104 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 07:42:59.182104 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 07:42:59.182104 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 07:42:59.182104 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 07:42:59.182104 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 07:42:59.182104 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 07:42:59.183260 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 07:42:59.183260 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 07:42:59.183260 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 07:42:59.183260 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 07:42:59.183260 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 07:42:59.183260 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 07:42:59.183260 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 07:42:59.183260 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 07:42:59.183260 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 07:42:59.183260 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 07:42:59.183260 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 07:42:59.183260 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application with Lock( Sep 16 07:42:59.183260 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 07:42:59.183260 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._enter() Sep 16 07:42:59.183260 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 07:42:59.183260 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 07:42:59.184326 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 07:42:59.184326 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.creator() Sep 16 07:42:59.184326 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 07:42:59.184326 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application created_value = creator( Sep 16 07:42:59.184326 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 07:42:59.184326 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 07:42:59.184326 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 07:42:59.184326 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 07:42:59.184326 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 07:42:59.184326 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 07:42:59.184326 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 16 07:42:59.184326 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Sep 16 07:42:59.190837 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 482/960] 10.222.0.57 () {56 vars in 1120 bytes} [Fri Sep 16 07:42:58 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 07:42:59.192120 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85586e28-429c-482c-98a4-4d7dcf2b88f9 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:42:59.193305 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9426a3-c5c1-4c1f-a854-e5aedfc01f2a None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:42:59.234537 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927e74fe-65e8-4425-961b-a6e774fedeca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:42:59.235468 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927e74fe-65e8-4425-961b-a6e774fedeca None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:59.235922 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927e74fe-65e8-4425-961b-a6e774fedeca None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:59.236342 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927e74fe-65e8-4425-961b-a6e774fedeca None admin] PATH_INFO: `/v3/services` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:59.237206 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927e74fe-65e8-4425-961b-a6e774fedeca None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:42:59.237654 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927e74fe-65e8-4425-961b-a6e774fedeca None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:42:59.239261 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927e74fe-65e8-4425-961b-a6e774fedeca None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:42:59.245353 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 479/961] 10.222.0.57 () {56 vars in 1122 bytes} [Fri Sep 16 07:42:59 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:42:59.252046 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927e74fe-65e8-4425-961b-a6e774fedeca None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:42:59.255290 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:42:59.297477 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:42:59.301407 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85586e28-429c-482c-98a4-4d7dcf2b88f9 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:42:59.336543 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac41b4d2-ffe9-4a09-96c3-ee1ea87ce642 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:42:59.336911 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac41b4d2-ffe9-4a09-96c3-ee1ea87ce642 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:59.337742 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac41b4d2-ffe9-4a09-96c3-ee1ea87ce642 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:59.337929 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac41b4d2-ffe9-4a09-96c3-ee1ea87ce642 None admin] PATH_INFO: `/v3/roles` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:59.338594 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac41b4d2-ffe9-4a09-96c3-ee1ea87ce642 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:42:59.338900 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac41b4d2-ffe9-4a09-96c3-ee1ea87ce642 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:42:59.340421 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac41b4d2-ffe9-4a09-96c3-ee1ea87ce642 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:42:59.353861 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 483/962] 10.222.0.57 () {56 vars in 1115 bytes} [Fri Sep 16 07:42:59 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 07:42:59.355414 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac41b4d2-ffe9-4a09-96c3-ee1ea87ce642 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:42:59.374197 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927e74fe-65e8-4425-961b-a6e774fedeca None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:42:59.415959 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef4db55-62b2-4f1a-92f1-eb8a0855b4c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:42:59.417986 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef4db55-62b2-4f1a-92f1-eb8a0855b4c2 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:59.418482 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef4db55-62b2-4f1a-92f1-eb8a0855b4c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:59.419220 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef4db55-62b2-4f1a-92f1-eb8a0855b4c2 None admin] PATH_INFO: `/v3/services` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:59.420616 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef4db55-62b2-4f1a-92f1-eb8a0855b4c2 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:42:59.421314 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef4db55-62b2-4f1a-92f1-eb8a0855b4c2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:42:59.423239 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef4db55-62b2-4f1a-92f1-eb8a0855b4c2 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:42:59.436630 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 480/963] 10.222.0.57 () {56 vars in 1122 bytes} [Fri Sep 16 07:42:59 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 07:42:59.436971 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef4db55-62b2-4f1a-92f1-eb8a0855b4c2 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:42:59.465310 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac41b4d2-ffe9-4a09-96c3-ee1ea87ce642 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:42:59.502011 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e329e18-20c7-45e5-93ab-d02bd479d419 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:42:59.502658 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e329e18-20c7-45e5-93ab-d02bd479d419 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:59.502939 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e329e18-20c7-45e5-93ab-d02bd479d419 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:59.503196 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e329e18-20c7-45e5-93ab-d02bd479d419 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:59.515192 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e329e18-20c7-45e5-93ab-d02bd479d419 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:42:59.516549 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e329e18-20c7-45e5-93ab-d02bd479d419 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:42:59.531614 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application [None req-6e329e18-20c7-45e5-93ab-d02bd479d419 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 07:42:59.531614 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 07:42:59.531614 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 07:42:59.531614 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 07:42:59.531614 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 07:42:59.531614 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 07:42:59.531614 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 07:42:59.531614 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 07:42:59.531614 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 07:42:59.531614 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 07:42:59.531614 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 07:42:59.531614 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 07:42:59.531614 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 07:42:59.531614 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 07:42:59.531614 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 07:42:59.531614 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 07:42:59.532584 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 07:42:59.532584 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 07:42:59.532584 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 07:42:59.532584 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 07:42:59.532584 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 07:42:59.532584 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 07:42:59.532584 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 07:42:59.532584 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application with Lock( Sep 16 07:42:59.532584 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 07:42:59.532584 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._enter() Sep 16 07:42:59.532584 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 07:42:59.532584 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 07:42:59.532584 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 07:42:59.532584 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.creator() Sep 16 07:42:59.532584 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 07:42:59.532584 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application created_value = creator( Sep 16 07:42:59.532584 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 07:42:59.533498 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 07:42:59.533498 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 07:42:59.533498 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Sep 16 07:42:59.534414 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:42:59.536640 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 484/964] 10.222.0.57 () {56 vars in 1108 bytes} [Fri Sep 16 07:42:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 16 07:42:59.539533 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e329e18-20c7-45e5-93ab-d02bd479d419 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:42:59.555561 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:42:59.584203 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef4db55-62b2-4f1a-92f1-eb8a0855b4c2 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:42:59.619532 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe999d4-0027-4326-9c7d-19acd4bd66df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:42:59.620180 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe999d4-0027-4326-9c7d-19acd4bd66df None admin] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:59.620416 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe999d4-0027-4326-9c7d-19acd4bd66df None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:59.620685 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe999d4-0027-4326-9c7d-19acd4bd66df None admin] PATH_INFO: `/v3/endpoints` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:59.621341 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe999d4-0027-4326-9c7d-19acd4bd66df None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:42:59.622728 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe999d4-0027-4326-9c7d-19acd4bd66df None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:42:59.650186 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 481/965] 10.222.0.57 () {60 vars in 1144 bytes} [Fri Sep 16 07:42:59 2022] POST /identity/v3/endpoints => generated 349 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 16 07:42:59.676674 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e329e18-20c7-45e5-93ab-d02bd479d419 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:42:59.722926 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e418e8b4-5e97-4708-a33b-c98332e1eff5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:42:59.723531 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e418e8b4-5e97-4708-a33b-c98332e1eff5 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:59.723807 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e418e8b4-5e97-4708-a33b-c98332e1eff5 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:59.724080 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e418e8b4-5e97-4708-a33b-c98332e1eff5 None admin] PATH_INFO: `/v3/domains` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:59.724724 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e418e8b4-5e97-4708-a33b-c98332e1eff5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:42:59.725023 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e418e8b4-5e97-4708-a33b-c98332e1eff5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:42:59.726659 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e418e8b4-5e97-4708-a33b-c98332e1eff5 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:42:59.745835 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 485/966] 10.222.0.57 () {56 vars in 1109 bytes} [Fri Sep 16 07:42:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 07:42:59.747461 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe999d4-0027-4326-9c7d-19acd4bd66df None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:42:59.866275 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe999d4-0027-4326-9c7d-19acd4bd66df None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:42:59.891825 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:42:59.905943 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deefa77d-31d2-4ade-bdd3-2ba837c5b617 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:42:59.906638 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deefa77d-31d2-4ade-bdd3-2ba837c5b617 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:59.906908 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deefa77d-31d2-4ade-bdd3-2ba837c5b617 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:59.907169 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deefa77d-31d2-4ade-bdd3-2ba837c5b617 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:59.915850 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deefa77d-31d2-4ade-bdd3-2ba837c5b617 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:42:59.917359 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deefa77d-31d2-4ade-bdd3-2ba837c5b617 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:42:59.929068 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application [None req-deefa77d-31d2-4ade-bdd3-2ba837c5b617 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 16 07:42:59.929068 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 07:42:59.929068 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 07:42:59.929068 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 07:42:59.929068 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 07:42:59.929068 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 07:42:59.929068 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 07:42:59.929068 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 07:42:59.929068 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 07:42:59.929068 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 07:42:59.929068 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 07:42:59.929068 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 07:42:59.929068 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 16 07:42:59.929068 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 16 07:42:59.929068 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 16 07:42:59.929068 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 16 07:42:59.930083 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 07:42:59.930083 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 07:42:59.930083 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 16 07:42:59.930083 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 07:42:59.930083 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 16 07:42:59.930083 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 07:42:59.930083 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 07:42:59.930083 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 07:42:59.930083 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 07:42:59.930083 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 07:42:59.930083 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 07:42:59.930083 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application with Lock( Sep 16 07:42:59.930083 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 07:42:59.930083 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._enter() Sep 16 07:42:59.930083 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 07:42:59.930083 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 07:42:59.930083 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 07:42:59.930083 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.creator() Sep 16 07:42:59.931956 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 07:42:59.931956 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application created_value = creator( Sep 16 07:42:59.931956 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 16 07:42:59.931956 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 16 07:42:59.931956 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 16 07:42:59.931956 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 16 07:42:59.931956 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 16 07:42:59.931956 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 16 07:42:59.931956 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 16 07:42:59.931956 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Sep 16 07:42:59.933235 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 482/967] 10.222.0.57 () {56 vars in 1117 bytes} [Fri Sep 16 07:42:59 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 07:42:59.936182 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0635a8-399d-4c7c-a0a5-d104e59c550d None None] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:59.936471 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0635a8-399d-4c7c-a0a5-d104e59c550d None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:59.936761 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0635a8-399d-4c7c-a0a5-d104e59c550d None None] PATH_INFO: `/` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:59.937036 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deefa77d-31d2-4ade-bdd3-2ba837c5b617 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:42:59.938340 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 486/968] 10.222.0.57 () {54 vars in 927 bytes} [Fri Sep 16 07:42:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 07:42:59.943705 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402b1bd5-0ed1-420e-ad5d-ace97a434deb None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:42:59.944043 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402b1bd5-0ed1-420e-ad5d-ace97a434deb None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:42:59.944320 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402b1bd5-0ed1-420e-ad5d-ace97a434deb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:42:59.963516 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-402b1bd5-0ed1-420e-ad5d-ace97a434deb None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:42:59.964537 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-402b1bd5-0ed1-420e-ad5d-ace97a434deb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:43:00.031599 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:43:00.039011 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 487/969] 10.222.0.57 () {58 vars in 1024 bytes} [Fri Sep 16 07:42:59 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 16 07:43:00.070154 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deefa77d-31d2-4ade-bdd3-2ba837c5b617 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:43:00.109290 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bad8d8-b346-4279-896c-67b78e1c3dd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:43:00.110132 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bad8d8-b346-4279-896c-67b78e1c3dd1 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:43:00.110568 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bad8d8-b346-4279-896c-67b78e1c3dd1 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:43:00.110989 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bad8d8-b346-4279-896c-67b78e1c3dd1 None admin] PATH_INFO: `/v3/users` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:43:00.111854 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63bad8d8-b346-4279-896c-67b78e1c3dd1 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:43:00.112306 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63bad8d8-b346-4279-896c-67b78e1c3dd1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:43:00.113965 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63bad8d8-b346-4279-896c-67b78e1c3dd1 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:43:00.139287 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 483/970] 10.222.0.57 () {56 vars in 1149 bytes} [Fri Sep 16 07:42:59 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:43:00.147383 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402b1bd5-0ed1-420e-ad5d-ace97a434deb None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:43:00.252484 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402b1bd5-0ed1-420e-ad5d-ace97a434deb None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:43:00.293244 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3bc2bc-9562-487e-b220-af58e87debac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:43:00.293961 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3bc2bc-9562-487e-b220-af58e87debac None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:43:00.294247 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3bc2bc-9562-487e-b220-af58e87debac None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:43:00.294502 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3bc2bc-9562-487e-b220-af58e87debac None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:43:00.313749 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bad8d8-b346-4279-896c-67b78e1c3dd1 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:43:00.362980 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:43:00.371977 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:43:00.375937 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3bc2bc-9562-487e-b220-af58e87debac None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:43:00.377782 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3bc2bc-9562-487e-b220-af58e87debac None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:43:00.433416 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bad8d8-b346-4279-896c-67b78e1c3dd1 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:43:00.474036 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcb47f8-7dcc-4b1a-88e0-5092e2ef428f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:43:00.474694 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcb47f8-7dcc-4b1a-88e0-5092e2ef428f None admin] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:43:00.474974 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcb47f8-7dcc-4b1a-88e0-5092e2ef428f None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:43:00.475241 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcb47f8-7dcc-4b1a-88e0-5092e2ef428f None admin] PATH_INFO: `/v3/users` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:43:00.475994 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bcb47f8-7dcc-4b1a-88e0-5092e2ef428f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:43:00.477529 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bcb47f8-7dcc-4b1a-88e0-5092e2ef428f None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:43:00.485951 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 488/971] 10.222.0.57 () {58 vars in 1282 bytes} [Fri Sep 16 07:43:00 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 16 07:43:00.487071 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf7dd50-0898-4f13-bb13-97bab32c91f7 None None] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:43:00.487360 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf7dd50-0898-4f13-bb13-97bab32c91f7 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:43:00.487632 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf7dd50-0898-4f13-bb13-97bab32c91f7 None None] PATH_INFO: `/` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:43:00.492957 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 489/972] 10.222.0.57 () {54 vars in 927 bytes} [Fri Sep 16 07:43:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 07:43:00.495210 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf7dd50-0898-4f13-bb13-97bab32c91f7 None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:43:00.500341 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.sql.core [None req-6bcb47f8-7dcc-4b1a-88e0-5092e2ef428f None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 16 07:43:00.500341 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Sep 16 07:43:00.500341 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [parameters: {'user_id': '1e93b45ca83e4f34a0799a3e08425e0f', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Sep 16 07:43:00.500341 dv-cinder-740146-20-smb devstack@keystone.service[81431]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81431) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 16 07:43:00.507155 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application [None req-6bcb47f8-7dcc-4b1a-88e0-5092e2ef428f None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Sep 16 07:43:00.507155 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 07:43:00.507155 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 16 07:43:00.507155 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 16 07:43:00.507155 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 16 07:43:00.507155 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 16 07:43:00.507155 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 16 07:43:00.507155 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application result = self._query(query) Sep 16 07:43:00.507155 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 16 07:43:00.507155 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application conn.query(q) Sep 16 07:43:00.507155 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 16 07:43:00.507155 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 16 07:43:00.507155 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 16 07:43:00.507155 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application result.read() Sep 16 07:43:00.507155 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 16 07:43:00.508028 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 16 07:43:00.508028 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 16 07:43:00.508028 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 16 07:43:00.508028 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 16 07:43:00.508028 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 16 07:43:00.508028 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 16 07:43:00.508028 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 16 07:43:00.508028 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 16 07:43:00.508028 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Sep 16 07:43:00.508028 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 16 07:43:00.508028 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Sep 16 07:43:00.508028 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 07:43:00.508028 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 16 07:43:00.508028 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 16 07:43:00.508028 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Sep 16 07:43:00.508028 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Sep 16 07:43:00.508028 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 16 07:43:00.508028 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application next(self.gen) Sep 16 07:43:00.509055 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 16 07:43:00.509055 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application yield resource Sep 16 07:43:00.509055 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 16 07:43:00.509055 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application next(self.gen) Sep 16 07:43:00.509055 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 16 07:43:00.509055 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application self.session.rollback() Sep 16 07:43:00.509055 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 16 07:43:00.509055 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application self.force_reraise() Sep 16 07:43:00.509055 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 16 07:43:00.509055 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application raise self.value Sep 16 07:43:00.509055 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 16 07:43:00.509055 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 16 07:43:00.509055 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 16 07:43:00.509055 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application session.commit() Sep 16 07:43:00.509055 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 16 07:43:00.509055 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 16 07:43:00.509055 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 16 07:43:00.510096 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application self._prepare_impl() Sep 16 07:43:00.510096 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 16 07:43:00.510096 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application self.session.flush() Sep 16 07:43:00.510096 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 16 07:43:00.510096 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application self._flush(objects) Sep 16 07:43:00.510096 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 16 07:43:00.510096 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 16 07:43:00.510096 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 16 07:43:00.510096 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application compat.raise_( Sep 16 07:43:00.510096 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 16 07:43:00.510096 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application raise exception Sep 16 07:43:00.510096 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 16 07:43:00.510096 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application flush_context.execute() Sep 16 07:43:00.510096 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 16 07:43:00.510096 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application rec.execute(self) Sep 16 07:43:00.510096 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 16 07:43:00.510096 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 16 07:43:00.511007 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 16 07:43:00.511007 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 16 07:43:00.511007 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Sep 16 07:43:00.511007 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application result = connection._execute_20( Sep 16 07:43:00.511007 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 16 07:43:00.511007 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 16 07:43:00.511007 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 16 07:43:00.511007 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 16 07:43:00.511007 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 16 07:43:00.511007 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 16 07:43:00.511007 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 16 07:43:00.511007 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 16 07:43:00.511007 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 16 07:43:00.511007 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 16 07:43:00.511007 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 16 07:43:00.511007 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application raise exception Sep 16 07:43:00.511876 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 16 07:43:00.511876 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 16 07:43:00.511876 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 16 07:43:00.511876 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 16 07:43:00.511876 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 16 07:43:00.511876 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application result = self._query(query) Sep 16 07:43:00.511876 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 16 07:43:00.511876 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application conn.query(q) Sep 16 07:43:00.511876 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 16 07:43:00.511876 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 16 07:43:00.511876 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 16 07:43:00.511876 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application result.read() Sep 16 07:43:00.511876 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 16 07:43:00.511876 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 16 07:43:00.511876 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 16 07:43:00.511876 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 16 07:43:00.512721 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 16 07:43:00.512721 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 16 07:43:00.512721 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 16 07:43:00.512721 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 16 07:43:00.512721 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 16 07:43:00.512721 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Sep 16 07:43:00.512721 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application [parameters: {'user_id': '1e93b45ca83e4f34a0799a3e08425e0f', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Sep 16 07:43:00.512721 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 16 07:43:00.512721 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Sep 16 07:43:00.512721 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 16 07:43:00.512721 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Sep 16 07:43:00.512721 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 07:43:00.512721 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 07:43:00.512721 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 07:43:00.512721 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 07:43:00.515116 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 07:43:00.515116 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 07:43:00.515116 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 07:43:00.515116 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 07:43:00.515116 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 07:43:00.515116 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 07:43:00.515116 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 07:43:00.515116 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Sep 16 07:43:00.515116 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Sep 16 07:43:00.515116 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 07:43:00.515116 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 07:43:00.515116 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 16 07:43:00.515116 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 07:43:00.515116 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 16 07:43:00.515116 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 07:43:00.515116 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Sep 16 07:43:00.515116 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Sep 16 07:43:00.518042 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Sep 16 07:43:00.518042 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Sep 16 07:43:00.518042 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 16 07:43:00.518042 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 16 07:43:00.518042 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Sep 16 07:43:00.518042 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Sep 16 07:43:00.518042 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 484/973] 10.222.0.57 () {60 vars in 1131 bytes} [Fri Sep 16 07:43:00 2022] POST /identity/v3/users => generated 160 bytes in 195 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Sep 16 07:43:00.518042 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a55e730-2bca-4670-b8f3-9a784d36bbfa None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:43:00.518042 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a55e730-2bca-4670-b8f3-9a784d36bbfa None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:43:00.518042 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a55e730-2bca-4670-b8f3-9a784d36bbfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:43:00.530562 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-3a55e730-2bca-4670-b8f3-9a784d36bbfa None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:43:00.532215 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-3a55e730-2bca-4670-b8f3-9a784d36bbfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:43:00.607087 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 485/974] 10.222.0.57 () {58 vars in 1024 bytes} [Fri Sep 16 07:43:00 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 16 07:43:00.607996 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a55e730-2bca-4670-b8f3-9a784d36bbfa None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:43:00.614999 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:43:00.622525 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf7dd50-0898-4f13-bb13-97bab32c91f7 None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:43:00.644785 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:43:00.671841 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693cd918-1b9c-4a83-ab58-857218c4fe40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:43:00.672468 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693cd918-1b9c-4a83-ab58-857218c4fe40 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:43:00.672744 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693cd918-1b9c-4a83-ab58-857218c4fe40 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:43:00.673013 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693cd918-1b9c-4a83-ab58-857218c4fe40 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:43:00.683822 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693cd918-1b9c-4a83-ab58-857218c4fe40 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:43:00.685255 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693cd918-1b9c-4a83-ab58-857218c4fe40 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:43:00.701105 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application [None req-693cd918-1b9c-4a83-ab58-857218c4fe40 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 07:43:00.701105 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 07:43:00.701105 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 07:43:00.701105 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 07:43:00.701105 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 07:43:00.701105 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 07:43:00.701105 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 07:43:00.701105 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 07:43:00.701105 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 07:43:00.701105 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 07:43:00.701105 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 07:43:00.701105 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 07:43:00.701105 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 07:43:00.701105 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 07:43:00.701105 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 07:43:00.701105 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 07:43:00.702183 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 07:43:00.702183 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 07:43:00.702183 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 07:43:00.702183 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 07:43:00.702183 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 07:43:00.702183 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 07:43:00.702183 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 07:43:00.702183 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application with Lock( Sep 16 07:43:00.702183 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 07:43:00.702183 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._enter() Sep 16 07:43:00.702183 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 07:43:00.702183 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 07:43:00.702183 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 07:43:00.702183 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.creator() Sep 16 07:43:00.702183 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 07:43:00.702183 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application created_value = creator( Sep 16 07:43:00.702183 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 07:43:00.703074 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 07:43:00.703074 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 07:43:00.703074 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Sep 16 07:43:00.707283 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 490/975] 10.222.0.57 () {56 vars in 1108 bytes} [Fri Sep 16 07:43:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 07:43:00.708706 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693cd918-1b9c-4a83-ab58-857218c4fe40 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:43:00.731247 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a55e730-2bca-4670-b8f3-9a784d36bbfa None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:43:00.766341 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec7f002-a9a4-43be-a59c-2a33ea08d819 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:43:00.766898 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec7f002-a9a4-43be-a59c-2a33ea08d819 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:43:00.767178 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec7f002-a9a4-43be-a59c-2a33ea08d819 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:43:00.767498 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec7f002-a9a4-43be-a59c-2a33ea08d819 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:43:00.775778 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec7f002-a9a4-43be-a59c-2a33ea08d819 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:43:00.777472 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec7f002-a9a4-43be-a59c-2a33ea08d819 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:43:00.791278 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application [None req-eec7f002-a9a4-43be-a59c-2a33ea08d819 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 16 07:43:00.791278 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 07:43:00.791278 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 07:43:00.791278 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 07:43:00.791278 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 07:43:00.791278 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 07:43:00.791278 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 07:43:00.791278 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 07:43:00.791278 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 07:43:00.791278 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 07:43:00.791278 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 07:43:00.791278 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 07:43:00.791278 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 16 07:43:00.791278 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 16 07:43:00.791278 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 16 07:43:00.791278 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 16 07:43:00.792247 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 07:43:00.792247 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 07:43:00.792247 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 16 07:43:00.792247 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 07:43:00.792247 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 16 07:43:00.792247 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 07:43:00.792247 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 07:43:00.792247 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 07:43:00.792247 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 07:43:00.792247 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 07:43:00.792247 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 07:43:00.792247 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application with Lock( Sep 16 07:43:00.792247 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 07:43:00.792247 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._enter() Sep 16 07:43:00.792247 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 07:43:00.792247 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 07:43:00.792247 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 07:43:00.792247 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.creator() Sep 16 07:43:00.793195 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 07:43:00.793195 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application created_value = creator( Sep 16 07:43:00.793195 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 16 07:43:00.793195 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 16 07:43:00.793195 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 16 07:43:00.793195 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 16 07:43:00.793195 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 16 07:43:00.793195 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 16 07:43:00.793195 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 16 07:43:00.793195 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Sep 16 07:43:00.793764 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 486/976] 10.222.0.57 () {56 vars in 1099 bytes} [Fri Sep 16 07:43:00 2022] GET /identity/v3/users/cinder => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 07:43:00.799420 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec7f002-a9a4-43be-a59c-2a33ea08d819 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:43:00.839747 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693cd918-1b9c-4a83-ab58-857218c4fe40 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:43:00.876044 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ab22a2-9757-45a5-8faa-2059a195bed7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:43:00.876651 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ab22a2-9757-45a5-8faa-2059a195bed7 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:43:00.876929 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ab22a2-9757-45a5-8faa-2059a195bed7 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:43:00.877199 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ab22a2-9757-45a5-8faa-2059a195bed7 None admin] PATH_INFO: `/v3/domains` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:43:00.877967 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ab22a2-9757-45a5-8faa-2059a195bed7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:43:00.878273 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ab22a2-9757-45a5-8faa-2059a195bed7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:43:00.879985 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ab22a2-9757-45a5-8faa-2059a195bed7 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:43:00.897380 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 491/977] 10.222.0.57 () {56 vars in 1109 bytes} [Fri Sep 16 07:43:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:43:00.897943 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:43:00.898997 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ab22a2-9757-45a5-8faa-2059a195bed7 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:43:00.905025 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec7f002-a9a4-43be-a59c-2a33ea08d819 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:43:00.911654 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:43:00.944082 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20eea60-b59c-473a-bc24-74dcbf0cfced None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:43:00.944686 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20eea60-b59c-473a-bc24-74dcbf0cfced None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:43:00.944960 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20eea60-b59c-473a-bc24-74dcbf0cfced None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:43:00.945281 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20eea60-b59c-473a-bc24-74dcbf0cfced None admin] PATH_INFO: `/v3/users` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:43:00.946075 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20eea60-b59c-473a-bc24-74dcbf0cfced None admin] RBAC: Adding query filter params (name=cinder) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:43:00.947396 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20eea60-b59c-473a-bc24-74dcbf0cfced None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:43:00.948415 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20eea60-b59c-473a-bc24-74dcbf0cfced None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:43:00.986325 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 487/978] 10.222.0.57 () {56 vars in 1101 bytes} [Fri Sep 16 07:43:00 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:43:00.989083 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20eea60-b59c-473a-bc24-74dcbf0cfced None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:43:01.014144 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ab22a2-9757-45a5-8faa-2059a195bed7 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:43:01.057835 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f602616-eeb9-4104-bd2f-802d7dc52654 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:43:01.058822 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f602616-eeb9-4104-bd2f-802d7dc52654 None admin] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:43:01.059992 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f602616-eeb9-4104-bd2f-802d7dc52654 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:43:01.060480 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f602616-eeb9-4104-bd2f-802d7dc52654 None admin] PATH_INFO: `/v3/services` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:43:01.062278 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f602616-eeb9-4104-bd2f-802d7dc52654 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:43:01.063977 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f602616-eeb9-4104-bd2f-802d7dc52654 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:43:01.096084 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 492/979] 10.222.0.57 () {60 vars in 1141 bytes} [Fri Sep 16 07:43:00 2022] POST /identity/v3/services => generated 242 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 07:43:01.157021 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20eea60-b59c-473a-bc24-74dcbf0cfced None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:43:01.207653 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac05c9c-8c6b-47f6-a1df-660f49500ab1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:43:01.208483 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac05c9c-8c6b-47f6-a1df-660f49500ab1 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:43:01.208855 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac05c9c-8c6b-47f6-a1df-660f49500ab1 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:43:01.209281 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac05c9c-8c6b-47f6-a1df-660f49500ab1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:43:01.217537 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac05c9c-8c6b-47f6-a1df-660f49500ab1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:43:01.219176 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac05c9c-8c6b-47f6-a1df-660f49500ab1 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:43:01.232605 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application [None req-3ac05c9c-8c6b-47f6-a1df-660f49500ab1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 07:43:01.232605 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 07:43:01.232605 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 07:43:01.232605 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 07:43:01.232605 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 07:43:01.232605 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 07:43:01.232605 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 07:43:01.232605 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 07:43:01.232605 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 07:43:01.232605 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 07:43:01.232605 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 07:43:01.232605 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 07:43:01.232605 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 16 07:43:01.232605 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 16 07:43:01.232605 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 16 07:43:01.233796 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 16 07:43:01.233796 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 07:43:01.233796 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 07:43:01.233796 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 07:43:01.233796 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 07:43:01.233796 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 07:43:01.233796 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 07:43:01.233796 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 07:43:01.233796 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application with Lock( Sep 16 07:43:01.233796 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 07:43:01.233796 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._enter() Sep 16 07:43:01.233796 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 07:43:01.233796 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 07:43:01.233796 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 07:43:01.233796 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.creator() Sep 16 07:43:01.233796 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 07:43:01.233796 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application created_value = creator( Sep 16 07:43:01.234908 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 16 07:43:01.234908 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 16 07:43:01.234908 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 16 07:43:01.234908 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 16 07:43:01.234908 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 16 07:43:01.234908 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 16 07:43:01.234908 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 07:43:01.234908 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Sep 16 07:43:01.236608 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 488/980] 10.222.0.57 () {56 vars in 1111 bytes} [Fri Sep 16 07:43:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 07:43:01.242252 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f602616-eeb9-4104-bd2f-802d7dc52654 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:43:01.325064 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:43:01.359945 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f602616-eeb9-4104-bd2f-802d7dc52654 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:43:01.393246 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8aaff15-a785-49c6-a1fc-398d5924874b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:43:01.393876 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8aaff15-a785-49c6-a1fc-398d5924874b None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:43:01.394149 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8aaff15-a785-49c6-a1fc-398d5924874b None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:43:01.394420 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8aaff15-a785-49c6-a1fc-398d5924874b None admin] PATH_INFO: `/v3/projects` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:43:01.395097 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8aaff15-a785-49c6-a1fc-398d5924874b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:43:01.395396 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8aaff15-a785-49c6-a1fc-398d5924874b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:43:01.396797 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8aaff15-a785-49c6-a1fc-398d5924874b None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:43:01.409588 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 493/981] 10.222.0.57 () {56 vars in 1148 bytes} [Fri Sep 16 07:43:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 07:43:01.416492 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac05c9c-8c6b-47f6-a1df-660f49500ab1 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:43:01.425945 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:43:01.519000 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac05c9c-8c6b-47f6-a1df-660f49500ab1 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:43:01.553498 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8fcb3a-0481-4da8-92fa-0a2283363bb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:43:01.554124 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8fcb3a-0481-4da8-92fa-0a2283363bb0 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:43:01.554401 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8fcb3a-0481-4da8-92fa-0a2283363bb0 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:43:01.554672 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8fcb3a-0481-4da8-92fa-0a2283363bb0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:43:01.555390 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8fcb3a-0481-4da8-92fa-0a2283363bb0 None admin] RBAC: Adding query filter params (role.id=0f6db070ff104938a2112f6d80494dab, scope.project.id=4735f453c0c24cc4a1c14e9ac84a0b46, user.id=56eb9bbabb65436bb095952159df184c) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:43:01.555766 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8fcb3a-0481-4da8-92fa-0a2283363bb0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:43:01.557187 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8fcb3a-0481-4da8-92fa-0a2283363bb0 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:43:01.569751 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 489/982] 10.222.0.57 () {56 vars in 1374 bytes} [Fri Sep 16 07:43:01 2022] GET /identity/v3/role_assignments?user.id=56eb9bbabb65436bb095952159df184c&scope.project.id=4735f453c0c24cc4a1c14e9ac84a0b46&role.id=0f6db070ff104938a2112f6d80494dab => generated 608 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:43:02.059950 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9811871c-67db-4d5c-9fa1-8584d75bffcd None None] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:43:02.060466 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9811871c-67db-4d5c-9fa1-8584d75bffcd None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:43:02.060542 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9811871c-67db-4d5c-9fa1-8584d75bffcd None None] PATH_INFO: `/` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:43:02.061980 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 494/983] 10.222.0.57 () {54 vars in 927 bytes} [Fri Sep 16 07:43:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 07:43:02.067092 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df94c405-768f-4e4e-8428-fefbb18fe027 None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:43:02.067487 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df94c405-768f-4e4e-8428-fefbb18fe027 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:43:02.067648 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df94c405-768f-4e4e-8428-fefbb18fe027 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:43:02.086686 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-df94c405-768f-4e4e-8428-fefbb18fe027 None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:43:02.088334 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-df94c405-768f-4e4e-8428-fefbb18fe027 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:43:02.155393 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:43:02.160423 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 490/984] 10.222.0.57 () {58 vars in 1024 bytes} [Fri Sep 16 07:43:02 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 16 07:43:02.448233 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9811871c-67db-4d5c-9fa1-8584d75bffcd None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:43:02.554872 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9811871c-67db-4d5c-9fa1-8584d75bffcd None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:43:02.584472 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:43:02.591783 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e959f0-e5c3-4192-877b-f3dcfb56bdfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:43:02.592410 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e959f0-e5c3-4192-877b-f3dcfb56bdfc None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:43:02.592689 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e959f0-e5c3-4192-877b-f3dcfb56bdfc None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:43:02.592963 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e959f0-e5c3-4192-877b-f3dcfb56bdfc None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:43:02.593547 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e959f0-e5c3-4192-877b-f3dcfb56bdfc None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:43:02.594927 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e959f0-e5c3-4192-877b-f3dcfb56bdfc None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:43:02.604156 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application [None req-c1e959f0-e5c3-4192-877b-f3dcfb56bdfc None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 16 07:43:02.604156 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 07:43:02.604156 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 16 07:43:02.604156 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 16 07:43:02.604156 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 16 07:43:02.604156 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 16 07:43:02.604156 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 16 07:43:02.604156 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 16 07:43:02.604156 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 16 07:43:02.604156 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Sep 16 07:43:02.604156 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 16 07:43:02.604156 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Sep 16 07:43:02.604156 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 07:43:02.604156 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 07:43:02.604156 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 07:43:02.604156 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 07:43:02.604156 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 07:43:02.605114 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 07:43:02.605114 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 07:43:02.605114 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 07:43:02.605114 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 07:43:02.605114 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 07:43:02.605114 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 07:43:02.605114 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 16 07:43:02.605114 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 16 07:43:02.605114 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 16 07:43:02.605114 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 16 07:43:02.605114 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 07:43:02.605114 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 07:43:02.605114 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 07:43:02.605114 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 07:43:02.605114 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 07:43:02.605114 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 07:43:02.606331 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 07:43:02.606331 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application with Lock( Sep 16 07:43:02.606331 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 07:43:02.606331 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._enter() Sep 16 07:43:02.606331 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 07:43:02.606331 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 07:43:02.606331 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 07:43:02.606331 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.creator() Sep 16 07:43:02.606331 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 07:43:02.606331 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application created_value = creator( Sep 16 07:43:02.606331 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 16 07:43:02.606331 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 16 07:43:02.606331 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 16 07:43:02.606331 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Sep 16 07:43:02.610086 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 495/985] 10.222.0.57 () {56 vars in 1126 bytes} [Fri Sep 16 07:43:02 2022] GET /identity/v3/services/object-store => generated 93 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 07:43:02.611274 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df94c405-768f-4e4e-8428-fefbb18fe027 None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:43:02.713007 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df94c405-768f-4e4e-8428-fefbb18fe027 None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:43:02.748614 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c2a8f7-8721-471c-98ba-b27af789f61c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:43:02.749389 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c2a8f7-8721-471c-98ba-b27af789f61c None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:43:02.749670 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c2a8f7-8721-471c-98ba-b27af789f61c None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:43:02.749958 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c2a8f7-8721-471c-98ba-b27af789f61c None admin] PATH_INFO: `/v3/services` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:43:02.750651 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c2a8f7-8721-471c-98ba-b27af789f61c None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:43:02.750957 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c2a8f7-8721-471c-98ba-b27af789f61c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:43:02.752314 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c2a8f7-8721-471c-98ba-b27af789f61c None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:43:02.763002 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 491/986] 10.222.0.57 () {56 vars in 1122 bytes} [Fri Sep 16 07:43:02 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:43:02.764248 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e959f0-e5c3-4192-877b-f3dcfb56bdfc None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:43:02.869063 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e959f0-e5c3-4192-877b-f3dcfb56bdfc None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:43:02.914863 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0ac49d-40c7-4500-a6df-2431e84bd046 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:43:02.915760 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0ac49d-40c7-4500-a6df-2431e84bd046 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:43:02.916174 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0ac49d-40c7-4500-a6df-2431e84bd046 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:43:02.916570 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0ac49d-40c7-4500-a6df-2431e84bd046 None admin] PATH_INFO: `/v3/services` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:43:02.917529 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0ac49d-40c7-4500-a6df-2431e84bd046 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:43:02.918063 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0ac49d-40c7-4500-a6df-2431e84bd046 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:43:02.919494 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0ac49d-40c7-4500-a6df-2431e84bd046 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:43:02.929793 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 496/987] 10.222.0.57 () {56 vars in 1122 bytes} [Fri Sep 16 07:43:02 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:43:02.932268 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c2a8f7-8721-471c-98ba-b27af789f61c None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:43:02.995330 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:43:03.034693 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c2a8f7-8721-471c-98ba-b27af789f61c None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:43:03.068859 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1dfaf8c-cf28-43a8-8bd1-5e84c496a518 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:43:03.069474 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dfaf8c-cf28-43a8-8bd1-5e84c496a518 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:43:03.069751 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dfaf8c-cf28-43a8-8bd1-5e84c496a518 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:43:03.070023 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dfaf8c-cf28-43a8-8bd1-5e84c496a518 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:43:03.070717 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1dfaf8c-cf28-43a8-8bd1-5e84c496a518 None admin] RBAC: Adding query filter params (interface=admin, service_id=1e901c4035834dc0a498eabb908130ef, region_id=RegionOne) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:43:03.071022 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1dfaf8c-cf28-43a8-8bd1-5e84c496a518 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:43:03.073102 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1dfaf8c-cf28-43a8-8bd1-5e84c496a518 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:43:03.085470 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 492/988] 10.222.0.57 () {56 vars in 1249 bytes} [Fri Sep 16 07:43:02 2022] GET /identity/v3/endpoints?service_id=1e901c4035834dc0a498eabb908130ef&interface=admin®ion_id=RegionOne => generated 193 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:43:03.086904 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0ac49d-40c7-4500-a6df-2431e84bd046 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:43:03.151816 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:43:03.195368 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0ac49d-40c7-4500-a6df-2431e84bd046 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:43:03.230586 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0346888-ec65-4a79-b238-0ca5badf2312 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:43:03.231215 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0346888-ec65-4a79-b238-0ca5badf2312 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:43:03.231490 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0346888-ec65-4a79-b238-0ca5badf2312 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:43:03.231760 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0346888-ec65-4a79-b238-0ca5badf2312 None admin] PATH_INFO: `/v3/services` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:43:03.232379 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0346888-ec65-4a79-b238-0ca5badf2312 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:43:03.233799 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0346888-ec65-4a79-b238-0ca5badf2312 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:43:03.241394 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 497/989] 10.222.0.57 () {56 vars in 1087 bytes} [Fri Sep 16 07:43:03 2022] GET /identity/v3/services => generated 1727 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 07:43:03.359914 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766ff502-cc93-412b-b2be-aea0464b0125 None None] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:43:03.360276 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766ff502-cc93-412b-b2be-aea0464b0125 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:43:03.360457 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766ff502-cc93-412b-b2be-aea0464b0125 None None] PATH_INFO: `/` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:43:03.362052 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 493/990] 10.222.0.57 () {54 vars in 927 bytes} [Fri Sep 16 07:43:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 07:43:03.367595 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9f6d7d-80b9-431f-a6b2-e2cbdf6e4ee8 None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:43:03.367893 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9f6d7d-80b9-431f-a6b2-e2cbdf6e4ee8 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:43:03.368724 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9f6d7d-80b9-431f-a6b2-e2cbdf6e4ee8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:43:03.388404 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-dd9f6d7d-80b9-431f-a6b2-e2cbdf6e4ee8 None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:43:03.389625 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-dd9f6d7d-80b9-431f-a6b2-e2cbdf6e4ee8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:43:03.471021 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 498/991] 10.222.0.57 () {58 vars in 1024 bytes} [Fri Sep 16 07:43:03 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 16 07:43:03.744005 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766ff502-cc93-412b-b2be-aea0464b0125 None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:43:03.830517 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0273fee-10e7-4209-8ebf-e00f2823a530 None None] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:43:03.830808 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0273fee-10e7-4209-8ebf-e00f2823a530 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:43:03.831097 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0273fee-10e7-4209-8ebf-e00f2823a530 None None] PATH_INFO: `/` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:43:03.832419 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 499/992] 10.222.0.57 () {54 vars in 927 bytes} [Fri Sep 16 07:43:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 16 07:43:03.838624 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcfe153-4d0c-4c9e-a74a-d6495f354eaa None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:43:03.839032 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcfe153-4d0c-4c9e-a74a-d6495f354eaa None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:43:03.839383 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcfe153-4d0c-4c9e-a74a-d6495f354eaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:43:03.850841 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766ff502-cc93-412b-b2be-aea0464b0125 None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:43:03.858315 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-7fcfe153-4d0c-4c9e-a74a-d6495f354eaa None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:43:03.859513 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-7fcfe153-4d0c-4c9e-a74a-d6495f354eaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:43:03.884637 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:43:03.895081 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e1f7ac-40e4-44ce-a396-b60e46f1afe3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:43:03.895968 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e1f7ac-40e4-44ce-a396-b60e46f1afe3 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:43:03.896410 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e1f7ac-40e4-44ce-a396-b60e46f1afe3 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:43:03.896679 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e1f7ac-40e4-44ce-a396-b60e46f1afe3 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:43:03.897261 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e1f7ac-40e4-44ce-a396-b60e46f1afe3 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:43:03.898648 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e1f7ac-40e4-44ce-a396-b60e46f1afe3 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:43:03.908496 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application [None req-48e1f7ac-40e4-44ce-a396-b60e46f1afe3 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 16 07:43:03.908496 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 07:43:03.908496 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 16 07:43:03.908496 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 16 07:43:03.908496 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 16 07:43:03.908496 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 16 07:43:03.908496 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 16 07:43:03.908496 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 16 07:43:03.908496 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 16 07:43:03.908496 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Sep 16 07:43:03.908496 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 16 07:43:03.908496 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Sep 16 07:43:03.908496 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 07:43:03.908496 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 07:43:03.908496 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 07:43:03.908496 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 07:43:03.908496 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 07:43:03.909591 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 07:43:03.909591 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 07:43:03.909591 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 07:43:03.909591 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 07:43:03.909591 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 07:43:03.909591 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 07:43:03.909591 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 16 07:43:03.909591 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 16 07:43:03.909591 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 16 07:43:03.909591 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 16 07:43:03.909591 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 07:43:03.909591 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 07:43:03.909591 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 07:43:03.909591 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 07:43:03.909591 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 07:43:03.909591 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 07:43:03.914750 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 07:43:03.914750 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application with Lock( Sep 16 07:43:03.914750 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 07:43:03.914750 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._enter() Sep 16 07:43:03.914750 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 07:43:03.914750 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 07:43:03.914750 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 07:43:03.914750 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.creator() Sep 16 07:43:03.914750 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 07:43:03.914750 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application created_value = creator( Sep 16 07:43:03.914750 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 16 07:43:03.914750 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 16 07:43:03.914750 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 16 07:43:03.914750 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Sep 16 07:43:03.914750 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 494/993] 10.222.0.57 () {56 vars in 1111 bytes} [Fri Sep 16 07:43:03 2022] GET /identity/v3/services/compute => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 07:43:03.917455 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e1f7ac-40e4-44ce-a396-b60e46f1afe3 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:43:03.923732 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:43:03.945856 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 500/994] 10.222.0.57 () {58 vars in 1024 bytes} [Fri Sep 16 07:43:03 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 16 07:43:04.026068 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e1f7ac-40e4-44ce-a396-b60e46f1afe3 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:43:04.058862 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06511c3-a7af-4ba8-a68a-6f6c30769139 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:43:04.059465 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06511c3-a7af-4ba8-a68a-6f6c30769139 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:43:04.059740 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06511c3-a7af-4ba8-a68a-6f6c30769139 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:43:04.060009 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06511c3-a7af-4ba8-a68a-6f6c30769139 None admin] PATH_INFO: `/v3/services` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:43:04.060626 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06511c3-a7af-4ba8-a68a-6f6c30769139 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:43:04.060922 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06511c3-a7af-4ba8-a68a-6f6c30769139 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:43:04.062318 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06511c3-a7af-4ba8-a68a-6f6c30769139 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:43:04.067117 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 495/995] 10.222.0.57 () {56 vars in 1112 bytes} [Fri Sep 16 07:43:03 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:43:04.073143 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcfe153-4d0c-4c9e-a74a-d6495f354eaa None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:43:04.180226 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcfe153-4d0c-4c9e-a74a-d6495f354eaa None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:43:04.214031 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95f4ba6-e1d3-472f-bd46-8618e6c973ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:43:04.214636 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95f4ba6-e1d3-472f-bd46-8618e6c973ec None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:43:04.214911 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95f4ba6-e1d3-472f-bd46-8618e6c973ec None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:43:04.215178 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95f4ba6-e1d3-472f-bd46-8618e6c973ec None admin] PATH_INFO: `/v3/services` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:43:04.215794 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95f4ba6-e1d3-472f-bd46-8618e6c973ec None admin] RBAC: Adding query filter params (type=compute) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:43:04.216090 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95f4ba6-e1d3-472f-bd46-8618e6c973ec None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:43:04.216634 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06511c3-a7af-4ba8-a68a-6f6c30769139 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:43:04.217441 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95f4ba6-e1d3-472f-bd46-8618e6c973ec None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:43:04.222992 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 501/996] 10.222.0.57 () {56 vars in 1112 bytes} [Fri Sep 16 07:43:04 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:43:04.231557 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95f4ba6-e1d3-472f-bd46-8618e6c973ec None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:43:04.280106 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:43:04.285488 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:43:04.325967 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06511c3-a7af-4ba8-a68a-6f6c30769139 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:43:04.346417 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95f4ba6-e1d3-472f-bd46-8618e6c973ec None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:43:04.362896 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8061f2-6c16-4b84-b7e1-84b6b59b800f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:43:04.363525 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8061f2-6c16-4b84-b7e1-84b6b59b800f None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:43:04.363808 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8061f2-6c16-4b84-b7e1-84b6b59b800f None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:43:04.364071 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8061f2-6c16-4b84-b7e1-84b6b59b800f None admin] PATH_INFO: `/v3/services/image` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:43:04.364647 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8061f2-6c16-4b84-b7e1-84b6b59b800f None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:43:04.366031 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8061f2-6c16-4b84-b7e1-84b6b59b800f None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:43:04.375101 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application [None req-9f8061f2-6c16-4b84-b7e1-84b6b59b800f None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 16 07:43:04.375101 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 07:43:04.375101 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 16 07:43:04.375101 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 16 07:43:04.375101 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 16 07:43:04.375101 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 16 07:43:04.375101 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 16 07:43:04.375101 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 16 07:43:04.375101 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 16 07:43:04.375101 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Sep 16 07:43:04.375101 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 16 07:43:04.375101 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Sep 16 07:43:04.375101 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 07:43:04.375101 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 07:43:04.375101 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 07:43:04.375101 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 07:43:04.375101 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 07:43:04.376305 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 07:43:04.376305 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 07:43:04.376305 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 07:43:04.376305 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 07:43:04.376305 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 07:43:04.376305 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 07:43:04.376305 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 16 07:43:04.376305 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 16 07:43:04.376305 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 16 07:43:04.376305 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 16 07:43:04.376305 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 07:43:04.376305 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 07:43:04.376305 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 07:43:04.376305 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 07:43:04.376305 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 07:43:04.376305 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 07:43:04.377175 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 07:43:04.377175 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application with Lock( Sep 16 07:43:04.377175 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 07:43:04.377175 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._enter() Sep 16 07:43:04.377175 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 07:43:04.377175 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 07:43:04.377175 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 07:43:04.377175 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.creator() Sep 16 07:43:04.377175 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 07:43:04.377175 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application created_value = creator( Sep 16 07:43:04.377175 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 16 07:43:04.377175 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 16 07:43:04.377175 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 16 07:43:04.377175 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Sep 16 07:43:04.377175 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 496/997] 10.222.0.57 () {56 vars in 1105 bytes} [Fri Sep 16 07:43:04 2022] GET /identity/v3/services/image => generated 86 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 16 07:43:04.382162 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8061f2-6c16-4b84-b7e1-84b6b59b800f None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:43:04.390445 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9098850-ce77-4180-ad67-8958a35cd448 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:43:04.391169 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9098850-ce77-4180-ad67-8958a35cd448 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:43:04.391448 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9098850-ce77-4180-ad67-8958a35cd448 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:43:04.391720 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9098850-ce77-4180-ad67-8958a35cd448 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:43:04.392454 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9098850-ce77-4180-ad67-8958a35cd448 None admin] RBAC: Adding query filter params (interface=public, service_id=85ea041fdd4646d890e0441348b89bf8, region_id=RegionOne) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:43:04.392765 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9098850-ce77-4180-ad67-8958a35cd448 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:43:04.394179 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9098850-ce77-4180-ad67-8958a35cd448 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:43:04.404861 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 502/998] 10.222.0.57 () {56 vars in 1251 bytes} [Fri Sep 16 07:43:04 2022] GET /identity/v3/endpoints?service_id=85ea041fdd4646d890e0441348b89bf8&interface=public®ion_id=RegionOne => generated 194 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:43:04.405579 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9098850-ce77-4180-ad67-8958a35cd448 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:43:04.488066 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8061f2-6c16-4b84-b7e1-84b6b59b800f None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:43:04.510598 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:43:04.519095 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9098850-ce77-4180-ad67-8958a35cd448 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:43:04.526075 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a51d94-c27e-4fe4-804a-088f671260e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:43:04.526684 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a51d94-c27e-4fe4-804a-088f671260e8 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:43:04.526963 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a51d94-c27e-4fe4-804a-088f671260e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:43:04.527239 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a51d94-c27e-4fe4-804a-088f671260e8 None admin] PATH_INFO: `/v3/services` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:43:04.527859 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a51d94-c27e-4fe4-804a-088f671260e8 None admin] RBAC: Adding query filter params (name=image) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:43:04.528160 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a51d94-c27e-4fe4-804a-088f671260e8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:43:04.529552 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a51d94-c27e-4fe4-804a-088f671260e8 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:43:04.531611 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:43:04.535015 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 497/999] 10.222.0.57 () {56 vars in 1108 bytes} [Fri Sep 16 07:43:04 2022] GET /identity/v3/services?name=image => generated 122 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:43:04.540967 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a51d94-c27e-4fe4-804a-088f671260e8 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:43:04.560533 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddf6a76-7c4a-4cf7-9e95-0c89ca83f5c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:43:04.561141 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddf6a76-7c4a-4cf7-9e95-0c89ca83f5c5 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:43:04.561415 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddf6a76-7c4a-4cf7-9e95-0c89ca83f5c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:43:04.561685 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddf6a76-7c4a-4cf7-9e95-0c89ca83f5c5 None admin] PATH_INFO: `/v3/services` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:43:04.562319 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bddf6a76-7c4a-4cf7-9e95-0c89ca83f5c5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:43:04.563674 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bddf6a76-7c4a-4cf7-9e95-0c89ca83f5c5 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:43:04.570201 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 503/1000] 10.222.0.57 () {56 vars in 1087 bytes} [Fri Sep 16 07:43:04 2022] GET /identity/v3/services => generated 1727 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 16 07:43:04.648611 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a51d94-c27e-4fe4-804a-088f671260e8 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:43:04.685177 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d32a5f-290b-4f36-9c78-f1dba0490ef4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:43:04.685831 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d32a5f-290b-4f36-9c78-f1dba0490ef4 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:43:04.686107 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d32a5f-290b-4f36-9c78-f1dba0490ef4 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:43:04.686373 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d32a5f-290b-4f36-9c78-f1dba0490ef4 None admin] PATH_INFO: `/v3/services` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:43:04.686996 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d32a5f-290b-4f36-9c78-f1dba0490ef4 None admin] RBAC: Adding query filter params (type=image) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:43:04.687291 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d32a5f-290b-4f36-9c78-f1dba0490ef4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:43:04.688663 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d32a5f-290b-4f36-9c78-f1dba0490ef4 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:43:04.694025 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 498/1001] 10.222.0.57 () {56 vars in 1108 bytes} [Fri Sep 16 07:43:04 2022] GET /identity/v3/services?type=image => generated 122 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 07:43:05.424663 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b749eecd-d391-4c32-86dd-9d5b38b90f7d None None] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:43:05.425153 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b749eecd-d391-4c32-86dd-9d5b38b90f7d None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:43:05.425153 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b749eecd-d391-4c32-86dd-9d5b38b90f7d None None] PATH_INFO: `/` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:43:05.426507 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 504/1002] 10.222.0.57 () {54 vars in 927 bytes} [Fri Sep 16 07:43:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 07:43:05.431728 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a14ad41-a27f-4e21-8372-31b01b0f1eff None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:43:05.432119 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a14ad41-a27f-4e21-8372-31b01b0f1eff None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:43:05.432300 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a14ad41-a27f-4e21-8372-31b01b0f1eff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:43:05.450707 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-3a14ad41-a27f-4e21-8372-31b01b0f1eff None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:43:05.451917 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-3a14ad41-a27f-4e21-8372-31b01b0f1eff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:43:05.499736 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:43:05.525392 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 499/1003] 10.222.0.57 () {58 vars in 1024 bytes} [Fri Sep 16 07:43:05 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 16 07:43:05.795127 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b749eecd-d391-4c32-86dd-9d5b38b90f7d None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:43:05.899005 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b749eecd-d391-4c32-86dd-9d5b38b90f7d None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:43:05.933920 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c58cb2-7059-4fa1-98e6-3c8b8a9ae690 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:43:05.934551 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c58cb2-7059-4fa1-98e6-3c8b8a9ae690 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:43:05.934825 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c58cb2-7059-4fa1-98e6-3c8b8a9ae690 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:43:05.935095 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c58cb2-7059-4fa1-98e6-3c8b8a9ae690 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:43:05.935773 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c58cb2-7059-4fa1-98e6-3c8b8a9ae690 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:43:05.937121 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c58cb2-7059-4fa1-98e6-3c8b8a9ae690 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:43:05.945923 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application [None req-25c58cb2-7059-4fa1-98e6-3c8b8a9ae690 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 16 07:43:05.945923 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 07:43:05.945923 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 16 07:43:05.945923 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 16 07:43:05.945923 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 16 07:43:05.945923 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 16 07:43:05.945923 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 16 07:43:05.945923 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 16 07:43:05.945923 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 16 07:43:05.945923 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Sep 16 07:43:05.945923 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 16 07:43:05.945923 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Sep 16 07:43:05.945923 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 07:43:05.945923 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 07:43:05.945923 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 07:43:05.945923 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 07:43:05.945923 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 07:43:05.947557 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 07:43:05.947557 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 07:43:05.947557 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 07:43:05.947557 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 07:43:05.947557 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 07:43:05.947557 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 07:43:05.947557 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 16 07:43:05.947557 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 16 07:43:05.947557 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 16 07:43:05.947557 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 16 07:43:05.947557 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 07:43:05.947557 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 07:43:05.947557 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 07:43:05.947557 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 07:43:05.947557 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 07:43:05.947557 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 07:43:05.948421 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 07:43:05.948421 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application with Lock( Sep 16 07:43:05.948421 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 07:43:05.948421 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._enter() Sep 16 07:43:05.948421 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 07:43:05.948421 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 07:43:05.948421 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 07:43:05.948421 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.creator() Sep 16 07:43:05.948421 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 07:43:05.948421 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application created_value = creator( Sep 16 07:43:05.948421 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 16 07:43:05.948421 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 16 07:43:05.948421 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 16 07:43:05.948421 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Sep 16 07:43:05.950077 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 505/1004] 10.222.0.57 () {56 vars in 1126 bytes} [Fri Sep 16 07:43:05 2022] GET /identity/v3/services/object-store => generated 93 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 07:43:05.953771 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a14ad41-a27f-4e21-8372-31b01b0f1eff None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:43:06.051155 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a14ad41-a27f-4e21-8372-31b01b0f1eff None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:43:06.089856 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19152ab8-9402-49ec-af5d-beab4ba582f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:43:06.090459 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19152ab8-9402-49ec-af5d-beab4ba582f4 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:43:06.090735 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19152ab8-9402-49ec-af5d-beab4ba582f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:43:06.091001 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19152ab8-9402-49ec-af5d-beab4ba582f4 None admin] PATH_INFO: `/v3/services` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:43:06.091613 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19152ab8-9402-49ec-af5d-beab4ba582f4 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:43:06.091908 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19152ab8-9402-49ec-af5d-beab4ba582f4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:43:06.093289 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19152ab8-9402-49ec-af5d-beab4ba582f4 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:43:06.098012 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 500/1005] 10.222.0.57 () {56 vars in 1122 bytes} [Fri Sep 16 07:43:05 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:43:06.104731 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c58cb2-7059-4fa1-98e6-3c8b8a9ae690 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:43:06.147435 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:43:06.209349 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c58cb2-7059-4fa1-98e6-3c8b8a9ae690 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:43:06.244600 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c8199f-8300-4f73-bf07-4d28a3f5ead8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:43:06.245207 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c8199f-8300-4f73-bf07-4d28a3f5ead8 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:43:06.245488 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c8199f-8300-4f73-bf07-4d28a3f5ead8 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:43:06.245783 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c8199f-8300-4f73-bf07-4d28a3f5ead8 None admin] PATH_INFO: `/v3/services` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:43:06.246408 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c8199f-8300-4f73-bf07-4d28a3f5ead8 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:43:06.246715 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c8199f-8300-4f73-bf07-4d28a3f5ead8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:43:06.248066 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c8199f-8300-4f73-bf07-4d28a3f5ead8 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:43:06.257565 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 506/1006] 10.222.0.57 () {56 vars in 1122 bytes} [Fri Sep 16 07:43:06 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 07:43:06.259989 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19152ab8-9402-49ec-af5d-beab4ba582f4 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:43:06.305013 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:43:06.363145 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19152ab8-9402-49ec-af5d-beab4ba582f4 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:43:06.398236 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f805a7-d890-4a6a-b46c-83d02fbbca0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:43:06.398850 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f805a7-d890-4a6a-b46c-83d02fbbca0e None admin] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:43:06.399161 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f805a7-d890-4a6a-b46c-83d02fbbca0e None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:43:06.399432 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f805a7-d890-4a6a-b46c-83d02fbbca0e None admin] PATH_INFO: `/v3/endpoints` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:43:06.400090 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f805a7-d890-4a6a-b46c-83d02fbbca0e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:43:06.401442 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f805a7-d890-4a6a-b46c-83d02fbbca0e None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:43:06.419458 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 501/1007] 10.222.0.57 () {60 vars in 1144 bytes} [Fri Sep 16 07:43:06 2022] POST /identity/v3/endpoints => generated 325 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 07:43:06.754640 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc3258a-64f4-49a1-aeb4-f9b4d574139b None None] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:43:06.755177 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc3258a-64f4-49a1-aeb4-f9b4d574139b None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:43:06.755177 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc3258a-64f4-49a1-aeb4-f9b4d574139b None None] PATH_INFO: `/` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:43:06.756560 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 507/1008] 10.222.0.57 () {54 vars in 927 bytes} [Fri Sep 16 07:43:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 07:43:06.763035 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f34594-9a75-4b62-b60f-81a57ba7a187 None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:43:06.763597 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f34594-9a75-4b62-b60f-81a57ba7a187 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:43:06.763819 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f34594-9a75-4b62-b60f-81a57ba7a187 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:43:06.784399 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-c4f34594-9a75-4b62-b60f-81a57ba7a187 None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:43:06.785615 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-c4f34594-9a75-4b62-b60f-81a57ba7a187 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:43:06.860132 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 502/1009] 10.222.0.57 () {58 vars in 1024 bytes} [Fri Sep 16 07:43:06 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 16 07:43:06.879616 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29af3ccb-b5dc-4168-ba8b-d5139601b413 None None] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:43:06.879898 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29af3ccb-b5dc-4168-ba8b-d5139601b413 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:43:06.880181 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29af3ccb-b5dc-4168-ba8b-d5139601b413 None None] PATH_INFO: `/` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:43:06.881618 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 508/1010] 10.222.0.57 () {54 vars in 927 bytes} [Fri Sep 16 07:43:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 07:43:06.886894 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26649221-749f-4e36-af54-d1e9e36cfe6f None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:43:06.887186 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26649221-749f-4e36-af54-d1e9e36cfe6f None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:43:06.887465 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26649221-749f-4e36-af54-d1e9e36cfe6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:43:06.905938 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-26649221-749f-4e36-af54-d1e9e36cfe6f None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:43:06.907127 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-26649221-749f-4e36-af54-d1e9e36cfe6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:43:06.930700 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:43:06.977497 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 503/1011] 10.222.0.57 () {58 vars in 1024 bytes} [Fri Sep 16 07:43:06 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 16 07:43:07.127418 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29af3ccb-b5dc-4168-ba8b-d5139601b413 None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:43:07.232622 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29af3ccb-b5dc-4168-ba8b-d5139601b413 None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:43:07.234269 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:43:07.249081 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26649221-749f-4e36-af54-d1e9e36cfe6f None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:43:07.272783 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace0330a-80a1-438e-94b3-1d7061ec8ad9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:43:07.273705 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace0330a-80a1-438e-94b3-1d7061ec8ad9 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:43:07.274667 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace0330a-80a1-438e-94b3-1d7061ec8ad9 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:43:07.275360 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace0330a-80a1-438e-94b3-1d7061ec8ad9 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:43:07.275949 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace0330a-80a1-438e-94b3-1d7061ec8ad9 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:43:07.277664 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace0330a-80a1-438e-94b3-1d7061ec8ad9 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:43:07.286590 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application [None req-ace0330a-80a1-438e-94b3-1d7061ec8ad9 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 16 07:43:07.286590 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 07:43:07.286590 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 16 07:43:07.286590 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 16 07:43:07.286590 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 16 07:43:07.286590 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 16 07:43:07.286590 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 16 07:43:07.286590 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 16 07:43:07.286590 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 16 07:43:07.286590 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Sep 16 07:43:07.286590 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 16 07:43:07.286590 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Sep 16 07:43:07.286590 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 07:43:07.286590 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 07:43:07.286590 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 07:43:07.286590 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 07:43:07.286590 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 07:43:07.287635 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 07:43:07.287635 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 07:43:07.287635 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 07:43:07.287635 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 07:43:07.287635 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 07:43:07.287635 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 07:43:07.287635 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 16 07:43:07.287635 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 16 07:43:07.287635 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 16 07:43:07.287635 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 16 07:43:07.287635 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 07:43:07.287635 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 07:43:07.287635 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 07:43:07.287635 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 07:43:07.287635 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 07:43:07.287635 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 07:43:07.288514 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 07:43:07.288514 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application with Lock( Sep 16 07:43:07.288514 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 07:43:07.288514 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._enter() Sep 16 07:43:07.288514 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 07:43:07.288514 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 07:43:07.288514 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 07:43:07.288514 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.creator() Sep 16 07:43:07.288514 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 07:43:07.288514 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application created_value = creator( Sep 16 07:43:07.288514 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 16 07:43:07.288514 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 16 07:43:07.288514 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 16 07:43:07.288514 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Sep 16 07:43:07.288514 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 509/1012] 10.222.0.57 () {56 vars in 1111 bytes} [Fri Sep 16 07:43:07 2022] GET /identity/v3/services/compute => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 07:43:07.293626 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace0330a-80a1-438e-94b3-1d7061ec8ad9 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:43:07.364668 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26649221-749f-4e36-af54-d1e9e36cfe6f None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:43:07.404493 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace0330a-80a1-438e-94b3-1d7061ec8ad9 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:43:07.407361 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234316ba-208e-4aa3-ad4f-a54ceee8f8e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:43:07.407607 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234316ba-208e-4aa3-ad4f-a54ceee8f8e9 None admin] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:43:07.407868 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234316ba-208e-4aa3-ad4f-a54ceee8f8e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:43:07.408133 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234316ba-208e-4aa3-ad4f-a54ceee8f8e9 None admin] PATH_INFO: `/v3/services` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:43:07.408786 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234316ba-208e-4aa3-ad4f-a54ceee8f8e9 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:43:07.410180 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234316ba-208e-4aa3-ad4f-a54ceee8f8e9 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:43:07.425807 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 504/1013] 10.222.0.57 () {60 vars in 1141 bytes} [Fri Sep 16 07:43:07 2022] POST /identity/v3/services => generated 242 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 16 07:43:07.453067 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb115c3-7252-40f1-84fa-61d314c83e3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:43:07.454134 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb115c3-7252-40f1-84fa-61d314c83e3d None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:43:07.454625 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb115c3-7252-40f1-84fa-61d314c83e3d None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:43:07.455104 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb115c3-7252-40f1-84fa-61d314c83e3d None admin] PATH_INFO: `/v3/services` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:43:07.455986 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb115c3-7252-40f1-84fa-61d314c83e3d None admin] RBAC: Adding query filter params (name=compute) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:43:07.456531 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb115c3-7252-40f1-84fa-61d314c83e3d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:43:07.458255 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb115c3-7252-40f1-84fa-61d314c83e3d None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:43:07.465294 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 510/1014] 10.222.0.57 () {56 vars in 1112 bytes} [Fri Sep 16 07:43:07 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 07:43:07.471098 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234316ba-208e-4aa3-ad4f-a54ceee8f8e9 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:43:07.493891 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:43:07.584030 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234316ba-208e-4aa3-ad4f-a54ceee8f8e9 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:43:07.622486 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a6b16c-7ad6-473b-994f-b46e392e5ff9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:43:07.623023 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a6b16c-7ad6-473b-994f-b46e392e5ff9 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:43:07.623305 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a6b16c-7ad6-473b-994f-b46e392e5ff9 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:43:07.623584 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a6b16c-7ad6-473b-994f-b46e392e5ff9 None admin] PATH_INFO: `/v3/services` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:43:07.624209 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a6b16c-7ad6-473b-994f-b46e392e5ff9 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:43:07.624518 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a6b16c-7ad6-473b-994f-b46e392e5ff9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:43:07.625971 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a6b16c-7ad6-473b-994f-b46e392e5ff9 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:43:07.631229 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 505/1015] 10.222.0.57 () {56 vars in 1112 bytes} [Fri Sep 16 07:43:07 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 07:43:07.639798 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb115c3-7252-40f1-84fa-61d314c83e3d None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:43:07.669842 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:43:07.748287 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb115c3-7252-40f1-84fa-61d314c83e3d None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:43:07.782211 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe71d689-1fcf-4419-bf35-937f7660fc6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:43:07.782857 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe71d689-1fcf-4419-bf35-937f7660fc6d None admin] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:43:07.783083 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe71d689-1fcf-4419-bf35-937f7660fc6d None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:43:07.783355 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe71d689-1fcf-4419-bf35-937f7660fc6d None admin] PATH_INFO: `/v3/endpoints` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:43:07.784028 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe71d689-1fcf-4419-bf35-937f7660fc6d None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:43:07.785374 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe71d689-1fcf-4419-bf35-937f7660fc6d None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:43:07.806742 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 511/1016] 10.222.0.57 () {60 vars in 1144 bytes} [Fri Sep 16 07:43:07 2022] POST /identity/v3/endpoints => generated 334 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 07:43:08.667774 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9035036-ddc7-49f1-9735-62b31376be8a None None] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:43:08.668337 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9035036-ddc7-49f1-9735-62b31376be8a None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:43:08.668337 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9035036-ddc7-49f1-9735-62b31376be8a None None] PATH_INFO: `/` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:43:08.669949 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 506/1017] 10.222.0.57 () {54 vars in 927 bytes} [Fri Sep 16 07:43:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 07:43:08.675059 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab68489-e835-4863-8a7a-9f424e7cf9f1 None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:43:08.675349 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab68489-e835-4863-8a7a-9f424e7cf9f1 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:43:08.675625 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab68489-e835-4863-8a7a-9f424e7cf9f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:43:08.694113 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-3ab68489-e835-4863-8a7a-9f424e7cf9f1 None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:43:08.695313 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-3ab68489-e835-4863-8a7a-9f424e7cf9f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:43:08.770517 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 512/1018] 10.222.0.57 () {58 vars in 1024 bytes} [Fri Sep 16 07:43:08 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 16 07:43:09.038022 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9035036-ddc7-49f1-9735-62b31376be8a None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:43:09.127643 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:43:09.147866 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9035036-ddc7-49f1-9735-62b31376be8a None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:43:09.183821 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ed23be-f924-403c-ad54-1b8f2a7d2c58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:43:09.184455 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ed23be-f924-403c-ad54-1b8f2a7d2c58 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:43:09.184736 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ed23be-f924-403c-ad54-1b8f2a7d2c58 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:43:09.185009 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ed23be-f924-403c-ad54-1b8f2a7d2c58 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:43:09.186218 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ed23be-f924-403c-ad54-1b8f2a7d2c58 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:43:09.187704 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ed23be-f924-403c-ad54-1b8f2a7d2c58 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:43:09.189443 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 507/1019] 10.222.0.57 () {56 vars in 1108 bytes} [Fri Sep 16 07:43:09 2022] GET /identity/v3/domains/default => generated 199 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:43:09.195019 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab68489-e835-4863-8a7a-9f424e7cf9f1 None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:43:09.206002 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:43:09.297712 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab68489-e835-4863-8a7a-9f424e7cf9f1 None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:43:09.331751 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85f0082-0956-403e-82d9-26afff0b8059 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:43:09.332358 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85f0082-0956-403e-82d9-26afff0b8059 None admin] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:43:09.332640 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85f0082-0956-403e-82d9-26afff0b8059 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:43:09.332910 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85f0082-0956-403e-82d9-26afff0b8059 None admin] PATH_INFO: `/v3/projects` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:43:09.333568 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85f0082-0956-403e-82d9-26afff0b8059 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:43:09.335004 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85f0082-0956-403e-82d9-26afff0b8059 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:43:09.363323 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 513/1020] 10.222.0.57 () {60 vars in 1141 bytes} [Fri Sep 16 07:43:09 2022] POST /identity/v3/projects => generated 311 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 07:43:09.640928 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91461a1f-e369-44b7-94f4-d7d2c6814587 None None] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:43:09.641285 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91461a1f-e369-44b7-94f4-d7d2c6814587 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:43:09.641480 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91461a1f-e369-44b7-94f4-d7d2c6814587 None None] PATH_INFO: `/` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:43:09.643004 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 508/1021] 10.222.0.57 () {54 vars in 927 bytes} [Fri Sep 16 07:43:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 07:43:09.648089 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d282d4-fbaa-4b9c-b10d-d6ac45efed70 None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:43:09.648384 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d282d4-fbaa-4b9c-b10d-d6ac45efed70 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:43:09.648667 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d282d4-fbaa-4b9c-b10d-d6ac45efed70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:43:09.667207 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-78d282d4-fbaa-4b9c-b10d-d6ac45efed70 None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:43:09.668396 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-78d282d4-fbaa-4b9c-b10d-d6ac45efed70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:43:09.724596 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:43:09.738593 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 514/1022] 10.222.0.57 () {58 vars in 1024 bytes} [Fri Sep 16 07:43:09 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 16 07:43:10.014751 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91461a1f-e369-44b7-94f4-d7d2c6814587 None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:43:10.095952 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ad1fd4-8882-4460-804f-60318018b0b7 None None] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:43:10.096300 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ad1fd4-8882-4460-804f-60318018b0b7 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:43:10.096510 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ad1fd4-8882-4460-804f-60318018b0b7 None None] PATH_INFO: `/` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:43:10.098069 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 515/1023] 10.222.0.57 () {54 vars in 927 bytes} [Fri Sep 16 07:43:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 07:43:10.103949 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150efcf6-b786-41de-b922-fc62e9401533 None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:43:10.104228 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150efcf6-b786-41de-b922-fc62e9401533 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:43:10.105335 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150efcf6-b786-41de-b922-fc62e9401533 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:43:10.125242 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-150efcf6-b786-41de-b922-fc62e9401533 None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:43:10.126703 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-150efcf6-b786-41de-b922-fc62e9401533 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:43:10.128137 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91461a1f-e369-44b7-94f4-d7d2c6814587 None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:43:10.164321 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0833df-8ad3-44c4-a065-2f812db4eb55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:43:10.165867 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0833df-8ad3-44c4-a065-2f812db4eb55 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:43:10.166368 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0833df-8ad3-44c4-a065-2f812db4eb55 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:43:10.166696 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0833df-8ad3-44c4-a065-2f812db4eb55 None admin] PATH_INFO: `/v3/services/image` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:43:10.167280 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0833df-8ad3-44c4-a065-2f812db4eb55 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:43:10.168642 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0833df-8ad3-44c4-a065-2f812db4eb55 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:43:10.178018 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application [None req-6f0833df-8ad3-44c4-a065-2f812db4eb55 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 16 07:43:10.178018 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 07:43:10.178018 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 16 07:43:10.178018 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 16 07:43:10.178018 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 16 07:43:10.178018 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 16 07:43:10.178018 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 16 07:43:10.178018 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 16 07:43:10.178018 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 16 07:43:10.178018 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Sep 16 07:43:10.178018 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 16 07:43:10.178018 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Sep 16 07:43:10.178018 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 07:43:10.178018 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 07:43:10.178018 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 07:43:10.178018 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 07:43:10.178018 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 07:43:10.179037 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 07:43:10.179037 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 07:43:10.179037 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 07:43:10.179037 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 07:43:10.179037 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 07:43:10.179037 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 07:43:10.179037 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 16 07:43:10.179037 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 16 07:43:10.179037 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 16 07:43:10.179037 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 16 07:43:10.179037 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 07:43:10.179037 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 07:43:10.179037 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 07:43:10.179037 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 07:43:10.179037 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 07:43:10.179037 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 07:43:10.179919 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 07:43:10.179919 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application with Lock( Sep 16 07:43:10.179919 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 07:43:10.179919 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._enter() Sep 16 07:43:10.179919 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 07:43:10.179919 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 07:43:10.179919 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 07:43:10.179919 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.creator() Sep 16 07:43:10.179919 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 07:43:10.179919 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application created_value = creator( Sep 16 07:43:10.179919 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 16 07:43:10.179919 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 16 07:43:10.179919 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 16 07:43:10.179919 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Sep 16 07:43:10.179919 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 509/1024] 10.222.0.57 () {56 vars in 1105 bytes} [Fri Sep 16 07:43:10 2022] GET /identity/v3/services/image => generated 86 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 07:43:10.185523 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0833df-8ad3-44c4-a065-2f812db4eb55 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:43:10.199748 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 516/1025] 10.222.0.57 () {58 vars in 1024 bytes} [Fri Sep 16 07:43:10 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 16 07:43:10.201501 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:43:10.287584 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0833df-8ad3-44c4-a065-2f812db4eb55 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:43:10.322620 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83761446-77b8-46ce-a74c-d9203e975159 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:43:10.323224 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83761446-77b8-46ce-a74c-d9203e975159 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:43:10.323499 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83761446-77b8-46ce-a74c-d9203e975159 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:43:10.323768 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83761446-77b8-46ce-a74c-d9203e975159 None admin] PATH_INFO: `/v3/services` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:43:10.324386 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83761446-77b8-46ce-a74c-d9203e975159 None admin] RBAC: Adding query filter params (name=image) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:43:10.324699 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83761446-77b8-46ce-a74c-d9203e975159 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:43:10.326088 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83761446-77b8-46ce-a74c-d9203e975159 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:43:10.335525 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 510/1026] 10.222.0.57 () {56 vars in 1108 bytes} [Fri Sep 16 07:43:10 2022] GET /identity/v3/services?name=image => generated 122 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 07:43:10.337121 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150efcf6-b786-41de-b922-fc62e9401533 None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:43:10.436045 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150efcf6-b786-41de-b922-fc62e9401533 None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:43:10.456259 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:43:10.468753 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83761446-77b8-46ce-a74c-d9203e975159 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:43:10.472480 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2877b3b1-68b1-4b7e-a5af-df1f3d808255 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:43:10.473092 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2877b3b1-68b1-4b7e-a5af-df1f3d808255 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:43:10.473375 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2877b3b1-68b1-4b7e-a5af-df1f3d808255 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:43:10.473650 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2877b3b1-68b1-4b7e-a5af-df1f3d808255 None admin] PATH_INFO: `/v3/services` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:43:10.474307 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2877b3b1-68b1-4b7e-a5af-df1f3d808255 None admin] RBAC: Adding query filter params (type=image) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:43:10.474607 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2877b3b1-68b1-4b7e-a5af-df1f3d808255 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:43:10.475963 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2877b3b1-68b1-4b7e-a5af-df1f3d808255 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:43:10.486185 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 517/1027] 10.222.0.57 () {56 vars in 1108 bytes} [Fri Sep 16 07:43:10 2022] GET /identity/v3/services?type=image => generated 350 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:43:10.487476 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2877b3b1-68b1-4b7e-a5af-df1f3d808255 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:43:10.566618 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:43:10.592616 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2877b3b1-68b1-4b7e-a5af-df1f3d808255 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:43:10.595837 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83761446-77b8-46ce-a74c-d9203e975159 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:43:10.629402 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea4b895-fdd6-4637-80e7-c24e26d6c88f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:43:10.630036 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea4b895-fdd6-4637-80e7-c24e26d6c88f None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:43:10.630320 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea4b895-fdd6-4637-80e7-c24e26d6c88f None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:43:10.630584 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea4b895-fdd6-4637-80e7-c24e26d6c88f None admin] PATH_INFO: `/v3/endpoints` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:43:10.631388 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea4b895-fdd6-4637-80e7-c24e26d6c88f None admin] RBAC: Adding query filter params (interface=public, service_id=a4d23c1169fc4e0ea4aa18cca8c4a78a, region_id=RegionOne) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:43:10.631594 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea4b895-fdd6-4637-80e7-c24e26d6c88f None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:43:10.632950 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea4b895-fdd6-4637-80e7-c24e26d6c88f None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:43:10.638736 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511c4d2c-6085-44c6-9d02-e57cf298cd3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:43:10.639210 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 518/1028] 10.222.0.57 () {56 vars in 1251 bytes} [Fri Sep 16 07:43:10 2022] GET /identity/v3/endpoints?service_id=a4d23c1169fc4e0ea4aa18cca8c4a78a&interface=public®ion_id=RegionOne => generated 194 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 07:43:10.639806 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511c4d2c-6085-44c6-9d02-e57cf298cd3a None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:43:10.640090 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511c4d2c-6085-44c6-9d02-e57cf298cd3a None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:43:10.640355 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511c4d2c-6085-44c6-9d02-e57cf298cd3a None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:43:10.645030 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea4b895-fdd6-4637-80e7-c24e26d6c88f None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:43:10.655460 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511c4d2c-6085-44c6-9d02-e57cf298cd3a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 07:43:10.661081 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application [None req-511c4d2c-6085-44c6-9d02-e57cf298cd3a None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 16 07:43:10.661081 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 07:43:10.661081 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 07:43:10.661081 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 07:43:10.661081 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 07:43:10.661081 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 07:43:10.661081 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 07:43:10.661081 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 07:43:10.661081 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 07:43:10.661081 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 07:43:10.661081 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 07:43:10.661081 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 07:43:10.661081 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 07:43:10.661081 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 07:43:10.661081 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 07:43:10.661081 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 07:43:10.662067 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 07:43:10.662067 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 07:43:10.662067 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 07:43:10.662067 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 07:43:10.662067 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 07:43:10.662067 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 07:43:10.662067 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 07:43:10.662067 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 07:43:10.662067 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 07:43:10.662067 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 07:43:10.662067 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 07:43:10.662067 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application with Lock( Sep 16 07:43:10.662067 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 07:43:10.662067 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._enter() Sep 16 07:43:10.662067 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 07:43:10.662067 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 07:43:10.662906 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 07:43:10.662906 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.creator() Sep 16 07:43:10.662906 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 07:43:10.662906 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application created_value = creator( Sep 16 07:43:10.662906 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 07:43:10.662906 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 07:43:10.662906 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 07:43:10.662906 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 07:43:10.662906 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 07:43:10.662906 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 07:43:10.662906 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 16 07:43:10.662906 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Sep 16 07:43:10.662906 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 511/1029] 10.222.0.57 () {56 vars in 1120 bytes} [Fri Sep 16 07:43:10 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 16 07:43:10.669014 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511c4d2c-6085-44c6-9d02-e57cf298cd3a None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:43:10.700063 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:43:10.755436 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea4b895-fdd6-4637-80e7-c24e26d6c88f None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:43:10.785163 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511c4d2c-6085-44c6-9d02-e57cf298cd3a None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:43:10.791709 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebd3425-9709-4fc0-983e-9088bb564774 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:43:10.792313 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebd3425-9709-4fc0-983e-9088bb564774 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:43:10.792593 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebd3425-9709-4fc0-983e-9088bb564774 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:43:10.792866 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebd3425-9709-4fc0-983e-9088bb564774 None admin] PATH_INFO: `/v3/services` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:43:10.793463 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebd3425-9709-4fc0-983e-9088bb564774 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:43:10.794895 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebd3425-9709-4fc0-983e-9088bb564774 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:43:10.803552 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 519/1030] 10.222.0.57 () {56 vars in 1087 bytes} [Fri Sep 16 07:43:10 2022] GET /identity/v3/services => generated 1957 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 16 07:43:10.833915 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee62a5f2-d84e-4e1b-a702-f4c127786008 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:43:10.834888 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee62a5f2-d84e-4e1b-a702-f4c127786008 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:43:10.835394 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee62a5f2-d84e-4e1b-a702-f4c127786008 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:43:10.835863 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee62a5f2-d84e-4e1b-a702-f4c127786008 None admin] PATH_INFO: `/v3/roles` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:43:10.837339 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee62a5f2-d84e-4e1b-a702-f4c127786008 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:43:10.837894 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee62a5f2-d84e-4e1b-a702-f4c127786008 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:43:10.839521 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee62a5f2-d84e-4e1b-a702-f4c127786008 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:43:10.846473 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:43:10.851559 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 512/1031] 10.222.0.57 () {56 vars in 1115 bytes} [Fri Sep 16 07:43:10 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 07:43:10.857270 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebd3425-9709-4fc0-983e-9088bb564774 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:43:10.972251 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebd3425-9709-4fc0-983e-9088bb564774 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:43:10.987144 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:43:11.012490 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5b5194-0907-4b03-b561-83116d614792 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:43:11.013118 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5b5194-0907-4b03-b561-83116d614792 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:43:11.013415 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5b5194-0907-4b03-b561-83116d614792 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:43:11.013660 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5b5194-0907-4b03-b561-83116d614792 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:43:11.024770 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5b5194-0907-4b03-b561-83116d614792 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:43:11.026232 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5b5194-0907-4b03-b561-83116d614792 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:43:11.041281 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application [None req-4d5b5194-0907-4b03-b561-83116d614792 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 07:43:11.041281 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 07:43:11.041281 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 07:43:11.041281 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 07:43:11.041281 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 07:43:11.041281 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 07:43:11.041281 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 07:43:11.041281 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 07:43:11.041281 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 07:43:11.041281 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 07:43:11.041281 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 07:43:11.041281 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 07:43:11.041281 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 07:43:11.041281 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 07:43:11.041281 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 07:43:11.041281 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 07:43:11.042269 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 07:43:11.042269 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 07:43:11.042269 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 07:43:11.042269 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 07:43:11.042269 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 07:43:11.042269 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 07:43:11.042269 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 07:43:11.042269 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application with Lock( Sep 16 07:43:11.042269 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 07:43:11.042269 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._enter() Sep 16 07:43:11.042269 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 07:43:11.042269 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 07:43:11.042269 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 07:43:11.042269 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.creator() Sep 16 07:43:11.042269 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 07:43:11.042269 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application created_value = creator( Sep 16 07:43:11.042269 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 07:43:11.043165 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 07:43:11.043165 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 07:43:11.043165 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Sep 16 07:43:11.043165 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 520/1032] 10.222.0.57 () {56 vars in 1108 bytes} [Fri Sep 16 07:43:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 07:43:11.048419 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee62a5f2-d84e-4e1b-a702-f4c127786008 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:43:11.161908 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee62a5f2-d84e-4e1b-a702-f4c127786008 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:43:11.196614 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505ed5d5-78b2-4d83-966d-7ce748bc0915 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:43:11.197284 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505ed5d5-78b2-4d83-966d-7ce748bc0915 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:43:11.197558 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505ed5d5-78b2-4d83-966d-7ce748bc0915 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:43:11.197870 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505ed5d5-78b2-4d83-966d-7ce748bc0915 None admin] PATH_INFO: `/v3/domains` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:43:11.198505 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505ed5d5-78b2-4d83-966d-7ce748bc0915 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:43:11.198856 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505ed5d5-78b2-4d83-966d-7ce748bc0915 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:43:11.200263 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505ed5d5-78b2-4d83-966d-7ce748bc0915 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:43:11.212110 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 513/1033] 10.222.0.57 () {56 vars in 1109 bytes} [Fri Sep 16 07:43:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 07:43:11.217517 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5b5194-0907-4b03-b561-83116d614792 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:43:11.322122 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5b5194-0907-4b03-b561-83116d614792 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:43:11.355651 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40da07be-d9f7-4810-bc6c-873681995d0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:43:11.356272 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40da07be-d9f7-4810-bc6c-873681995d0d None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:43:11.356547 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40da07be-d9f7-4810-bc6c-873681995d0d None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:43:11.356815 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40da07be-d9f7-4810-bc6c-873681995d0d None admin] PATH_INFO: `/v3/users/nova` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:43:11.364174 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40da07be-d9f7-4810-bc6c-873681995d0d None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:43:11.365534 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40da07be-d9f7-4810-bc6c-873681995d0d None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:43:11.377003 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application [None req-40da07be-d9f7-4810-bc6c-873681995d0d None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 16 07:43:11.377003 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 07:43:11.377003 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 07:43:11.377003 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 07:43:11.377003 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 07:43:11.377003 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 07:43:11.377003 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 07:43:11.377003 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 07:43:11.377003 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 07:43:11.377003 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 07:43:11.377003 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 07:43:11.377003 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 07:43:11.377003 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 16 07:43:11.377003 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 16 07:43:11.377003 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 16 07:43:11.377003 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 16 07:43:11.378342 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 07:43:11.378342 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 07:43:11.378342 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 16 07:43:11.378342 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 07:43:11.378342 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 16 07:43:11.378342 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 07:43:11.378342 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 07:43:11.378342 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 07:43:11.378342 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 07:43:11.378342 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 07:43:11.378342 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 07:43:11.378342 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application with Lock( Sep 16 07:43:11.378342 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 07:43:11.378342 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._enter() Sep 16 07:43:11.378342 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 07:43:11.378342 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 07:43:11.378342 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 07:43:11.378342 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.creator() Sep 16 07:43:11.379590 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 07:43:11.379590 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application created_value = creator( Sep 16 07:43:11.379590 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 16 07:43:11.379590 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 16 07:43:11.379590 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 16 07:43:11.379590 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 16 07:43:11.379590 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 16 07:43:11.379590 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 16 07:43:11.379590 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 16 07:43:11.379590 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Sep 16 07:43:11.380616 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 521/1034] 10.222.0.57 () {56 vars in 1093 bytes} [Fri Sep 16 07:43:11 2022] GET /identity/v3/users/nova => generated 82 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 07:43:11.384675 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505ed5d5-78b2-4d83-966d-7ce748bc0915 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:43:11.444933 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:43:11.495229 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505ed5d5-78b2-4d83-966d-7ce748bc0915 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:43:11.529073 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d0f338-b8f2-45a8-889d-aaaa3b656708 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:43:11.529685 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d0f338-b8f2-45a8-889d-aaaa3b656708 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:43:11.529989 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d0f338-b8f2-45a8-889d-aaaa3b656708 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:43:11.530267 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d0f338-b8f2-45a8-889d-aaaa3b656708 None admin] PATH_INFO: `/v3/users` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:43:11.530984 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d0f338-b8f2-45a8-889d-aaaa3b656708 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:43:11.531284 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d0f338-b8f2-45a8-889d-aaaa3b656708 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:43:11.532701 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d0f338-b8f2-45a8-889d-aaaa3b656708 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:43:11.556248 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 514/1035] 10.222.0.57 () {56 vars in 1133 bytes} [Fri Sep 16 07:43:11 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:43:11.557489 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40da07be-d9f7-4810-bc6c-873681995d0d None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:43:11.583857 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d344db-39f4-44cc-a9c1-4fa6b916be71 None None] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:43:11.584040 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:43:11.584526 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d344db-39f4-44cc-a9c1-4fa6b916be71 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:43:11.585000 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d344db-39f4-44cc-a9c1-4fa6b916be71 None None] PATH_INFO: `/` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:43:11.586758 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 515/1036] 10.222.0.57 () {54 vars in 927 bytes} [Fri Sep 16 07:43:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 16 07:43:11.591974 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea4d905-055a-48c2-a3e6-72e407c269ac None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:43:11.592399 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea4d905-055a-48c2-a3e6-72e407c269ac None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:43:11.592678 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea4d905-055a-48c2-a3e6-72e407c269ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:43:11.611343 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-1ea4d905-055a-48c2-a3e6-72e407c269ac None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:43:11.612536 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-1ea4d905-055a-48c2-a3e6-72e407c269ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:43:11.664865 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40da07be-d9f7-4810-bc6c-873681995d0d None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:43:11.690025 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 516/1037] 10.222.0.57 () {58 vars in 1024 bytes} [Fri Sep 16 07:43:11 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 16 07:43:11.709873 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd54627e-e7ea-47c0-bdca-bb48a1a862da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:43:11.710516 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd54627e-e7ea-47c0-bdca-bb48a1a862da None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:43:11.710793 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd54627e-e7ea-47c0-bdca-bb48a1a862da None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:43:11.711063 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd54627e-e7ea-47c0-bdca-bb48a1a862da None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:43:11.780645 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd54627e-e7ea-47c0-bdca-bb48a1a862da None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:43:11.782115 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd54627e-e7ea-47c0-bdca-bb48a1a862da None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:43:11.806281 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:43:11.884777 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 522/1038] 10.222.0.57 () {58 vars in 1282 bytes} [Fri Sep 16 07:43:11 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 16 07:43:11.886109 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea4d905-055a-48c2-a3e6-72e407c269ac None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:43:11.935667 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:43:11.959161 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd54627e-e7ea-47c0-bdca-bb48a1a862da None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:43:11.987441 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea4d905-055a-48c2-a3e6-72e407c269ac None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:43:12.024014 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d044d8-65e9-4685-8206-8d955154e3a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:43:12.024985 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d044d8-65e9-4685-8206-8d955154e3a4 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:43:12.025481 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d044d8-65e9-4685-8206-8d955154e3a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:43:12.025771 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d044d8-65e9-4685-8206-8d955154e3a4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:43:12.035890 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d044d8-65e9-4685-8206-8d955154e3a4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:43:12.037330 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d044d8-65e9-4685-8206-8d955154e3a4 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:43:12.053598 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application [None req-98d044d8-65e9-4685-8206-8d955154e3a4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 07:43:12.053598 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 07:43:12.053598 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 07:43:12.053598 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 07:43:12.053598 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 07:43:12.053598 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 07:43:12.053598 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 07:43:12.053598 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 07:43:12.053598 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 07:43:12.053598 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 07:43:12.053598 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 07:43:12.053598 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 07:43:12.053598 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 07:43:12.053598 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 07:43:12.053598 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 07:43:12.053598 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 07:43:12.055672 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 07:43:12.055672 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 07:43:12.055672 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 07:43:12.055672 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 07:43:12.055672 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 07:43:12.055672 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 07:43:12.055672 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 07:43:12.055672 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application with Lock( Sep 16 07:43:12.055672 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 07:43:12.055672 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._enter() Sep 16 07:43:12.055672 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 07:43:12.055672 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 07:43:12.055672 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 07:43:12.055672 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.creator() Sep 16 07:43:12.055672 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 07:43:12.055672 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application created_value = creator( Sep 16 07:43:12.055672 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 07:43:12.056578 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 07:43:12.056578 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 07:43:12.056578 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Sep 16 07:43:12.056578 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 517/1039] 10.222.0.57 () {56 vars in 1108 bytes} [Fri Sep 16 07:43:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 16 07:43:12.060973 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d044d8-65e9-4685-8206-8d955154e3a4 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:43:12.067296 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd54627e-e7ea-47c0-bdca-bb48a1a862da None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:43:12.097102 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:43:12.113253 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5d0e01-fa0f-4cf3-a749-3a91d2c4af67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:43:12.113982 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5d0e01-fa0f-4cf3-a749-3a91d2c4af67 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:43:12.114270 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5d0e01-fa0f-4cf3-a749-3a91d2c4af67 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:43:12.114541 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5d0e01-fa0f-4cf3-a749-3a91d2c4af67 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:43:12.115655 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5d0e01-fa0f-4cf3-a749-3a91d2c4af67 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:43:12.117072 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5d0e01-fa0f-4cf3-a749-3a91d2c4af67 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:43:12.119560 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 523/1040] 10.222.0.57 () {56 vars in 1108 bytes} [Fri Sep 16 07:43:11 2022] GET /identity/v3/domains/default => generated 199 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 07:43:12.125037 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5d0e01-fa0f-4cf3-a749-3a91d2c4af67 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:43:12.172839 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d044d8-65e9-4685-8206-8d955154e3a4 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:43:12.174507 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:43:12.212618 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80db17c4-c652-4303-83b0-8e6468172c3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:43:12.213147 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80db17c4-c652-4303-83b0-8e6468172c3d None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:43:12.213533 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80db17c4-c652-4303-83b0-8e6468172c3d None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:43:12.213699 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80db17c4-c652-4303-83b0-8e6468172c3d None admin] PATH_INFO: `/v3/domains` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:43:12.214365 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80db17c4-c652-4303-83b0-8e6468172c3d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:43:12.214668 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80db17c4-c652-4303-83b0-8e6468172c3d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:43:12.216028 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80db17c4-c652-4303-83b0-8e6468172c3d None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:43:12.228270 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 518/1041] 10.222.0.57 () {56 vars in 1109 bytes} [Fri Sep 16 07:43:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 07:43:12.229088 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5d0e01-fa0f-4cf3-a749-3a91d2c4af67 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:43:12.233787 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80db17c4-c652-4303-83b0-8e6468172c3d None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:43:12.264553 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505fbbca-5dd9-4697-a307-2adc77347321 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:43:12.265151 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505fbbca-5dd9-4697-a307-2adc77347321 None admin] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:43:12.265429 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505fbbca-5dd9-4697-a307-2adc77347321 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:43:12.265695 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505fbbca-5dd9-4697-a307-2adc77347321 None admin] PATH_INFO: `/v3/users` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:43:12.266358 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505fbbca-5dd9-4697-a307-2adc77347321 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:43:12.267761 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505fbbca-5dd9-4697-a307-2adc77347321 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:43:12.291465 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 524/1042] 10.222.0.57 () {60 vars in 1132 bytes} [Fri Sep 16 07:43:12 2022] POST /identity/v3/users => generated 285 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 16 07:43:12.344102 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80db17c4-c652-4303-83b0-8e6468172c3d None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:43:12.382044 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181ca780-e87c-41f5-b3ff-9ce9a1f18b38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:43:12.382696 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181ca780-e87c-41f5-b3ff-9ce9a1f18b38 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:43:12.383492 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181ca780-e87c-41f5-b3ff-9ce9a1f18b38 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:43:12.383771 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181ca780-e87c-41f5-b3ff-9ce9a1f18b38 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:43:12.391717 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181ca780-e87c-41f5-b3ff-9ce9a1f18b38 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:43:12.393179 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181ca780-e87c-41f5-b3ff-9ce9a1f18b38 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:43:12.405771 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application [None req-181ca780-e87c-41f5-b3ff-9ce9a1f18b38 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 07:43:12.405771 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 07:43:12.405771 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 07:43:12.405771 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 07:43:12.405771 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 07:43:12.405771 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 07:43:12.405771 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 07:43:12.405771 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 07:43:12.405771 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 07:43:12.405771 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 07:43:12.405771 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 07:43:12.405771 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 07:43:12.405771 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 16 07:43:12.405771 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 16 07:43:12.405771 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 16 07:43:12.406785 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 16 07:43:12.406785 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 07:43:12.406785 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 07:43:12.406785 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 07:43:12.406785 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 07:43:12.406785 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 07:43:12.406785 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 07:43:12.406785 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 07:43:12.406785 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application with Lock( Sep 16 07:43:12.406785 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 07:43:12.406785 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._enter() Sep 16 07:43:12.406785 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 07:43:12.406785 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 07:43:12.406785 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 07:43:12.406785 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.creator() Sep 16 07:43:12.406785 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 07:43:12.406785 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application created_value = creator( Sep 16 07:43:12.412717 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 16 07:43:12.412717 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 16 07:43:12.412717 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 16 07:43:12.412717 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 16 07:43:12.412717 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 16 07:43:12.412717 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 16 07:43:12.412717 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 07:43:12.412717 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Sep 16 07:43:12.412717 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 519/1043] 10.222.0.57 () {56 vars in 1111 bytes} [Fri Sep 16 07:43:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 16 07:43:12.415509 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505fbbca-5dd9-4697-a307-2adc77347321 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:43:12.472454 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:43:12.532650 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505fbbca-5dd9-4697-a307-2adc77347321 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:43:12.569631 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ec25dd-39d5-449e-8576-6e4a29631c7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:43:12.570262 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ec25dd-39d5-449e-8576-6e4a29631c7e None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:43:12.570566 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ec25dd-39d5-449e-8576-6e4a29631c7e None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:43:12.570837 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ec25dd-39d5-449e-8576-6e4a29631c7e None admin] PATH_INFO: `/v3/projects` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:43:12.571633 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ec25dd-39d5-449e-8576-6e4a29631c7e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:43:12.571934 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ec25dd-39d5-449e-8576-6e4a29631c7e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:43:12.573345 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ec25dd-39d5-449e-8576-6e4a29631c7e None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:43:12.587643 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 525/1044] 10.222.0.57 () {56 vars in 1148 bytes} [Fri Sep 16 07:43:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:43:12.593807 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181ca780-e87c-41f5-b3ff-9ce9a1f18b38 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:43:12.617502 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:43:12.698872 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181ca780-e87c-41f5-b3ff-9ce9a1f18b38 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:43:12.734158 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504ed247-adb5-41df-bfaf-07ddc4c3d09e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:43:12.734691 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504ed247-adb5-41df-bfaf-07ddc4c3d09e None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:43:12.734970 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504ed247-adb5-41df-bfaf-07ddc4c3d09e None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:43:12.735245 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504ed247-adb5-41df-bfaf-07ddc4c3d09e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:43:12.735963 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504ed247-adb5-41df-bfaf-07ddc4c3d09e None admin] RBAC: Adding query filter params (role.id=0f6db070ff104938a2112f6d80494dab, scope.project.id=4735f453c0c24cc4a1c14e9ac84a0b46, user.id=9bec4d9b08514461a1bf63c6b88f53b2) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:43:12.736273 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504ed247-adb5-41df-bfaf-07ddc4c3d09e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:43:12.737699 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504ed247-adb5-41df-bfaf-07ddc4c3d09e None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:43:12.743677 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 520/1045] 10.222.0.57 () {56 vars in 1374 bytes} [Fri Sep 16 07:43:12 2022] GET /identity/v3/role_assignments?user.id=9bec4d9b08514461a1bf63c6b88f53b2&scope.project.id=4735f453c0c24cc4a1c14e9ac84a0b46&role.id=0f6db070ff104938a2112f6d80494dab => generated 259 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:43:13.000730 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2500e61b-263c-4bdc-9211-eecb48838528 None None] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:43:13.000903 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2500e61b-263c-4bdc-9211-eecb48838528 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:43:13.001181 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2500e61b-263c-4bdc-9211-eecb48838528 None None] PATH_INFO: `/` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:43:13.002573 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 526/1046] 10.222.0.57 () {54 vars in 927 bytes} [Fri Sep 16 07:43:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 07:43:13.008557 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b30595-54cf-4f8b-9ab0-2f305278b7e7 None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:43:13.008935 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b30595-54cf-4f8b-9ab0-2f305278b7e7 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:43:13.009206 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b30595-54cf-4f8b-9ab0-2f305278b7e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:43:13.028084 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-c0b30595-54cf-4f8b-9ab0-2f305278b7e7 None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:43:13.029255 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-c0b30595-54cf-4f8b-9ab0-2f305278b7e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:43:13.103047 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 521/1047] 10.222.0.57 () {58 vars in 1024 bytes} [Fri Sep 16 07:43:13 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 16 07:43:13.370082 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2500e61b-263c-4bdc-9211-eecb48838528 None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:43:13.471014 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2500e61b-263c-4bdc-9211-eecb48838528 None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:43:13.481001 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:43:13.506755 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f00d19-101a-4254-a8e5-26b080ebb7ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:43:13.507383 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f00d19-101a-4254-a8e5-26b080ebb7ab None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:43:13.507656 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f00d19-101a-4254-a8e5-26b080ebb7ab None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:43:13.507978 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f00d19-101a-4254-a8e5-26b080ebb7ab None admin] PATH_INFO: `/v3/services/image` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:43:13.508562 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f00d19-101a-4254-a8e5-26b080ebb7ab None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:43:13.509935 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f00d19-101a-4254-a8e5-26b080ebb7ab None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:43:13.518593 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application [None req-d7f00d19-101a-4254-a8e5-26b080ebb7ab None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 16 07:43:13.518593 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 07:43:13.518593 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 16 07:43:13.518593 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 16 07:43:13.518593 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 16 07:43:13.518593 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 16 07:43:13.518593 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 16 07:43:13.518593 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 16 07:43:13.518593 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 16 07:43:13.518593 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Sep 16 07:43:13.518593 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 16 07:43:13.518593 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Sep 16 07:43:13.518593 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 07:43:13.518593 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 07:43:13.518593 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 07:43:13.518593 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 07:43:13.518593 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 07:43:13.519569 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 07:43:13.519569 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 07:43:13.519569 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 07:43:13.519569 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 07:43:13.519569 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 07:43:13.519569 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 07:43:13.519569 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 16 07:43:13.519569 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 16 07:43:13.519569 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 16 07:43:13.519569 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 16 07:43:13.519569 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 07:43:13.519569 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 07:43:13.519569 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 07:43:13.519569 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 07:43:13.519569 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 07:43:13.519569 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 07:43:13.520436 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 07:43:13.520436 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application with Lock( Sep 16 07:43:13.520436 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 07:43:13.520436 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._enter() Sep 16 07:43:13.520436 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 07:43:13.520436 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 07:43:13.520436 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 07:43:13.520436 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.creator() Sep 16 07:43:13.520436 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 07:43:13.520436 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application created_value = creator( Sep 16 07:43:13.520436 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 16 07:43:13.520436 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 16 07:43:13.520436 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 16 07:43:13.520436 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Sep 16 07:43:13.522051 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 527/1048] 10.222.0.57 () {56 vars in 1105 bytes} [Fri Sep 16 07:43:13 2022] GET /identity/v3/services/image => generated 86 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 07:43:13.526074 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b30595-54cf-4f8b-9ab0-2f305278b7e7 None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:43:13.541841 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:43:13.630052 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b30595-54cf-4f8b-9ab0-2f305278b7e7 None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:43:13.665357 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8f3300-72b4-4eb2-bd80-dcbab1260db7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:43:13.665993 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8f3300-72b4-4eb2-bd80-dcbab1260db7 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:43:13.666271 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8f3300-72b4-4eb2-bd80-dcbab1260db7 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:43:13.666541 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8f3300-72b4-4eb2-bd80-dcbab1260db7 None admin] PATH_INFO: `/v3/services` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:43:13.667154 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8f3300-72b4-4eb2-bd80-dcbab1260db7 None admin] RBAC: Adding query filter params (name=image) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:43:13.667450 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8f3300-72b4-4eb2-bd80-dcbab1260db7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:43:13.668813 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8f3300-72b4-4eb2-bd80-dcbab1260db7 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:43:13.678172 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 522/1049] 10.222.0.57 () {56 vars in 1108 bytes} [Fri Sep 16 07:43:13 2022] GET /identity/v3/services?name=image => generated 122 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:43:13.679394 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f00d19-101a-4254-a8e5-26b080ebb7ab None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:43:13.780966 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f00d19-101a-4254-a8e5-26b080ebb7ab None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:43:13.813527 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d744d990-77ed-4066-be5d-b9fc4e893faa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:43:13.814228 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d744d990-77ed-4066-be5d-b9fc4e893faa None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:43:13.814576 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d744d990-77ed-4066-be5d-b9fc4e893faa None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:43:13.814916 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d744d990-77ed-4066-be5d-b9fc4e893faa None admin] PATH_INFO: `/v3/services` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:43:13.815606 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d744d990-77ed-4066-be5d-b9fc4e893faa None admin] RBAC: Adding query filter params (type=image) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:43:13.815980 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d744d990-77ed-4066-be5d-b9fc4e893faa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:43:13.817397 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d744d990-77ed-4066-be5d-b9fc4e893faa None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:43:13.827429 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 528/1050] 10.222.0.57 () {56 vars in 1108 bytes} [Fri Sep 16 07:43:13 2022] GET /identity/v3/services?type=image => generated 350 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:43:13.828791 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8f3300-72b4-4eb2-bd80-dcbab1260db7 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:43:13.909051 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:43:13.931891 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8f3300-72b4-4eb2-bd80-dcbab1260db7 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:43:13.969541 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991d59fc-85c3-4399-ad98-895eb80b65e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:43:13.970271 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991d59fc-85c3-4399-ad98-895eb80b65e9 None admin] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:43:13.970616 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991d59fc-85c3-4399-ad98-895eb80b65e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:43:13.971006 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991d59fc-85c3-4399-ad98-895eb80b65e9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:43:13.971811 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991d59fc-85c3-4399-ad98-895eb80b65e9 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:43:13.973224 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991d59fc-85c3-4399-ad98-895eb80b65e9 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:43:13.997994 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 523/1051] 10.222.0.57 () {60 vars in 1144 bytes} [Fri Sep 16 07:43:13 2022] POST /identity/v3/endpoints => generated 327 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 16 07:43:14.542281 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a236a2e8-f8fd-47ae-bffa-e684addc1dfe None None] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:43:14.542807 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a236a2e8-f8fd-47ae-bffa-e684addc1dfe None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:43:14.542807 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a236a2e8-f8fd-47ae-bffa-e684addc1dfe None None] PATH_INFO: `/` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:43:14.544175 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 529/1052] 10.222.0.57 () {54 vars in 927 bytes} [Fri Sep 16 07:43:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 07:43:14.549328 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339388fe-1862-4752-84e9-8029069f30fa None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:43:14.549757 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339388fe-1862-4752-84e9-8029069f30fa None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:43:14.549945 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339388fe-1862-4752-84e9-8029069f30fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:43:14.569649 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-339388fe-1862-4752-84e9-8029069f30fa None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:43:14.570988 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-339388fe-1862-4752-84e9-8029069f30fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:43:14.647464 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 524/1053] 10.222.0.57 () {58 vars in 1024 bytes} [Fri Sep 16 07:43:14 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 16 07:43:14.909185 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0892fffe-c740-4447-a72a-5e006a835712 None None] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:43:14.909548 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0892fffe-c740-4447-a72a-5e006a835712 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:43:14.909773 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0892fffe-c740-4447-a72a-5e006a835712 None None] PATH_INFO: `/` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:43:14.911236 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 530/1054] 10.222.0.57 () {54 vars in 927 bytes} [Fri Sep 16 07:43:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 07:43:14.916993 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0892fffe-c740-4447-a72a-5e006a835712 None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:43:14.917126 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979051c3-24e8-4033-8faf-53cadddecdbf None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:43:14.917303 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979051c3-24e8-4033-8faf-53cadddecdbf None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:43:14.917555 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979051c3-24e8-4033-8faf-53cadddecdbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:43:14.935509 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-979051c3-24e8-4033-8faf-53cadddecdbf None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:43:14.936703 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-979051c3-24e8-4033-8faf-53cadddecdbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:43:14.953591 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:43:14.994685 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:43:15.008661 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 525/1055] 10.222.0.57 () {58 vars in 1024 bytes} [Fri Sep 16 07:43:14 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 16 07:43:15.025223 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0892fffe-c740-4447-a72a-5e006a835712 None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:43:15.058507 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a6ef03-4fbb-42b6-b683-20f5871ef009 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:43:15.059126 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a6ef03-4fbb-42b6-b683-20f5871ef009 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:43:15.059404 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a6ef03-4fbb-42b6-b683-20f5871ef009 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:43:15.059676 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a6ef03-4fbb-42b6-b683-20f5871ef009 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:43:15.069999 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a6ef03-4fbb-42b6-b683-20f5871ef009 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 07:43:15.075109 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application [None req-e8a6ef03-4fbb-42b6-b683-20f5871ef009 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 16 07:43:15.075109 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 07:43:15.075109 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 07:43:15.075109 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 07:43:15.075109 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 07:43:15.075109 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 07:43:15.075109 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 07:43:15.075109 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 07:43:15.075109 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 07:43:15.075109 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 07:43:15.075109 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 07:43:15.075109 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 07:43:15.075109 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 07:43:15.075109 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 07:43:15.075109 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 07:43:15.075109 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 07:43:15.076137 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 07:43:15.076137 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 07:43:15.076137 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 07:43:15.076137 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 07:43:15.076137 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 07:43:15.076137 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 07:43:15.076137 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 07:43:15.076137 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 07:43:15.076137 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 07:43:15.076137 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 07:43:15.076137 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 07:43:15.076137 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application with Lock( Sep 16 07:43:15.076137 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 07:43:15.076137 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._enter() Sep 16 07:43:15.076137 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 07:43:15.076137 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 07:43:15.077045 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 07:43:15.077045 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.creator() Sep 16 07:43:15.077045 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 07:43:15.077045 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application created_value = creator( Sep 16 07:43:15.077045 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 07:43:15.077045 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 07:43:15.077045 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 07:43:15.077045 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 07:43:15.077045 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 07:43:15.077045 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 07:43:15.077045 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 16 07:43:15.077045 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Sep 16 07:43:15.084463 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 531/1056] 10.222.0.57 () {56 vars in 1096 bytes} [Fri Sep 16 07:43:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 07:43:15.084615 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979051c3-24e8-4033-8faf-53cadddecdbf None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:43:15.186809 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979051c3-24e8-4033-8faf-53cadddecdbf None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:43:15.221193 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3241e215-e36f-4fc7-9621-1cb6536ff527 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:43:15.221830 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3241e215-e36f-4fc7-9621-1cb6536ff527 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:43:15.222116 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3241e215-e36f-4fc7-9621-1cb6536ff527 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:43:15.222390 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3241e215-e36f-4fc7-9621-1cb6536ff527 None admin] PATH_INFO: `/v3/roles` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:43:15.223041 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3241e215-e36f-4fc7-9621-1cb6536ff527 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:43:15.223345 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3241e215-e36f-4fc7-9621-1cb6536ff527 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:43:15.224712 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3241e215-e36f-4fc7-9621-1cb6536ff527 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:43:15.233128 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 526/1057] 10.222.0.57 () {56 vars in 1099 bytes} [Fri Sep 16 07:43:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 07:43:15.238816 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a6ef03-4fbb-42b6-b683-20f5871ef009 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:43:15.280787 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3241e215-e36f-4fc7-9621-1cb6536ff527 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:43:15.338148 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:43:15.344561 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:43:15.351612 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a6ef03-4fbb-42b6-b683-20f5871ef009 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:43:15.390310 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e86333-423e-4e6b-8069-5d5e9f8ce67f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:43:15.390937 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e86333-423e-4e6b-8069-5d5e9f8ce67f None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:43:15.391220 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e86333-423e-4e6b-8069-5d5e9f8ce67f None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:43:15.391575 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e86333-423e-4e6b-8069-5d5e9f8ce67f None admin] PATH_INFO: `/v3/users/544e2b736ede4ecda1652bcfd9e9b6b9` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:43:15.393536 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3241e215-e36f-4fc7-9621-1cb6536ff527 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:43:15.405576 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e86333-423e-4e6b-8069-5d5e9f8ce67f None admin] RBAC: Authorizing `identity:get_user(user_id=544e2b736ede4ecda1652bcfd9e9b6b9)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:43:15.407052 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e86333-423e-4e6b-8069-5d5e9f8ce67f None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:43:15.413431 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 532/1058] 10.222.0.57 () {56 vars in 1177 bytes} [Fri Sep 16 07:43:15 2022] GET /identity/v3/users/544e2b736ede4ecda1652bcfd9e9b6b9 => generated 285 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:43:15.415262 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e86333-423e-4e6b-8069-5d5e9f8ce67f None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:43:15.434336 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482c3d79-e9ef-4cb6-a3a7-691b69a9185a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:43:15.434989 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482c3d79-e9ef-4cb6-a3a7-691b69a9185a None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:43:15.435248 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482c3d79-e9ef-4cb6-a3a7-691b69a9185a None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:43:15.435519 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482c3d79-e9ef-4cb6-a3a7-691b69a9185a None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:43:15.446423 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482c3d79-e9ef-4cb6-a3a7-691b69a9185a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 07:43:15.451564 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application [None req-482c3d79-e9ef-4cb6-a3a7-691b69a9185a None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 16 07:43:15.451564 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 07:43:15.451564 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 07:43:15.451564 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 07:43:15.451564 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 07:43:15.451564 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 07:43:15.451564 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 07:43:15.451564 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 07:43:15.451564 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 07:43:15.451564 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 07:43:15.451564 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 07:43:15.451564 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 07:43:15.451564 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 07:43:15.451564 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 07:43:15.451564 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 07:43:15.451564 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 07:43:15.452485 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 07:43:15.452485 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 07:43:15.452485 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 07:43:15.452485 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 07:43:15.452485 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 07:43:15.452485 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 07:43:15.452485 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 07:43:15.452485 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 07:43:15.452485 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 07:43:15.452485 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 07:43:15.452485 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 07:43:15.452485 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application with Lock( Sep 16 07:43:15.452485 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 07:43:15.452485 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._enter() Sep 16 07:43:15.452485 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 07:43:15.452485 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 07:43:15.453355 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 07:43:15.453355 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.creator() Sep 16 07:43:15.453355 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 07:43:15.453355 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application created_value = creator( Sep 16 07:43:15.453355 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 07:43:15.453355 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 07:43:15.453355 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 07:43:15.453355 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 07:43:15.453355 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 07:43:15.453355 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 07:43:15.453355 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 16 07:43:15.453355 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Sep 16 07:43:15.453355 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 527/1059] 10.222.0.57 () {56 vars in 1120 bytes} [Fri Sep 16 07:43:15 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 16 07:43:15.458554 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482c3d79-e9ef-4cb6-a3a7-691b69a9185a None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:43:15.524744 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e86333-423e-4e6b-8069-5d5e9f8ce67f None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:43:15.561392 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94762248-bb31-4093-a24b-b6cfdf7ba534 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:43:15.562052 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482c3d79-e9ef-4cb6-a3a7-691b69a9185a None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:43:15.562402 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94762248-bb31-4093-a24b-b6cfdf7ba534 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:43:15.562402 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94762248-bb31-4093-a24b-b6cfdf7ba534 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:43:15.562573 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94762248-bb31-4093-a24b-b6cfdf7ba534 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:43:15.575857 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:43:15.589230 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:43:15.600169 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb19dbb-cb01-4c82-a5b8-8e7e2d457ff7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:43:15.601297 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb19dbb-cb01-4c82-a5b8-8e7e2d457ff7 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:43:15.601297 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb19dbb-cb01-4c82-a5b8-8e7e2d457ff7 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:43:15.601297 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb19dbb-cb01-4c82-a5b8-8e7e2d457ff7 None admin] PATH_INFO: `/v3/roles` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:43:15.601984 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb19dbb-cb01-4c82-a5b8-8e7e2d457ff7 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:43:15.602283 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb19dbb-cb01-4c82-a5b8-8e7e2d457ff7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:43:15.603641 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb19dbb-cb01-4c82-a5b8-8e7e2d457ff7 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:43:15.612098 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 528/1060] 10.222.0.57 () {56 vars in 1115 bytes} [Fri Sep 16 07:43:15 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 07:43:15.618777 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb19dbb-cb01-4c82-a5b8-8e7e2d457ff7 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:43:15.641998 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94762248-bb31-4093-a24b-b6cfdf7ba534 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:43:15.643761 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94762248-bb31-4093-a24b-b6cfdf7ba534 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:43:15.747018 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb19dbb-cb01-4c82-a5b8-8e7e2d457ff7 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:43:15.762917 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 533/1061] 10.222.0.57 () {58 vars in 1282 bytes} [Fri Sep 16 07:43:15 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 16 07:43:15.768843 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94762248-bb31-4093-a24b-b6cfdf7ba534 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:43:15.784689 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8895e68f-b3b6-439a-b99c-24913a44d0af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:43:15.785355 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8895e68f-b3b6-439a-b99c-24913a44d0af None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:43:15.785586 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8895e68f-b3b6-439a-b99c-24913a44d0af None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:43:15.785883 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8895e68f-b3b6-439a-b99c-24913a44d0af None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:43:15.797856 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8895e68f-b3b6-439a-b99c-24913a44d0af None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:43:15.799216 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8895e68f-b3b6-439a-b99c-24913a44d0af None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:43:15.814211 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application [None req-8895e68f-b3b6-439a-b99c-24913a44d0af None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 07:43:15.814211 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 07:43:15.814211 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 07:43:15.814211 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 07:43:15.814211 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 07:43:15.814211 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 07:43:15.814211 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 07:43:15.814211 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 07:43:15.814211 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 07:43:15.814211 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 07:43:15.814211 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 07:43:15.814211 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 07:43:15.814211 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 07:43:15.814211 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 07:43:15.814211 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 07:43:15.814211 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 07:43:15.815251 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 07:43:15.815251 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 07:43:15.815251 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 07:43:15.815251 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 07:43:15.815251 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 07:43:15.815251 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 07:43:15.815251 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 07:43:15.815251 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application with Lock( Sep 16 07:43:15.815251 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 07:43:15.815251 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._enter() Sep 16 07:43:15.815251 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 07:43:15.815251 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 07:43:15.815251 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 07:43:15.815251 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.creator() Sep 16 07:43:15.815251 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 07:43:15.815251 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application created_value = creator( Sep 16 07:43:15.815251 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 07:43:15.816159 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 07:43:15.816159 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 07:43:15.816159 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Sep 16 07:43:15.816159 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 529/1062] 10.222.0.57 () {56 vars in 1108 bytes} [Fri Sep 16 07:43:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 16 07:43:15.821823 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8895e68f-b3b6-439a-b99c-24913a44d0af None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:43:15.829062 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:43:15.851990 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:43:15.876940 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94762248-bb31-4093-a24b-b6cfdf7ba534 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:43:15.914521 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bf0430-fe58-4cda-9c17-88975efd3092 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:43:15.915228 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bf0430-fe58-4cda-9c17-88975efd3092 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:43:15.915505 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bf0430-fe58-4cda-9c17-88975efd3092 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:43:15.915777 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bf0430-fe58-4cda-9c17-88975efd3092 None admin] PATH_INFO: `/v3/projects/51ee3784f4c5484ebf6953539855bc83` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:43:15.916952 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12bf0430-fe58-4cda-9c17-88975efd3092 None admin] RBAC: Authorizing `identity:get_project(project_id=51ee3784f4c5484ebf6953539855bc83)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:43:15.918646 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12bf0430-fe58-4cda-9c17-88975efd3092 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:43:15.925345 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 534/1063] 10.222.0.57 () {56 vars in 1186 bytes} [Fri Sep 16 07:43:15 2022] GET /identity/v3/projects/51ee3784f4c5484ebf6953539855bc83 => generated 311 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 07:43:15.926984 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bf0430-fe58-4cda-9c17-88975efd3092 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:43:15.931901 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8895e68f-b3b6-439a-b99c-24913a44d0af None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:43:15.969737 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6507dd-ffeb-4541-aaa7-6647bfa32fe6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:43:15.970746 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6507dd-ffeb-4541-aaa7-6647bfa32fe6 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:43:15.971114 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6507dd-ffeb-4541-aaa7-6647bfa32fe6 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:43:15.971488 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6507dd-ffeb-4541-aaa7-6647bfa32fe6 None admin] PATH_INFO: `/v3/domains` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:43:15.972436 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6507dd-ffeb-4541-aaa7-6647bfa32fe6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:43:15.973005 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6507dd-ffeb-4541-aaa7-6647bfa32fe6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:43:15.974667 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6507dd-ffeb-4541-aaa7-6647bfa32fe6 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:43:15.988023 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 530/1064] 10.222.0.57 () {56 vars in 1109 bytes} [Fri Sep 16 07:43:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 07:43:15.994430 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6507dd-ffeb-4541-aaa7-6647bfa32fe6 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:43:16.034434 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bf0430-fe58-4cda-9c17-88975efd3092 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:43:16.060178 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:43:16.073385 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7729741e-8315-4364-b82e-984811bc3d0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:43:16.074149 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7729741e-8315-4364-b82e-984811bc3d0b None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:43:16.074426 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7729741e-8315-4364-b82e-984811bc3d0b None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:43:16.074692 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7729741e-8315-4364-b82e-984811bc3d0b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:43:16.075443 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7729741e-8315-4364-b82e-984811bc3d0b None admin] RBAC: Adding query filter params (role.id=567db03c91854ad9af1e9a87ec1bd275, scope.project.id=51ee3784f4c5484ebf6953539855bc83, user.id=544e2b736ede4ecda1652bcfd9e9b6b9) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:43:16.075750 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7729741e-8315-4364-b82e-984811bc3d0b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:43:16.077229 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7729741e-8315-4364-b82e-984811bc3d0b None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:43:16.097755 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 535/1065] 10.222.0.57 () {56 vars in 1374 bytes} [Fri Sep 16 07:43:15 2022] GET /identity/v3/role_assignments?user.id=544e2b736ede4ecda1652bcfd9e9b6b9&scope.project.id=51ee3784f4c5484ebf6953539855bc83&role.id=567db03c91854ad9af1e9a87ec1bd275 => generated 259 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 07:43:16.098014 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:43:16.121431 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6507dd-ffeb-4541-aaa7-6647bfa32fe6 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:43:16.159958 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580fb452-6766-4d08-9a50-e6c6022a80d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:43:16.160606 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580fb452-6766-4d08-9a50-e6c6022a80d1 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:43:16.160879 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580fb452-6766-4d08-9a50-e6c6022a80d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:43:16.161144 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580fb452-6766-4d08-9a50-e6c6022a80d1 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:43:16.170026 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580fb452-6766-4d08-9a50-e6c6022a80d1 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:43:16.171504 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580fb452-6766-4d08-9a50-e6c6022a80d1 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:43:16.185973 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application [None req-580fb452-6766-4d08-9a50-e6c6022a80d1 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 16 07:43:16.185973 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 07:43:16.185973 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 07:43:16.185973 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 07:43:16.185973 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 07:43:16.185973 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 07:43:16.185973 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 07:43:16.185973 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 07:43:16.185973 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 07:43:16.185973 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 07:43:16.185973 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 07:43:16.185973 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 07:43:16.185973 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 16 07:43:16.185973 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 16 07:43:16.185973 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 16 07:43:16.185973 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 16 07:43:16.187027 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 07:43:16.187027 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 07:43:16.187027 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 16 07:43:16.187027 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 07:43:16.187027 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 16 07:43:16.187027 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 07:43:16.187027 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 07:43:16.187027 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 07:43:16.187027 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 07:43:16.187027 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 07:43:16.187027 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 07:43:16.187027 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application with Lock( Sep 16 07:43:16.187027 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 07:43:16.187027 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._enter() Sep 16 07:43:16.187027 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 07:43:16.187027 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 07:43:16.187027 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 07:43:16.187027 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.creator() Sep 16 07:43:16.192927 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 07:43:16.192927 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application created_value = creator( Sep 16 07:43:16.192927 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 16 07:43:16.192927 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 16 07:43:16.192927 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 16 07:43:16.192927 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 16 07:43:16.192927 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 16 07:43:16.192927 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 16 07:43:16.192927 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 16 07:43:16.192927 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Sep 16 07:43:16.192927 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 531/1066] 10.222.0.57 () {56 vars in 1093 bytes} [Fri Sep 16 07:43:15 2022] GET /identity/v3/users/nova => generated 82 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 16 07:43:16.194110 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7729741e-8315-4364-b82e-984811bc3d0b None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:43:16.205038 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d9a9bf-6dd4-4755-b7eb-06d511b386fc None None] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:43:16.205328 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d9a9bf-6dd4-4755-b7eb-06d511b386fc None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:43:16.205599 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d9a9bf-6dd4-4755-b7eb-06d511b386fc None None] PATH_INFO: `/` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:43:16.207054 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 532/1067] 10.222.0.57 () {54 vars in 927 bytes} [Fri Sep 16 07:43:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 16 07:43:16.212760 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db7b61e-06ed-445e-bbe5-452366b35011 None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:43:16.213034 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db7b61e-06ed-445e-bbe5-452366b35011 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:43:16.213309 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db7b61e-06ed-445e-bbe5-452366b35011 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:43:16.232406 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-2db7b61e-06ed-445e-bbe5-452366b35011 None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:43:16.233642 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-2db7b61e-06ed-445e-bbe5-452366b35011 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:43:16.309074 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7729741e-8315-4364-b82e-984811bc3d0b None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:43:16.317828 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 533/1068] 10.222.0.57 () {58 vars in 1024 bytes} [Fri Sep 16 07:43:16 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 16 07:43:16.344697 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29566bfc-8199-4ce1-bf66-4f3a17152c9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:43:16.345310 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29566bfc-8199-4ce1-bf66-4f3a17152c9d None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:43:16.345588 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29566bfc-8199-4ce1-bf66-4f3a17152c9d None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:43:16.345909 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29566bfc-8199-4ce1-bf66-4f3a17152c9d None admin] PATH_INFO: `/v3/users` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:43:16.346641 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29566bfc-8199-4ce1-bf66-4f3a17152c9d None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:43:16.346945 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29566bfc-8199-4ce1-bf66-4f3a17152c9d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:43:16.348364 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29566bfc-8199-4ce1-bf66-4f3a17152c9d None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:43:16.366926 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 536/1069] 10.222.0.57 () {56 vars in 1133 bytes} [Fri Sep 16 07:43:16 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:43:16.372603 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db7b61e-06ed-445e-bbe5-452366b35011 None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:43:16.450587 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:43:16.474499 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db7b61e-06ed-445e-bbe5-452366b35011 None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:43:16.509837 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5b4138-ef02-454d-9782-4fa5c3ecaea1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:43:16.510471 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5b4138-ef02-454d-9782-4fa5c3ecaea1 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:43:16.510753 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5b4138-ef02-454d-9782-4fa5c3ecaea1 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:43:16.511026 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5b4138-ef02-454d-9782-4fa5c3ecaea1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:43:16.522460 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5b4138-ef02-454d-9782-4fa5c3ecaea1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:43:16.524442 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5b4138-ef02-454d-9782-4fa5c3ecaea1 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:43:16.539969 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application [None req-9b5b4138-ef02-454d-9782-4fa5c3ecaea1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 07:43:16.539969 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 07:43:16.539969 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 07:43:16.539969 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 07:43:16.539969 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 07:43:16.539969 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 07:43:16.539969 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 07:43:16.539969 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 07:43:16.539969 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 07:43:16.539969 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 07:43:16.539969 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 07:43:16.539969 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 07:43:16.539969 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 07:43:16.539969 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 07:43:16.539969 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 07:43:16.539969 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 07:43:16.540955 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 07:43:16.540955 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 07:43:16.540955 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 07:43:16.540955 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 07:43:16.540955 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 07:43:16.540955 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 07:43:16.540955 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 07:43:16.540955 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application with Lock( Sep 16 07:43:16.540955 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 07:43:16.540955 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._enter() Sep 16 07:43:16.540955 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 07:43:16.540955 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 07:43:16.540955 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 07:43:16.540955 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.creator() Sep 16 07:43:16.540955 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 07:43:16.540955 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application created_value = creator( Sep 16 07:43:16.540955 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 07:43:16.541870 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 07:43:16.541870 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 07:43:16.541870 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Sep 16 07:43:16.541870 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 534/1070] 10.222.0.57 () {56 vars in 1108 bytes} [Fri Sep 16 07:43:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 07:43:16.546919 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29566bfc-8199-4ce1-bf66-4f3a17152c9d None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:43:16.596551 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:43:16.610036 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5b4138-ef02-454d-9782-4fa5c3ecaea1 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:43:16.655908 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29566bfc-8199-4ce1-bf66-4f3a17152c9d None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:43:16.690578 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89f33ba-4b23-484f-9760-2c1887567518 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:43:16.691180 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89f33ba-4b23-484f-9760-2c1887567518 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:43:16.691462 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89f33ba-4b23-484f-9760-2c1887567518 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:43:16.691737 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89f33ba-4b23-484f-9760-2c1887567518 None admin] PATH_INFO: `/v3/domains` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:43:16.692377 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89f33ba-4b23-484f-9760-2c1887567518 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:43:16.692684 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89f33ba-4b23-484f-9760-2c1887567518 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:43:16.694068 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89f33ba-4b23-484f-9760-2c1887567518 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:43:16.706431 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 537/1071] 10.222.0.57 () {56 vars in 1109 bytes} [Fri Sep 16 07:43:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:43:16.712559 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89f33ba-4b23-484f-9760-2c1887567518 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:43:16.715441 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5b4138-ef02-454d-9782-4fa5c3ecaea1 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:43:16.749446 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:43:16.761070 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43084597-c018-4c07-ac5b-b35504ece75b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:43:16.761805 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43084597-c018-4c07-ac5b-b35504ece75b None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:43:16.762083 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43084597-c018-4c07-ac5b-b35504ece75b None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:43:16.762353 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43084597-c018-4c07-ac5b-b35504ece75b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:43:16.817702 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89f33ba-4b23-484f-9760-2c1887567518 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:43:16.820033 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:43:16.838461 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43084597-c018-4c07-ac5b-b35504ece75b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:43:16.840395 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43084597-c018-4c07-ac5b-b35504ece75b None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:43:16.854176 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facf4e6c-465f-4398-9847-b59fbec688fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:43:16.854802 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facf4e6c-465f-4398-9847-b59fbec688fd None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:43:16.855310 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facf4e6c-465f-4398-9847-b59fbec688fd None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:43:16.855310 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facf4e6c-465f-4398-9847-b59fbec688fd None admin] PATH_INFO: `/v3/projects/service` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:43:16.862546 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-facf4e6c-465f-4398-9847-b59fbec688fd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:43:16.863967 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-facf4e6c-465f-4398-9847-b59fbec688fd None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:43:16.875474 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application [None req-facf4e6c-465f-4398-9847-b59fbec688fd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 07:43:16.875474 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 07:43:16.875474 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 07:43:16.875474 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 07:43:16.875474 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 07:43:16.875474 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 07:43:16.875474 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 07:43:16.875474 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 07:43:16.875474 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 07:43:16.875474 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 07:43:16.875474 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 07:43:16.875474 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 07:43:16.875474 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 16 07:43:16.875474 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 16 07:43:16.875474 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 16 07:43:16.876424 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 16 07:43:16.876424 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 07:43:16.876424 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 07:43:16.876424 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 07:43:16.876424 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 07:43:16.876424 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 07:43:16.876424 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 07:43:16.876424 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 07:43:16.876424 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application with Lock( Sep 16 07:43:16.876424 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 07:43:16.876424 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._enter() Sep 16 07:43:16.876424 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 07:43:16.876424 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 07:43:16.876424 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 07:43:16.876424 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.creator() Sep 16 07:43:16.876424 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 07:43:16.876424 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application created_value = creator( Sep 16 07:43:16.877380 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 16 07:43:16.877380 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 16 07:43:16.877380 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 16 07:43:16.877380 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 16 07:43:16.877380 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 16 07:43:16.877380 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 16 07:43:16.877380 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 07:43:16.877380 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Sep 16 07:43:16.877380 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 538/1072] 10.222.0.57 () {56 vars in 1111 bytes} [Fri Sep 16 07:43:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 16 07:43:16.882406 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facf4e6c-465f-4398-9847-b59fbec688fd None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:43:16.950193 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 535/1073] 10.222.0.57 () {58 vars in 1282 bytes} [Fri Sep 16 07:43:16 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 16 07:43:16.956002 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43084597-c018-4c07-ac5b-b35504ece75b None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:43:16.985584 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:43:16.997235 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facf4e6c-465f-4398-9847-b59fbec688fd None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:43:17.032625 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7707f86b-d65f-4004-b1fd-6d11ee538efa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:43:17.033234 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7707f86b-d65f-4004-b1fd-6d11ee538efa None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:43:17.033510 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7707f86b-d65f-4004-b1fd-6d11ee538efa None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:43:17.033806 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7707f86b-d65f-4004-b1fd-6d11ee538efa None admin] PATH_INFO: `/v3/projects` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:43:17.034497 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7707f86b-d65f-4004-b1fd-6d11ee538efa None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:43:17.034801 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7707f86b-d65f-4004-b1fd-6d11ee538efa None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:43:17.036215 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7707f86b-d65f-4004-b1fd-6d11ee538efa None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:43:17.048117 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 539/1074] 10.222.0.57 () {56 vars in 1148 bytes} [Fri Sep 16 07:43:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 07:43:17.053688 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7707f86b-d65f-4004-b1fd-6d11ee538efa None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:43:17.064275 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43084597-c018-4c07-ac5b-b35504ece75b None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:43:17.085384 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:43:17.103710 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f166677-c204-43a5-9f58-7708d817eeb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:43:17.104082 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f166677-c204-43a5-9f58-7708d817eeb6 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:43:17.104515 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f166677-c204-43a5-9f58-7708d817eeb6 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:43:17.104837 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f166677-c204-43a5-9f58-7708d817eeb6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:43:17.117581 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f166677-c204-43a5-9f58-7708d817eeb6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:43:17.119846 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f166677-c204-43a5-9f58-7708d817eeb6 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:43:17.136007 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application [None req-6f166677-c204-43a5-9f58-7708d817eeb6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 07:43:17.136007 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 07:43:17.136007 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 07:43:17.136007 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 07:43:17.136007 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 07:43:17.136007 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 07:43:17.136007 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 07:43:17.136007 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 07:43:17.136007 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 07:43:17.136007 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 07:43:17.136007 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 07:43:17.136007 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 07:43:17.136007 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 07:43:17.136007 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 07:43:17.136007 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 07:43:17.136007 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 07:43:17.137154 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 07:43:17.137154 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 07:43:17.137154 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 07:43:17.137154 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 07:43:17.137154 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 07:43:17.137154 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 07:43:17.137154 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 07:43:17.137154 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application with Lock( Sep 16 07:43:17.137154 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 07:43:17.137154 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._enter() Sep 16 07:43:17.137154 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 07:43:17.137154 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 07:43:17.137154 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 07:43:17.137154 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.creator() Sep 16 07:43:17.137154 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 07:43:17.137154 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application created_value = creator( Sep 16 07:43:17.137154 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 07:43:17.138083 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 07:43:17.138083 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 07:43:17.138083 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Sep 16 07:43:17.138083 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 536/1075] 10.222.0.57 () {56 vars in 1108 bytes} [Fri Sep 16 07:43:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 16 07:43:17.142845 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f166677-c204-43a5-9f58-7708d817eeb6 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:43:17.177940 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7707f86b-d65f-4004-b1fd-6d11ee538efa None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:43:17.214764 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42201ed-96b9-442d-82c3-72e5499cf088 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:43:17.215529 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42201ed-96b9-442d-82c3-72e5499cf088 None admin] REQUEST_METHOD: `PUT` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:43:17.215817 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42201ed-96b9-442d-82c3-72e5499cf088 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:43:17.216094 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42201ed-96b9-442d-82c3-72e5499cf088 None admin] PATH_INFO: `/v3/projects/4735f453c0c24cc4a1c14e9ac84a0b46/users/9bec4d9b08514461a1bf63c6b88f53b2/roles/0f6db070ff104938a2112f6d80494dab` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:43:17.218297 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42201ed-96b9-442d-82c3-72e5499cf088 None admin] RBAC: Authorizing `identity:create_grant(project_id=4735f453c0c24cc4a1c14e9ac84a0b46, user_id=9bec4d9b08514461a1bf63c6b88f53b2, role_id=0f6db070ff104938a2112f6d80494dab)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:43:17.219724 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42201ed-96b9-442d-82c3-72e5499cf088 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:43:17.229192 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:43:17.233239 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 540/1076] 10.222.0.57 () {58 vars in 1439 bytes} [Fri Sep 16 07:43:17 2022] PUT /identity/v3/projects/4735f453c0c24cc4a1c14e9ac84a0b46/users/9bec4d9b08514461a1bf63c6b88f53b2/roles/0f6db070ff104938a2112f6d80494dab => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 16 07:43:17.253000 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f166677-c204-43a5-9f58-7708d817eeb6 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:43:17.292665 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89839a82-75b7-47a1-9ed2-4733abe16dac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:43:17.293300 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89839a82-75b7-47a1-9ed2-4733abe16dac None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:43:17.293572 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89839a82-75b7-47a1-9ed2-4733abe16dac None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:43:17.293869 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89839a82-75b7-47a1-9ed2-4733abe16dac None admin] PATH_INFO: `/v3/domains` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:43:17.294714 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89839a82-75b7-47a1-9ed2-4733abe16dac None admin] RBAC: Adding query filter params (name=Default) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:43:17.295019 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89839a82-75b7-47a1-9ed2-4733abe16dac None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:43:17.296487 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89839a82-75b7-47a1-9ed2-4733abe16dac None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:43:17.317770 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 537/1077] 10.222.0.57 () {56 vars in 1109 bytes} [Fri Sep 16 07:43:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 07:43:18.247741 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbd2916-9efc-4abe-9c4f-0407b82725f3 None None] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:43:18.248261 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbd2916-9efc-4abe-9c4f-0407b82725f3 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:43:18.248350 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbd2916-9efc-4abe-9c4f-0407b82725f3 None None] PATH_INFO: `/` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:43:18.249792 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 541/1078] 10.222.0.57 () {54 vars in 927 bytes} [Fri Sep 16 07:43:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 07:43:18.255016 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435e836b-ff9c-4db2-8daf-09497059ef41 None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:43:18.255403 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435e836b-ff9c-4db2-8daf-09497059ef41 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:43:18.255560 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435e836b-ff9c-4db2-8daf-09497059ef41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:43:18.273440 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-435e836b-ff9c-4db2-8daf-09497059ef41 None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:43:18.274670 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-435e836b-ff9c-4db2-8daf-09497059ef41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:43:18.339996 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 538/1079] 10.222.0.57 () {58 vars in 1024 bytes} [Fri Sep 16 07:43:18 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 16 07:43:18.608137 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbd2916-9efc-4abe-9c4f-0407b82725f3 None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:43:18.691453 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:43:18.709050 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbd2916-9efc-4abe-9c4f-0407b82725f3 None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:43:18.745028 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc34c3f-d56c-40b7-9381-117acd083345 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:43:18.745652 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc34c3f-d56c-40b7-9381-117acd083345 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:43:18.745961 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc34c3f-d56c-40b7-9381-117acd083345 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:43:18.746233 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc34c3f-d56c-40b7-9381-117acd083345 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:43:18.756402 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc34c3f-d56c-40b7-9381-117acd083345 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 07:43:18.761605 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application [None req-bbc34c3f-d56c-40b7-9381-117acd083345 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 16 07:43:18.761605 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 07:43:18.761605 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 07:43:18.761605 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 07:43:18.761605 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 07:43:18.761605 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 07:43:18.761605 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 07:43:18.761605 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 07:43:18.761605 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 07:43:18.761605 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 07:43:18.761605 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 07:43:18.761605 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 07:43:18.761605 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 07:43:18.761605 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 07:43:18.761605 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 07:43:18.761605 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 07:43:18.762724 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 07:43:18.762724 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 07:43:18.762724 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 07:43:18.762724 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 07:43:18.762724 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 07:43:18.762724 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 07:43:18.762724 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 07:43:18.762724 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 07:43:18.762724 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 07:43:18.762724 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 07:43:18.762724 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 07:43:18.762724 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application with Lock( Sep 16 07:43:18.762724 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 07:43:18.762724 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._enter() Sep 16 07:43:18.762724 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 07:43:18.762724 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 07:43:18.763957 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 07:43:18.763957 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.creator() Sep 16 07:43:18.763957 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 07:43:18.763957 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application created_value = creator( Sep 16 07:43:18.763957 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 07:43:18.763957 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 07:43:18.763957 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 07:43:18.763957 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 07:43:18.763957 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 07:43:18.763957 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 07:43:18.763957 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 16 07:43:18.763957 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Sep 16 07:43:18.765875 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 542/1080] 10.222.0.57 () {56 vars in 1096 bytes} [Fri Sep 16 07:43:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 07:43:18.769567 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435e836b-ff9c-4db2-8daf-09497059ef41 None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:43:18.838847 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:43:18.869190 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435e836b-ff9c-4db2-8daf-09497059ef41 None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:43:18.902364 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae34e347-7a43-4ea5-b293-4763e21abd5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:43:18.902965 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae34e347-7a43-4ea5-b293-4763e21abd5e None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:43:18.903241 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae34e347-7a43-4ea5-b293-4763e21abd5e None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:43:18.903508 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae34e347-7a43-4ea5-b293-4763e21abd5e None admin] PATH_INFO: `/v3/roles` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:43:18.904149 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae34e347-7a43-4ea5-b293-4763e21abd5e None admin] RBAC: Adding query filter params (name=admin) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:43:18.904447 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae34e347-7a43-4ea5-b293-4763e21abd5e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:43:18.905839 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae34e347-7a43-4ea5-b293-4763e21abd5e None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:43:18.914698 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 539/1081] 10.222.0.57 () {56 vars in 1099 bytes} [Fri Sep 16 07:43:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:43:18.920502 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc34c3f-d56c-40b7-9381-117acd083345 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:43:19.020030 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc34c3f-d56c-40b7-9381-117acd083345 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:43:19.058342 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c283c3-2ad2-4b5b-b785-926880f34b69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:43:19.058980 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c283c3-2ad2-4b5b-b785-926880f34b69 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:43:19.059254 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c283c3-2ad2-4b5b-b785-926880f34b69 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:43:19.059520 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c283c3-2ad2-4b5b-b785-926880f34b69 None admin] PATH_INFO: `/v3/users/544e2b736ede4ecda1652bcfd9e9b6b9` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:43:19.061082 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c283c3-2ad2-4b5b-b785-926880f34b69 None admin] RBAC: Authorizing `identity:get_user(user_id=544e2b736ede4ecda1652bcfd9e9b6b9)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:43:19.062974 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c283c3-2ad2-4b5b-b785-926880f34b69 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:43:19.064575 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 543/1082] 10.222.0.57 () {56 vars in 1177 bytes} [Fri Sep 16 07:43:18 2022] GET /identity/v3/users/544e2b736ede4ecda1652bcfd9e9b6b9 => generated 285 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:43:19.071642 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae34e347-7a43-4ea5-b293-4763e21abd5e None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:43:19.175069 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae34e347-7a43-4ea5-b293-4763e21abd5e None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:43:19.203187 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:43:19.208571 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1566094-f3cc-466f-b590-7576ec179e8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:43:19.209196 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1566094-f3cc-466f-b590-7576ec179e8d None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:43:19.209474 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1566094-f3cc-466f-b590-7576ec179e8d None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:43:19.209768 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1566094-f3cc-466f-b590-7576ec179e8d None admin] PATH_INFO: `/v3/projects/51ee3784f4c5484ebf6953539855bc83` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:43:19.211450 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1566094-f3cc-466f-b590-7576ec179e8d None admin] RBAC: Authorizing `identity:get_project(project_id=51ee3784f4c5484ebf6953539855bc83)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:43:19.212876 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1566094-f3cc-466f-b590-7576ec179e8d None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:43:19.214561 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 540/1083] 10.222.0.57 () {56 vars in 1186 bytes} [Fri Sep 16 07:43:19 2022] GET /identity/v3/projects/51ee3784f4c5484ebf6953539855bc83 => generated 311 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:43:19.220503 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c283c3-2ad2-4b5b-b785-926880f34b69 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:43:19.235571 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:43:19.324330 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c283c3-2ad2-4b5b-b785-926880f34b69 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:43:19.356240 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffd5331-cd21-4efd-b922-5c12a17017dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:43:19.356890 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffd5331-cd21-4efd-b922-5c12a17017dd None admin] REQUEST_METHOD: `PUT` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:43:19.357163 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffd5331-cd21-4efd-b922-5c12a17017dd None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:43:19.357428 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffd5331-cd21-4efd-b922-5c12a17017dd None admin] PATH_INFO: `/v3/projects/51ee3784f4c5484ebf6953539855bc83/users/544e2b736ede4ecda1652bcfd9e9b6b9/roles/567db03c91854ad9af1e9a87ec1bd275` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:43:19.359313 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffd5331-cd21-4efd-b922-5c12a17017dd None admin] RBAC: Authorizing `identity:create_grant(project_id=51ee3784f4c5484ebf6953539855bc83, user_id=544e2b736ede4ecda1652bcfd9e9b6b9, role_id=567db03c91854ad9af1e9a87ec1bd275)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:43:19.360722 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffd5331-cd21-4efd-b922-5c12a17017dd None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:43:19.385640 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 544/1084] 10.222.0.57 () {58 vars in 1439 bytes} [Fri Sep 16 07:43:19 2022] PUT /identity/v3/projects/51ee3784f4c5484ebf6953539855bc83/users/544e2b736ede4ecda1652bcfd9e9b6b9/roles/567db03c91854ad9af1e9a87ec1bd275 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 07:43:19.392062 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b9192c-57d7-45ae-80c1-6d98500ec9ab None None] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:43:19.392628 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b9192c-57d7-45ae-80c1-6d98500ec9ab None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:43:19.392628 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b9192c-57d7-45ae-80c1-6d98500ec9ab None None] PATH_INFO: `/` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:43:19.393988 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 541/1085] 10.222.0.57 () {54 vars in 927 bytes} [Fri Sep 16 07:43:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 07:43:19.400344 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031525da-0034-4c2d-b990-dc7891efa9e9 None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:43:19.400633 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031525da-0034-4c2d-b990-dc7891efa9e9 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:43:19.400910 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031525da-0034-4c2d-b990-dc7891efa9e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:43:19.420562 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-031525da-0034-4c2d-b990-dc7891efa9e9 None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:43:19.421824 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-031525da-0034-4c2d-b990-dc7891efa9e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:43:19.493824 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 545/1086] 10.222.0.57 () {58 vars in 1024 bytes} [Fri Sep 16 07:43:19 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 16 07:43:19.762262 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b9192c-57d7-45ae-80c1-6d98500ec9ab None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:43:19.863287 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b9192c-57d7-45ae-80c1-6d98500ec9ab None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:43:19.896376 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6637b093-54f9-4934-8c92-4e17904f2b09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:43:19.896998 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6637b093-54f9-4934-8c92-4e17904f2b09 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:43:19.897269 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6637b093-54f9-4934-8c92-4e17904f2b09 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:43:19.897534 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6637b093-54f9-4934-8c92-4e17904f2b09 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:43:19.907888 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6637b093-54f9-4934-8c92-4e17904f2b09 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 07:43:19.912594 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application [None req-6637b093-54f9-4934-8c92-4e17904f2b09 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 16 07:43:19.912594 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 07:43:19.912594 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 07:43:19.912594 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 07:43:19.912594 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 07:43:19.912594 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 07:43:19.912594 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 07:43:19.912594 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 07:43:19.912594 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 07:43:19.912594 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 07:43:19.912594 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 07:43:19.912594 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 07:43:19.912594 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 07:43:19.912594 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 07:43:19.912594 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 07:43:19.912594 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 07:43:19.913566 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 07:43:19.913566 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 07:43:19.913566 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 07:43:19.913566 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 07:43:19.913566 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 07:43:19.913566 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 07:43:19.913566 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 07:43:19.913566 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 07:43:19.913566 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 07:43:19.913566 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 07:43:19.913566 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 07:43:19.913566 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application with Lock( Sep 16 07:43:19.913566 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 07:43:19.913566 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._enter() Sep 16 07:43:19.913566 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 07:43:19.913566 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 07:43:19.915036 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 07:43:19.915036 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.creator() Sep 16 07:43:19.915036 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 07:43:19.915036 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application created_value = creator( Sep 16 07:43:19.915036 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 07:43:19.915036 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 07:43:19.915036 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 07:43:19.915036 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 07:43:19.915036 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 07:43:19.915036 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 07:43:19.915036 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 16 07:43:19.915036 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Sep 16 07:43:19.915036 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 542/1087] 10.222.0.57 () {56 vars in 1120 bytes} [Fri Sep 16 07:43:19 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 07:43:19.920252 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031525da-0034-4c2d-b990-dc7891efa9e9 None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:43:19.922457 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:43:20.017540 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031525da-0034-4c2d-b990-dc7891efa9e9 None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:43:20.050514 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c057064e-14c2-4999-ab3c-aa01b02f254c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:43:20.051115 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c057064e-14c2-4999-ab3c-aa01b02f254c None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:43:20.051393 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c057064e-14c2-4999-ab3c-aa01b02f254c None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:43:20.051664 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c057064e-14c2-4999-ab3c-aa01b02f254c None admin] PATH_INFO: `/v3/roles` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:43:20.052319 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c057064e-14c2-4999-ab3c-aa01b02f254c None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:43:20.052618 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c057064e-14c2-4999-ab3c-aa01b02f254c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:43:20.053997 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c057064e-14c2-4999-ab3c-aa01b02f254c None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:43:20.062388 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 546/1088] 10.222.0.57 () {56 vars in 1115 bytes} [Fri Sep 16 07:43:19 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:43:20.068135 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6637b093-54f9-4934-8c92-4e17904f2b09 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:43:20.129501 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:43:20.171280 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6637b093-54f9-4934-8c92-4e17904f2b09 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:43:20.203318 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeee32ac-dd40-45bc-97c7-4172a93ebb37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:43:20.203933 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeee32ac-dd40-45bc-97c7-4172a93ebb37 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:43:20.204207 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeee32ac-dd40-45bc-97c7-4172a93ebb37 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:43:20.204474 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeee32ac-dd40-45bc-97c7-4172a93ebb37 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:43:20.215560 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeee32ac-dd40-45bc-97c7-4172a93ebb37 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:43:20.216996 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeee32ac-dd40-45bc-97c7-4172a93ebb37 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:43:20.231308 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application [None req-eeee32ac-dd40-45bc-97c7-4172a93ebb37 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 07:43:20.231308 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 07:43:20.231308 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 07:43:20.231308 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 07:43:20.231308 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 07:43:20.231308 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 07:43:20.231308 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 07:43:20.231308 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 07:43:20.231308 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 07:43:20.231308 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 07:43:20.231308 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 07:43:20.231308 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 07:43:20.231308 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 07:43:20.231308 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 07:43:20.231308 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 07:43:20.231308 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 07:43:20.232410 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 07:43:20.232410 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 07:43:20.232410 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 07:43:20.232410 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 07:43:20.232410 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 07:43:20.232410 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 07:43:20.232410 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 07:43:20.232410 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application with Lock( Sep 16 07:43:20.232410 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 07:43:20.232410 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._enter() Sep 16 07:43:20.232410 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 07:43:20.232410 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 07:43:20.232410 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 07:43:20.232410 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.creator() Sep 16 07:43:20.232410 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 07:43:20.232410 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application created_value = creator( Sep 16 07:43:20.232410 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 07:43:20.233325 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 07:43:20.233325 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 07:43:20.233325 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Sep 16 07:43:20.233325 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 543/1089] 10.222.0.57 () {56 vars in 1108 bytes} [Fri Sep 16 07:43:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 07:43:20.238099 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c057064e-14c2-4999-ab3c-aa01b02f254c None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:43:20.300750 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:43:20.338280 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c057064e-14c2-4999-ab3c-aa01b02f254c None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:43:20.370486 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcfab39-2652-4ef2-9024-593c69f25d70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:43:20.371085 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcfab39-2652-4ef2-9024-593c69f25d70 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:43:20.371365 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcfab39-2652-4ef2-9024-593c69f25d70 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:43:20.371638 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcfab39-2652-4ef2-9024-593c69f25d70 None admin] PATH_INFO: `/v3/domains` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:43:20.372268 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fcfab39-2652-4ef2-9024-593c69f25d70 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:43:20.372568 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fcfab39-2652-4ef2-9024-593c69f25d70 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:43:20.373945 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fcfab39-2652-4ef2-9024-593c69f25d70 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:43:20.385522 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 547/1090] 10.222.0.57 () {56 vars in 1109 bytes} [Fri Sep 16 07:43:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:43:20.391096 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeee32ac-dd40-45bc-97c7-4172a93ebb37 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:43:20.489116 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeee32ac-dd40-45bc-97c7-4172a93ebb37 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:43:20.501575 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:43:20.522828 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6ffcb8-fd51-4672-969a-e5ff5257282d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:43:20.524195 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6ffcb8-fd51-4672-969a-e5ff5257282d None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:43:20.524468 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6ffcb8-fd51-4672-969a-e5ff5257282d None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:43:20.524793 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6ffcb8-fd51-4672-969a-e5ff5257282d None admin] PATH_INFO: `/v3/users/nova` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:43:20.532360 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6ffcb8-fd51-4672-969a-e5ff5257282d None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:43:20.533801 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6ffcb8-fd51-4672-969a-e5ff5257282d None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:43:20.544562 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application [None req-fd6ffcb8-fd51-4672-969a-e5ff5257282d None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 16 07:43:20.544562 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 07:43:20.544562 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 07:43:20.544562 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 07:43:20.544562 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 07:43:20.544562 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 07:43:20.544562 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 07:43:20.544562 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 07:43:20.544562 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 07:43:20.544562 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 07:43:20.544562 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 07:43:20.544562 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 07:43:20.544562 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 16 07:43:20.544562 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 16 07:43:20.544562 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 16 07:43:20.544562 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 16 07:43:20.545498 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 07:43:20.545498 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 07:43:20.545498 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 16 07:43:20.545498 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 07:43:20.545498 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 16 07:43:20.545498 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 07:43:20.545498 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 07:43:20.545498 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 07:43:20.545498 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 07:43:20.545498 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 07:43:20.545498 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 07:43:20.545498 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application with Lock( Sep 16 07:43:20.545498 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 07:43:20.545498 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._enter() Sep 16 07:43:20.545498 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 07:43:20.545498 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 07:43:20.545498 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 07:43:20.545498 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.creator() Sep 16 07:43:20.546731 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 07:43:20.546731 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application created_value = creator( Sep 16 07:43:20.546731 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 16 07:43:20.546731 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 16 07:43:20.546731 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 16 07:43:20.546731 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 16 07:43:20.546731 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 16 07:43:20.546731 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 16 07:43:20.546731 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 16 07:43:20.546731 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Sep 16 07:43:20.546731 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 544/1091] 10.222.0.57 () {56 vars in 1093 bytes} [Fri Sep 16 07:43:20 2022] GET /identity/v3/users/nova => generated 82 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 07:43:20.551453 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcfab39-2652-4ef2-9024-593c69f25d70 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:43:20.651739 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcfab39-2652-4ef2-9024-593c69f25d70 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:43:20.675339 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:43:20.686346 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8568af-1a41-40ee-adbc-1f703bb2b1e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:43:20.686948 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8568af-1a41-40ee-adbc-1f703bb2b1e7 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:43:20.687227 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8568af-1a41-40ee-adbc-1f703bb2b1e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:43:20.687495 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8568af-1a41-40ee-adbc-1f703bb2b1e7 None admin] PATH_INFO: `/v3/users` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:43:20.688210 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8568af-1a41-40ee-adbc-1f703bb2b1e7 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:43:20.688511 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8568af-1a41-40ee-adbc-1f703bb2b1e7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:43:20.689962 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8568af-1a41-40ee-adbc-1f703bb2b1e7 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:43:20.707046 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 548/1092] 10.222.0.57 () {56 vars in 1133 bytes} [Fri Sep 16 07:43:20 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:43:20.713389 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6ffcb8-fd51-4672-969a-e5ff5257282d None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:43:20.816088 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6ffcb8-fd51-4672-969a-e5ff5257282d None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:43:20.848731 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589958bb-02fd-47d8-8577-56f8e1371482 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:43:20.849319 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589958bb-02fd-47d8-8577-56f8e1371482 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:43:20.849591 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589958bb-02fd-47d8-8577-56f8e1371482 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:43:20.850005 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589958bb-02fd-47d8-8577-56f8e1371482 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:43:20.889674 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:43:20.915146 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589958bb-02fd-47d8-8577-56f8e1371482 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:43:20.916575 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589958bb-02fd-47d8-8577-56f8e1371482 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:43:21.013672 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 545/1093] 10.222.0.57 () {58 vars in 1282 bytes} [Fri Sep 16 07:43:20 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 16 07:43:21.019492 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8568af-1a41-40ee-adbc-1f703bb2b1e7 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:43:21.118228 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8568af-1a41-40ee-adbc-1f703bb2b1e7 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:43:21.152318 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e91a2c8-5f0b-4e2c-9346-94bb63597282 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:43:21.152932 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e91a2c8-5f0b-4e2c-9346-94bb63597282 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:43:21.153204 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e91a2c8-5f0b-4e2c-9346-94bb63597282 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:43:21.153470 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e91a2c8-5f0b-4e2c-9346-94bb63597282 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:43:21.163252 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e91a2c8-5f0b-4e2c-9346-94bb63597282 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:43:21.165401 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e91a2c8-5f0b-4e2c-9346-94bb63597282 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:43:21.179990 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application [None req-3e91a2c8-5f0b-4e2c-9346-94bb63597282 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 07:43:21.179990 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 07:43:21.179990 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 07:43:21.179990 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 07:43:21.179990 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 07:43:21.179990 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 07:43:21.179990 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 07:43:21.179990 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 07:43:21.179990 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 07:43:21.179990 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 07:43:21.179990 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 07:43:21.179990 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 07:43:21.179990 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 07:43:21.179990 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 07:43:21.179990 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 07:43:21.179990 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 07:43:21.181182 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 07:43:21.181182 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 07:43:21.181182 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 07:43:21.181182 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 07:43:21.181182 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 07:43:21.181182 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 07:43:21.181182 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 07:43:21.181182 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application with Lock( Sep 16 07:43:21.181182 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 07:43:21.181182 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._enter() Sep 16 07:43:21.181182 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 07:43:21.181182 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 07:43:21.181182 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 07:43:21.181182 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.creator() Sep 16 07:43:21.181182 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 07:43:21.181182 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application created_value = creator( Sep 16 07:43:21.181182 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 07:43:21.182326 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 07:43:21.182326 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 07:43:21.182326 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Sep 16 07:43:21.182326 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 549/1094] 10.222.0.57 () {56 vars in 1108 bytes} [Fri Sep 16 07:43:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 07:43:21.186921 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589958bb-02fd-47d8-8577-56f8e1371482 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:43:21.254519 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:43:21.284905 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589958bb-02fd-47d8-8577-56f8e1371482 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:43:21.317552 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db348256-994d-4a39-bb65-95308f597682 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:43:21.318178 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db348256-994d-4a39-bb65-95308f597682 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:43:21.318454 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db348256-994d-4a39-bb65-95308f597682 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:43:21.318724 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db348256-994d-4a39-bb65-95308f597682 None admin] PATH_INFO: `/v3/domains` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:43:21.319351 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db348256-994d-4a39-bb65-95308f597682 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:43:21.319651 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db348256-994d-4a39-bb65-95308f597682 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:43:21.321541 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db348256-994d-4a39-bb65-95308f597682 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:43:21.332379 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 546/1095] 10.222.0.57 () {56 vars in 1109 bytes} [Fri Sep 16 07:43:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:43:21.338551 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e91a2c8-5f0b-4e2c-9346-94bb63597282 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:43:21.371864 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:43:21.439113 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e91a2c8-5f0b-4e2c-9346-94bb63597282 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:43:21.474149 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9786f8cb-f018-497e-a358-4fc5b39fcac4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:43:21.474762 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9786f8cb-f018-497e-a358-4fc5b39fcac4 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:43:21.475035 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9786f8cb-f018-497e-a358-4fc5b39fcac4 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:43:21.475299 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9786f8cb-f018-497e-a358-4fc5b39fcac4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:43:21.481990 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9786f8cb-f018-497e-a358-4fc5b39fcac4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:43:21.483403 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9786f8cb-f018-497e-a358-4fc5b39fcac4 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:43:21.494274 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application [None req-9786f8cb-f018-497e-a358-4fc5b39fcac4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 07:43:21.494274 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 07:43:21.494274 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 07:43:21.494274 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 07:43:21.494274 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 07:43:21.494274 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 07:43:21.494274 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 07:43:21.494274 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 07:43:21.494274 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 07:43:21.494274 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 07:43:21.494274 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 07:43:21.494274 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 07:43:21.494274 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 16 07:43:21.494274 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 16 07:43:21.494274 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 16 07:43:21.495332 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 16 07:43:21.495332 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 07:43:21.495332 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 07:43:21.495332 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 07:43:21.495332 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 07:43:21.495332 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 07:43:21.495332 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 07:43:21.495332 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 07:43:21.495332 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application with Lock( Sep 16 07:43:21.495332 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 07:43:21.495332 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._enter() Sep 16 07:43:21.495332 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 07:43:21.495332 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 07:43:21.495332 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 07:43:21.495332 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.creator() Sep 16 07:43:21.495332 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 07:43:21.495332 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application created_value = creator( Sep 16 07:43:21.501194 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 16 07:43:21.501194 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 16 07:43:21.501194 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 16 07:43:21.501194 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 16 07:43:21.501194 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 16 07:43:21.501194 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 16 07:43:21.501194 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 07:43:21.501194 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Sep 16 07:43:21.501194 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 550/1096] 10.222.0.57 () {56 vars in 1111 bytes} [Fri Sep 16 07:43:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 07:43:21.502875 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db348256-994d-4a39-bb65-95308f597682 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:43:21.540545 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e5ac90-617a-4444-b1dd-ed90a00065e9 None None] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:43:21.540830 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e5ac90-617a-4444-b1dd-ed90a00065e9 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:43:21.541103 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e5ac90-617a-4444-b1dd-ed90a00065e9 None None] PATH_INFO: `/` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:43:21.542450 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 551/1097] 10.222.0.57 () {54 vars in 927 bytes} [Fri Sep 16 07:43:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 07:43:21.547317 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efd327b-aeb4-4361-a169-2a40a042cfc7 None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:43:21.547600 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efd327b-aeb4-4361-a169-2a40a042cfc7 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:43:21.547877 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efd327b-aeb4-4361-a169-2a40a042cfc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:43:21.566053 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-2efd327b-aeb4-4361-a169-2a40a042cfc7 None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:43:21.567240 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-2efd327b-aeb4-4361-a169-2a40a042cfc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:43:21.602971 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db348256-994d-4a39-bb65-95308f597682 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:43:21.631848 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:43:21.633642 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 552/1098] 10.222.0.57 () {58 vars in 1024 bytes} [Fri Sep 16 07:43:21 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 16 07:43:21.640408 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac96df98-3bc4-4cb7-97aa-4add97909440 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:43:21.641007 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac96df98-3bc4-4cb7-97aa-4add97909440 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:43:21.641278 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac96df98-3bc4-4cb7-97aa-4add97909440 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:43:21.641543 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac96df98-3bc4-4cb7-97aa-4add97909440 None admin] PATH_INFO: `/v3/projects` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:43:21.642251 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac96df98-3bc4-4cb7-97aa-4add97909440 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:43:21.642551 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac96df98-3bc4-4cb7-97aa-4add97909440 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:43:21.643959 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac96df98-3bc4-4cb7-97aa-4add97909440 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:43:21.656359 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 547/1099] 10.222.0.57 () {56 vars in 1148 bytes} [Fri Sep 16 07:43:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:43:21.662336 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efd327b-aeb4-4361-a169-2a40a042cfc7 None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:43:21.686871 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:43:21.760869 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efd327b-aeb4-4361-a169-2a40a042cfc7 None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:43:21.794185 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46de321-b49a-4125-b564-594c41d5cb9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:43:21.794782 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46de321-b49a-4125-b564-594c41d5cb9f None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:43:21.795058 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46de321-b49a-4125-b564-594c41d5cb9f None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:43:21.795327 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46de321-b49a-4125-b564-594c41d5cb9f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:43:21.796037 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46de321-b49a-4125-b564-594c41d5cb9f None admin] RBAC: Adding query filter params (role.id=0f6db070ff104938a2112f6d80494dab, scope.project.id=4735f453c0c24cc4a1c14e9ac84a0b46, user.id=9bec4d9b08514461a1bf63c6b88f53b2) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:43:21.796344 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46de321-b49a-4125-b564-594c41d5cb9f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:43:21.797774 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46de321-b49a-4125-b564-594c41d5cb9f None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:43:21.803301 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 553/1100] 10.222.0.57 () {56 vars in 1374 bytes} [Fri Sep 16 07:43:21 2022] GET /identity/v3/role_assignments?user.id=9bec4d9b08514461a1bf63c6b88f53b2&scope.project.id=4735f453c0c24cc4a1c14e9ac84a0b46&role.id=0f6db070ff104938a2112f6d80494dab => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:43:21.905016 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac96df98-3bc4-4cb7-97aa-4add97909440 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:43:22.010628 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac96df98-3bc4-4cb7-97aa-4add97909440 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:43:22.046312 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afd9d88-51d8-4a58-8bee-8e6bae03fc03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:43:22.046945 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afd9d88-51d8-4a58-8bee-8e6bae03fc03 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:43:22.047221 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afd9d88-51d8-4a58-8bee-8e6bae03fc03 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:43:22.047491 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afd9d88-51d8-4a58-8bee-8e6bae03fc03 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:43:22.058230 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afd9d88-51d8-4a58-8bee-8e6bae03fc03 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 07:43:22.062983 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application [None req-6afd9d88-51d8-4a58-8bee-8e6bae03fc03 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 16 07:43:22.062983 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 07:43:22.062983 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 07:43:22.062983 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 07:43:22.062983 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 07:43:22.062983 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 07:43:22.062983 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 07:43:22.062983 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 07:43:22.062983 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 07:43:22.062983 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 07:43:22.062983 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 07:43:22.062983 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 07:43:22.062983 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 07:43:22.062983 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 07:43:22.062983 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 07:43:22.062983 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 07:43:22.063939 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 07:43:22.063939 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 07:43:22.063939 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 07:43:22.063939 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 07:43:22.063939 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 07:43:22.063939 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 07:43:22.063939 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 07:43:22.063939 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 07:43:22.063939 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 07:43:22.063939 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 07:43:22.063939 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 07:43:22.063939 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application with Lock( Sep 16 07:43:22.063939 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 07:43:22.063939 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._enter() Sep 16 07:43:22.063939 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 07:43:22.063939 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 07:43:22.064808 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 07:43:22.064808 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.creator() Sep 16 07:43:22.064808 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 07:43:22.064808 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application created_value = creator( Sep 16 07:43:22.064808 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 07:43:22.064808 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 07:43:22.064808 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 07:43:22.064808 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 07:43:22.064808 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 07:43:22.064808 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 07:43:22.064808 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 16 07:43:22.064808 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Sep 16 07:43:22.064808 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 548/1101] 10.222.0.57 () {56 vars in 1096 bytes} [Fri Sep 16 07:43:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 07:43:22.070728 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46de321-b49a-4125-b564-594c41d5cb9f None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:43:22.166253 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:43:22.178663 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46de321-b49a-4125-b564-594c41d5cb9f None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:43:22.214632 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10208b5a-c78b-4882-9a50-6da80b7c3280 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:43:22.215236 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10208b5a-c78b-4882-9a50-6da80b7c3280 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:43:22.215510 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10208b5a-c78b-4882-9a50-6da80b7c3280 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:43:22.215784 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10208b5a-c78b-4882-9a50-6da80b7c3280 None admin] PATH_INFO: `/v3/roles` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:43:22.216435 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10208b5a-c78b-4882-9a50-6da80b7c3280 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:43:22.216733 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10208b5a-c78b-4882-9a50-6da80b7c3280 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:43:22.218116 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10208b5a-c78b-4882-9a50-6da80b7c3280 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:43:22.227202 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 554/1102] 10.222.0.57 () {56 vars in 1099 bytes} [Fri Sep 16 07:43:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:43:22.233304 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afd9d88-51d8-4a58-8bee-8e6bae03fc03 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:43:22.291726 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:43:22.340741 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afd9d88-51d8-4a58-8bee-8e6bae03fc03 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:43:22.375560 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac1ffe9-a76a-4437-872f-4464ba50708e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:43:22.376188 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac1ffe9-a76a-4437-872f-4464ba50708e None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:43:22.376461 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac1ffe9-a76a-4437-872f-4464ba50708e None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:43:22.376726 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac1ffe9-a76a-4437-872f-4464ba50708e None admin] PATH_INFO: `/v3/users/544e2b736ede4ecda1652bcfd9e9b6b9` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:43:22.377866 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac1ffe9-a76a-4437-872f-4464ba50708e None admin] RBAC: Authorizing `identity:get_user(user_id=544e2b736ede4ecda1652bcfd9e9b6b9)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:43:22.379540 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac1ffe9-a76a-4437-872f-4464ba50708e None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:43:22.381398 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 549/1103] 10.222.0.57 () {56 vars in 1177 bytes} [Fri Sep 16 07:43:22 2022] GET /identity/v3/users/544e2b736ede4ecda1652bcfd9e9b6b9 => generated 285 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:43:22.387631 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10208b5a-c78b-4882-9a50-6da80b7c3280 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:43:22.490609 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10208b5a-c78b-4882-9a50-6da80b7c3280 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:43:22.525508 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7856a863-dbc9-4063-a555-8ff7915942f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:43:22.526146 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7856a863-dbc9-4063-a555-8ff7915942f6 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:43:22.526424 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7856a863-dbc9-4063-a555-8ff7915942f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:43:22.526684 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7856a863-dbc9-4063-a555-8ff7915942f6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:43:22.545404 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:43:22.595750 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7856a863-dbc9-4063-a555-8ff7915942f6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:43:22.597204 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7856a863-dbc9-4063-a555-8ff7915942f6 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:43:22.698379 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 555/1104] 10.222.0.57 () {58 vars in 1282 bytes} [Fri Sep 16 07:43:22 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 16 07:43:22.704282 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac1ffe9-a76a-4437-872f-4464ba50708e None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:43:22.803683 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac1ffe9-a76a-4437-872f-4464ba50708e None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:43:22.824521 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:43:22.838309 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24e72dd-3e8e-4f7a-8e31-c7657effa408 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:43:22.838939 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24e72dd-3e8e-4f7a-8e31-c7657effa408 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:43:22.839213 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24e72dd-3e8e-4f7a-8e31-c7657effa408 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:43:22.839484 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24e72dd-3e8e-4f7a-8e31-c7657effa408 None admin] PATH_INFO: `/v3/projects/51ee3784f4c5484ebf6953539855bc83` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:43:22.840591 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24e72dd-3e8e-4f7a-8e31-c7657effa408 None admin] RBAC: Authorizing `identity:get_project(project_id=51ee3784f4c5484ebf6953539855bc83)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:43:22.842066 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24e72dd-3e8e-4f7a-8e31-c7657effa408 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:43:22.843676 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 550/1105] 10.222.0.57 () {56 vars in 1186 bytes} [Fri Sep 16 07:43:22 2022] GET /identity/v3/projects/51ee3784f4c5484ebf6953539855bc83 => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:43:22.849863 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7856a863-dbc9-4063-a555-8ff7915942f6 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:43:22.898942 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:43:22.947190 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7856a863-dbc9-4063-a555-8ff7915942f6 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:43:22.979859 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6e55b5-027b-44d5-aed4-e37dcf3d2819 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:43:22.980447 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6e55b5-027b-44d5-aed4-e37dcf3d2819 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:43:22.980723 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6e55b5-027b-44d5-aed4-e37dcf3d2819 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:43:22.980994 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6e55b5-027b-44d5-aed4-e37dcf3d2819 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:43:22.981705 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6e55b5-027b-44d5-aed4-e37dcf3d2819 None admin] RBAC: Adding query filter params (role.id=567db03c91854ad9af1e9a87ec1bd275, scope.project.id=51ee3784f4c5484ebf6953539855bc83, user.id=544e2b736ede4ecda1652bcfd9e9b6b9) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:43:22.982041 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6e55b5-027b-44d5-aed4-e37dcf3d2819 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:43:22.983452 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6e55b5-027b-44d5-aed4-e37dcf3d2819 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:43:22.988941 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 556/1106] 10.222.0.57 () {56 vars in 1374 bytes} [Fri Sep 16 07:43:22 2022] GET /identity/v3/role_assignments?user.id=544e2b736ede4ecda1652bcfd9e9b6b9&scope.project.id=51ee3784f4c5484ebf6953539855bc83&role.id=567db03c91854ad9af1e9a87ec1bd275 => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:43:25.140258 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a5dd52-f43a-4d37-b774-e8c9599028fc None None] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:43:25.140737 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a5dd52-f43a-4d37-b774-e8c9599028fc None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:43:25.140830 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a5dd52-f43a-4d37-b774-e8c9599028fc None None] PATH_INFO: `/` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:43:25.142196 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 551/1107] 10.222.0.57 () {54 vars in 927 bytes} [Fri Sep 16 07:43:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 07:43:25.147261 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8455b82-f223-48ce-9223-38692809cfeb None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:43:25.147648 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8455b82-f223-48ce-9223-38692809cfeb None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:43:25.148416 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8455b82-f223-48ce-9223-38692809cfeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:43:25.166179 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-c8455b82-f223-48ce-9223-38692809cfeb None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:43:25.167350 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-c8455b82-f223-48ce-9223-38692809cfeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:43:25.231396 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 557/1108] 10.222.0.57 () {58 vars in 1024 bytes} [Fri Sep 16 07:43:25 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 16 07:43:25.499100 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a5dd52-f43a-4d37-b774-e8c9599028fc None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:43:25.597099 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a5dd52-f43a-4d37-b774-e8c9599028fc None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:43:25.629537 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192f634d-ae04-4c71-9c0c-23827e4626f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:43:25.630165 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192f634d-ae04-4c71-9c0c-23827e4626f6 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:43:25.630444 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192f634d-ae04-4c71-9c0c-23827e4626f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:43:25.630712 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192f634d-ae04-4c71-9c0c-23827e4626f6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:43:25.631793 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192f634d-ae04-4c71-9c0c-23827e4626f6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:43:25.633400 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192f634d-ae04-4c71-9c0c-23827e4626f6 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:43:25.634956 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 552/1109] 10.222.0.57 () {56 vars in 1108 bytes} [Fri Sep 16 07:43:25 2022] GET /identity/v3/domains/default => generated 199 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:43:25.640650 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8455b82-f223-48ce-9223-38692809cfeb None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:43:25.685714 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:43:25.740729 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8455b82-f223-48ce-9223-38692809cfeb None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:43:25.777448 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81edb65a-d980-43ab-a87b-ec50c607a1e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:43:25.778005 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81edb65a-d980-43ab-a87b-ec50c607a1e5 None admin] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:43:25.778283 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81edb65a-d980-43ab-a87b-ec50c607a1e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:43:25.778551 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81edb65a-d980-43ab-a87b-ec50c607a1e5 None admin] PATH_INFO: `/v3/users` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:43:25.779196 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81edb65a-d980-43ab-a87b-ec50c607a1e5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:43:25.780600 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81edb65a-d980-43ab-a87b-ec50c607a1e5 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:43:25.801210 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 558/1110] 10.222.0.57 () {60 vars in 1132 bytes} [Fri Sep 16 07:43:25 2022] POST /identity/v3/users => generated 286 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 07:43:27.969117 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61936b7b-5b0b-4fab-aba1-4f3ab8c6d560 None None] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:43:27.969649 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61936b7b-5b0b-4fab-aba1-4f3ab8c6d560 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:43:27.969649 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61936b7b-5b0b-4fab-aba1-4f3ab8c6d560 None None] PATH_INFO: `/` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:43:27.970994 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 553/1111] 10.222.0.57 () {54 vars in 927 bytes} [Fri Sep 16 07:43:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 07:43:27.976180 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5948a752-0a4b-4f8c-a55a-2d389ad2fa11 None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:43:27.976555 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5948a752-0a4b-4f8c-a55a-2d389ad2fa11 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:43:27.976741 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5948a752-0a4b-4f8c-a55a-2d389ad2fa11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:43:27.994424 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-5948a752-0a4b-4f8c-a55a-2d389ad2fa11 None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:43:27.995595 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-5948a752-0a4b-4f8c-a55a-2d389ad2fa11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:43:28.060008 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 559/1112] 10.222.0.57 () {58 vars in 1024 bytes} [Fri Sep 16 07:43:27 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 16 07:43:28.331955 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61936b7b-5b0b-4fab-aba1-4f3ab8c6d560 None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:43:28.388621 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:43:28.433272 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61936b7b-5b0b-4fab-aba1-4f3ab8c6d560 None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:43:28.466191 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245234b4-7c3e-4263-871f-82e2e58df00d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:43:28.466808 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245234b4-7c3e-4263-871f-82e2e58df00d None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:43:28.467087 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245234b4-7c3e-4263-871f-82e2e58df00d None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:43:28.467358 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245234b4-7c3e-4263-871f-82e2e58df00d None admin] PATH_INFO: `/v3/roles/e92664bc677b40769b7a05d102541bf0` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:43:28.468741 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245234b4-7c3e-4263-871f-82e2e58df00d None admin] RBAC: Authorizing `identity:get_role(role_id=e92664bc677b40769b7a05d102541bf0)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:43:28.470133 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245234b4-7c3e-4263-871f-82e2e58df00d None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:43:28.471471 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 554/1113] 10.222.0.57 () {56 vars in 1177 bytes} [Fri Sep 16 07:43:28 2022] GET /identity/v3/roles/e92664bc677b40769b7a05d102541bf0 => generated 223 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:43:28.478048 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5948a752-0a4b-4f8c-a55a-2d389ad2fa11 None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:43:28.506979 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:43:28.574178 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5948a752-0a4b-4f8c-a55a-2d389ad2fa11 None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:43:28.608162 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1793dd-1d96-434f-820e-61b6930dbd02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:43:28.608783 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1793dd-1d96-434f-820e-61b6930dbd02 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:43:28.609060 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1793dd-1d96-434f-820e-61b6930dbd02 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:43:28.609330 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1793dd-1d96-434f-820e-61b6930dbd02 None admin] PATH_INFO: `/v3/users/e5f9e6b69f804e189711377732f72454` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:43:28.621788 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1793dd-1d96-434f-820e-61b6930dbd02 None admin] RBAC: Authorizing `identity:get_user(user_id=e5f9e6b69f804e189711377732f72454)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:43:28.623217 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1793dd-1d96-434f-820e-61b6930dbd02 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:43:28.624781 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 560/1114] 10.222.0.57 () {56 vars in 1177 bytes} [Fri Sep 16 07:43:28 2022] GET /identity/v3/users/e5f9e6b69f804e189711377732f72454 => generated 286 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:43:28.630934 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245234b4-7c3e-4263-871f-82e2e58df00d None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:43:28.746449 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245234b4-7c3e-4263-871f-82e2e58df00d None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:43:28.769498 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:43:28.780746 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803332dc-22d6-4ea9-b741-6e53cebc42c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:43:28.781341 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803332dc-22d6-4ea9-b741-6e53cebc42c2 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:43:28.781612 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803332dc-22d6-4ea9-b741-6e53cebc42c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:43:28.781917 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803332dc-22d6-4ea9-b741-6e53cebc42c2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:43:28.845540 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803332dc-22d6-4ea9-b741-6e53cebc42c2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:43:28.846983 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803332dc-22d6-4ea9-b741-6e53cebc42c2 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:43:28.940491 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 555/1115] 10.222.0.57 () {58 vars in 1282 bytes} [Fri Sep 16 07:43:28 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 16 07:43:28.947009 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1793dd-1d96-434f-820e-61b6930dbd02 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:43:29.031513 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:43:29.043326 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1793dd-1d96-434f-820e-61b6930dbd02 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:43:29.076365 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7299506-1d92-4e7b-9da4-7e660036e2f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:43:29.076975 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7299506-1d92-4e7b-9da4-7e660036e2f0 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:43:29.077250 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7299506-1d92-4e7b-9da4-7e660036e2f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:43:29.077518 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7299506-1d92-4e7b-9da4-7e660036e2f0 None admin] PATH_INFO: `/v3/projects/51ee3784f4c5484ebf6953539855bc83` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:43:29.078652 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7299506-1d92-4e7b-9da4-7e660036e2f0 None admin] RBAC: Authorizing `identity:get_project(project_id=51ee3784f4c5484ebf6953539855bc83)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:43:29.080082 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7299506-1d92-4e7b-9da4-7e660036e2f0 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:43:29.081693 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 561/1116] 10.222.0.57 () {56 vars in 1186 bytes} [Fri Sep 16 07:43:28 2022] GET /identity/v3/projects/51ee3784f4c5484ebf6953539855bc83 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:43:29.087939 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803332dc-22d6-4ea9-b741-6e53cebc42c2 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:43:29.112048 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:43:29.186235 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803332dc-22d6-4ea9-b741-6e53cebc42c2 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:43:29.219029 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d86e388-e942-4f37-b4ac-bf91f3b5eaa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:43:29.219562 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d86e388-e942-4f37-b4ac-bf91f3b5eaa1 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:43:29.219842 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d86e388-e942-4f37-b4ac-bf91f3b5eaa1 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:43:29.220117 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d86e388-e942-4f37-b4ac-bf91f3b5eaa1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:43:29.220828 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d86e388-e942-4f37-b4ac-bf91f3b5eaa1 None admin] RBAC: Adding query filter params (role.id=e92664bc677b40769b7a05d102541bf0, scope.project.id=51ee3784f4c5484ebf6953539855bc83, user.id=e5f9e6b69f804e189711377732f72454) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:43:29.221134 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d86e388-e942-4f37-b4ac-bf91f3b5eaa1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:43:29.222576 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d86e388-e942-4f37-b4ac-bf91f3b5eaa1 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:43:29.227806 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 556/1117] 10.222.0.57 () {56 vars in 1374 bytes} [Fri Sep 16 07:43:29 2022] GET /identity/v3/role_assignments?user.id=e5f9e6b69f804e189711377732f72454&scope.project.id=51ee3784f4c5484ebf6953539855bc83&role.id=e92664bc677b40769b7a05d102541bf0 => generated 259 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:43:31.318833 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3a0742-6729-4148-ab27-6b24de83fae1 None None] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:43:31.319452 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3a0742-6729-4148-ab27-6b24de83fae1 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:43:31.319452 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3a0742-6729-4148-ab27-6b24de83fae1 None None] PATH_INFO: `/` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:43:31.321039 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 562/1118] 10.222.0.57 () {54 vars in 927 bytes} [Fri Sep 16 07:43:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 07:43:31.326066 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3ec26d-6e26-44d1-b246-f98e311908ed None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:43:31.326480 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3ec26d-6e26-44d1-b246-f98e311908ed None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:43:31.326615 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3ec26d-6e26-44d1-b246-f98e311908ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:43:31.345418 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-0d3ec26d-6e26-44d1-b246-f98e311908ed None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:43:31.346618 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-0d3ec26d-6e26-44d1-b246-f98e311908ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:43:31.411659 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 557/1119] 10.222.0.57 () {58 vars in 1024 bytes} [Fri Sep 16 07:43:31 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 16 07:43:31.687321 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3a0742-6729-4148-ab27-6b24de83fae1 None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:43:31.792997 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3a0742-6729-4148-ab27-6b24de83fae1 None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:43:31.825380 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18380724-2b4f-423a-bea2-a16345f227eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:43:31.826017 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18380724-2b4f-423a-bea2-a16345f227eb None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:43:31.826294 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18380724-2b4f-423a-bea2-a16345f227eb None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:43:31.826613 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18380724-2b4f-423a-bea2-a16345f227eb None admin] PATH_INFO: `/v3/roles/e92664bc677b40769b7a05d102541bf0` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:43:31.827981 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18380724-2b4f-423a-bea2-a16345f227eb None admin] RBAC: Authorizing `identity:get_role(role_id=e92664bc677b40769b7a05d102541bf0)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:43:31.829320 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18380724-2b4f-423a-bea2-a16345f227eb None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:43:31.830660 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 563/1120] 10.222.0.57 () {56 vars in 1177 bytes} [Fri Sep 16 07:43:31 2022] GET /identity/v3/roles/e92664bc677b40769b7a05d102541bf0 => generated 223 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:43:31.837216 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3ec26d-6e26-44d1-b246-f98e311908ed None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:43:31.855080 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:43:31.932431 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3ec26d-6e26-44d1-b246-f98e311908ed None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:43:31.965416 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551460a7-dc79-4c1b-b35a-c002d990a46b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:43:31.965991 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551460a7-dc79-4c1b-b35a-c002d990a46b None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:43:31.966263 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551460a7-dc79-4c1b-b35a-c002d990a46b None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:43:31.966526 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551460a7-dc79-4c1b-b35a-c002d990a46b None admin] PATH_INFO: `/v3/users/e5f9e6b69f804e189711377732f72454` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:43:31.967619 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551460a7-dc79-4c1b-b35a-c002d990a46b None admin] RBAC: Authorizing `identity:get_user(user_id=e5f9e6b69f804e189711377732f72454)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:43:31.969018 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551460a7-dc79-4c1b-b35a-c002d990a46b None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:43:31.970564 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 558/1121] 10.222.0.57 () {56 vars in 1177 bytes} [Fri Sep 16 07:43:31 2022] GET /identity/v3/users/e5f9e6b69f804e189711377732f72454 => generated 286 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:43:31.976378 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18380724-2b4f-423a-bea2-a16345f227eb None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:43:32.000501 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:43:32.073321 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18380724-2b4f-423a-bea2-a16345f227eb None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:43:32.106305 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40145a32-1265-4d2e-bcd9-0b09285cde77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:43:32.106925 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40145a32-1265-4d2e-bcd9-0b09285cde77 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:43:32.107199 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40145a32-1265-4d2e-bcd9-0b09285cde77 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:43:32.107465 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40145a32-1265-4d2e-bcd9-0b09285cde77 None admin] PATH_INFO: `/v3/projects/51ee3784f4c5484ebf6953539855bc83` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:43:32.108552 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40145a32-1265-4d2e-bcd9-0b09285cde77 None admin] RBAC: Authorizing `identity:get_project(project_id=51ee3784f4c5484ebf6953539855bc83)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:43:32.109986 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40145a32-1265-4d2e-bcd9-0b09285cde77 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:43:32.111567 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 564/1122] 10.222.0.57 () {56 vars in 1186 bytes} [Fri Sep 16 07:43:31 2022] GET /identity/v3/projects/51ee3784f4c5484ebf6953539855bc83 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:43:32.118009 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551460a7-dc79-4c1b-b35a-c002d990a46b None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:43:32.200466 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:43:32.214633 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551460a7-dc79-4c1b-b35a-c002d990a46b None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:43:32.247129 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1f1d53-8d92-41f7-bfe5-fbb9fcf7e553 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:43:32.247709 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1f1d53-8d92-41f7-bfe5-fbb9fcf7e553 None admin] REQUEST_METHOD: `PUT` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:43:32.247985 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1f1d53-8d92-41f7-bfe5-fbb9fcf7e553 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:43:32.248258 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1f1d53-8d92-41f7-bfe5-fbb9fcf7e553 None admin] PATH_INFO: `/v3/projects/51ee3784f4c5484ebf6953539855bc83/users/e5f9e6b69f804e189711377732f72454/roles/e92664bc677b40769b7a05d102541bf0` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:43:32.250376 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1f1d53-8d92-41f7-bfe5-fbb9fcf7e553 None admin] RBAC: Authorizing `identity:create_grant(project_id=51ee3784f4c5484ebf6953539855bc83, user_id=e5f9e6b69f804e189711377732f72454, role_id=e92664bc677b40769b7a05d102541bf0)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:43:32.251800 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1f1d53-8d92-41f7-bfe5-fbb9fcf7e553 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:43:32.264366 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 559/1123] 10.222.0.57 () {58 vars in 1439 bytes} [Fri Sep 16 07:43:32 2022] PUT /identity/v3/projects/51ee3784f4c5484ebf6953539855bc83/users/e5f9e6b69f804e189711377732f72454/roles/e92664bc677b40769b7a05d102541bf0 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 07:43:34.379361 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd037bd-8723-44bd-8c20-b349a84b5458 None None] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:43:34.379877 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd037bd-8723-44bd-8c20-b349a84b5458 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:43:34.379877 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd037bd-8723-44bd-8c20-b349a84b5458 None None] PATH_INFO: `/` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:43:34.381126 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 565/1124] 10.222.0.57 () {54 vars in 927 bytes} [Fri Sep 16 07:43:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 07:43:34.386491 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee6b6ee-0bc7-4569-bdc1-16793b55f7d0 None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:43:34.386889 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee6b6ee-0bc7-4569-bdc1-16793b55f7d0 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:43:34.387033 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee6b6ee-0bc7-4569-bdc1-16793b55f7d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:43:34.405299 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-6ee6b6ee-0bc7-4569-bdc1-16793b55f7d0 None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:43:34.406525 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-6ee6b6ee-0bc7-4569-bdc1-16793b55f7d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:43:34.471602 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 560/1125] 10.222.0.57 () {58 vars in 1024 bytes} [Fri Sep 16 07:43:34 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 16 07:43:34.743121 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd037bd-8723-44bd-8c20-b349a84b5458 None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:43:34.834148 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:43:34.844648 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd037bd-8723-44bd-8c20-b349a84b5458 None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:43:34.877541 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93fd2c7-76a1-4f84-a2b9-073e3ea44d81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:43:34.878453 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93fd2c7-76a1-4f84-a2b9-073e3ea44d81 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:43:34.878733 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93fd2c7-76a1-4f84-a2b9-073e3ea44d81 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:43:34.879007 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93fd2c7-76a1-4f84-a2b9-073e3ea44d81 None admin] PATH_INFO: `/v3/roles/e92664bc677b40769b7a05d102541bf0` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:43:34.880389 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93fd2c7-76a1-4f84-a2b9-073e3ea44d81 None admin] RBAC: Authorizing `identity:get_role(role_id=e92664bc677b40769b7a05d102541bf0)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:43:34.882567 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93fd2c7-76a1-4f84-a2b9-073e3ea44d81 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:43:34.883876 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 566/1126] 10.222.0.57 () {56 vars in 1177 bytes} [Fri Sep 16 07:43:34 2022] GET /identity/v3/roles/e92664bc677b40769b7a05d102541bf0 => generated 223 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:43:34.889671 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee6b6ee-0bc7-4569-bdc1-16793b55f7d0 None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:43:34.965924 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:43:34.989360 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee6b6ee-0bc7-4569-bdc1-16793b55f7d0 None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:43:35.023658 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a71784-1bcf-447f-86f4-6e6e9ef6eaff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:43:35.024211 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a71784-1bcf-447f-86f4-6e6e9ef6eaff None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:43:35.024490 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a71784-1bcf-447f-86f4-6e6e9ef6eaff None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:43:35.024764 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a71784-1bcf-447f-86f4-6e6e9ef6eaff None admin] PATH_INFO: `/v3/users/e5f9e6b69f804e189711377732f72454` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:43:35.025900 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a71784-1bcf-447f-86f4-6e6e9ef6eaff None admin] RBAC: Authorizing `identity:get_user(user_id=e5f9e6b69f804e189711377732f72454)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:43:35.027331 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a71784-1bcf-447f-86f4-6e6e9ef6eaff None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:43:35.028889 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 561/1127] 10.222.0.57 () {56 vars in 1177 bytes} [Fri Sep 16 07:43:34 2022] GET /identity/v3/users/e5f9e6b69f804e189711377732f72454 => generated 286 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:43:35.034671 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93fd2c7-76a1-4f84-a2b9-073e3ea44d81 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:43:35.132031 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93fd2c7-76a1-4f84-a2b9-073e3ea44d81 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:43:35.164270 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375ba1f4-7a25-4b42-af96-72dce6e2f6c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:43:35.164848 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375ba1f4-7a25-4b42-af96-72dce6e2f6c8 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:43:35.165122 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375ba1f4-7a25-4b42-af96-72dce6e2f6c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:43:35.165388 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375ba1f4-7a25-4b42-af96-72dce6e2f6c8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:43:35.191673 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:43:35.230024 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375ba1f4-7a25-4b42-af96-72dce6e2f6c8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:43:35.231503 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375ba1f4-7a25-4b42-af96-72dce6e2f6c8 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:43:35.325387 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 567/1128] 10.222.0.57 () {58 vars in 1282 bytes} [Fri Sep 16 07:43:35 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 16 07:43:35.331224 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a71784-1bcf-447f-86f4-6e6e9ef6eaff None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:43:35.427565 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a71784-1bcf-447f-86f4-6e6e9ef6eaff None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:43:35.460657 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bd2af5-e761-4c8d-b4f1-431189b29575 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:43:35.461261 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bd2af5-e761-4c8d-b4f1-431189b29575 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:43:35.461537 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bd2af5-e761-4c8d-b4f1-431189b29575 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:43:35.461835 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bd2af5-e761-4c8d-b4f1-431189b29575 None admin] PATH_INFO: `/v3/projects/51ee3784f4c5484ebf6953539855bc83` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:43:35.462934 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63bd2af5-e761-4c8d-b4f1-431189b29575 None admin] RBAC: Authorizing `identity:get_project(project_id=51ee3784f4c5484ebf6953539855bc83)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:43:35.464348 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63bd2af5-e761-4c8d-b4f1-431189b29575 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:43:35.465968 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 562/1129] 10.222.0.57 () {56 vars in 1186 bytes} [Fri Sep 16 07:43:35 2022] GET /identity/v3/projects/51ee3784f4c5484ebf6953539855bc83 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:43:35.472080 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375ba1f4-7a25-4b42-af96-72dce6e2f6c8 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:43:35.528529 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:43:35.567680 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375ba1f4-7a25-4b42-af96-72dce6e2f6c8 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:43:35.599634 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d050662-e271-429f-88f2-c3c427039bee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:43:35.600686 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d050662-e271-429f-88f2-c3c427039bee None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:43:35.600959 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d050662-e271-429f-88f2-c3c427039bee None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:43:35.601230 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d050662-e271-429f-88f2-c3c427039bee None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:43:35.601966 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d050662-e271-429f-88f2-c3c427039bee None admin] RBAC: Adding query filter params (role.id=e92664bc677b40769b7a05d102541bf0, scope.project.id=51ee3784f4c5484ebf6953539855bc83, user.id=e5f9e6b69f804e189711377732f72454) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:43:35.602272 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d050662-e271-429f-88f2-c3c427039bee None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:43:35.603677 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d050662-e271-429f-88f2-c3c427039bee None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:43:35.609172 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 568/1130] 10.222.0.57 () {56 vars in 1374 bytes} [Fri Sep 16 07:43:35 2022] GET /identity/v3/role_assignments?user.id=e5f9e6b69f804e189711377732f72454&scope.project.id=51ee3784f4c5484ebf6953539855bc83&role.id=e92664bc677b40769b7a05d102541bf0 => generated 608 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:43:37.822510 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88f7911-492b-4ad8-9a26-ae383e9dd13e None None] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:43:37.823075 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88f7911-492b-4ad8-9a26-ae383e9dd13e None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:43:37.823075 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88f7911-492b-4ad8-9a26-ae383e9dd13e None None] PATH_INFO: `/` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:43:37.824369 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 563/1131] 10.222.0.57 () {54 vars in 927 bytes} [Fri Sep 16 07:43:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 07:43:37.829518 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3549ad73-0a78-4293-937a-7f42ef4babbf None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:43:37.829958 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3549ad73-0a78-4293-937a-7f42ef4babbf None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:43:37.830101 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3549ad73-0a78-4293-937a-7f42ef4babbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:43:37.847949 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-3549ad73-0a78-4293-937a-7f42ef4babbf None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:43:37.849132 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-3549ad73-0a78-4293-937a-7f42ef4babbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:43:37.914233 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 569/1132] 10.222.0.57 () {58 vars in 1024 bytes} [Fri Sep 16 07:43:37 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 16 07:43:38.186937 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88f7911-492b-4ad8-9a26-ae383e9dd13e None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:43:38.201531 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:43:38.286878 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88f7911-492b-4ad8-9a26-ae383e9dd13e None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:43:38.319431 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb50353-40ae-44d7-adc4-d423a0067c99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:43:38.320031 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb50353-40ae-44d7-adc4-d423a0067c99 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:43:38.320302 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb50353-40ae-44d7-adc4-d423a0067c99 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:43:38.320567 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb50353-40ae-44d7-adc4-d423a0067c99 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:43:38.321656 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb50353-40ae-44d7-adc4-d423a0067c99 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:43:38.323085 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb50353-40ae-44d7-adc4-d423a0067c99 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:43:38.324609 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 564/1133] 10.222.0.57 () {56 vars in 1108 bytes} [Fri Sep 16 07:43:38 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:43:38.330480 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3549ad73-0a78-4293-937a-7f42ef4babbf None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:43:38.384596 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:43:38.428943 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3549ad73-0a78-4293-937a-7f42ef4babbf None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:43:38.462693 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709d3d7c-0f2f-43a3-a51f-e576e4033cb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:43:38.463288 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709d3d7c-0f2f-43a3-a51f-e576e4033cb2 None admin] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:43:38.463565 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709d3d7c-0f2f-43a3-a51f-e576e4033cb2 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:43:38.463836 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709d3d7c-0f2f-43a3-a51f-e576e4033cb2 None admin] PATH_INFO: `/v3/projects` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:43:38.464489 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709d3d7c-0f2f-43a3-a51f-e576e4033cb2 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:43:38.465933 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709d3d7c-0f2f-43a3-a51f-e576e4033cb2 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:43:38.491012 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 570/1134] 10.222.0.57 () {60 vars in 1141 bytes} [Fri Sep 16 07:43:38 2022] POST /identity/v3/projects => generated 311 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 07:43:40.655155 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b06d92-f0b2-4d4f-8677-ba96fb8f3e95 None None] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:43:40.655673 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b06d92-f0b2-4d4f-8677-ba96fb8f3e95 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:43:40.655767 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b06d92-f0b2-4d4f-8677-ba96fb8f3e95 None None] PATH_INFO: `/` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:43:40.657035 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 565/1135] 10.222.0.57 () {54 vars in 927 bytes} [Fri Sep 16 07:43:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 07:43:40.662213 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e388a7-56d0-4a37-8623-7870891a3804 None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:43:40.663089 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e388a7-56d0-4a37-8623-7870891a3804 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:43:40.663325 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e388a7-56d0-4a37-8623-7870891a3804 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:43:40.681156 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-e0e388a7-56d0-4a37-8623-7870891a3804 None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:43:40.682363 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-e0e388a7-56d0-4a37-8623-7870891a3804 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:43:40.745709 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 571/1136] 10.222.0.57 () {58 vars in 1024 bytes} [Fri Sep 16 07:43:40 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 16 07:43:41.013648 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b06d92-f0b2-4d4f-8677-ba96fb8f3e95 None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:43:41.093381 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:43:41.113064 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b06d92-f0b2-4d4f-8677-ba96fb8f3e95 None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:43:41.146435 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0210441-5771-44b6-8a6f-b3b87d20d4e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:43:41.147124 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0210441-5771-44b6-8a6f-b3b87d20d4e3 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:43:41.147399 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0210441-5771-44b6-8a6f-b3b87d20d4e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:43:41.147665 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0210441-5771-44b6-8a6f-b3b87d20d4e3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:43:41.148752 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0210441-5771-44b6-8a6f-b3b87d20d4e3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:43:41.150199 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0210441-5771-44b6-8a6f-b3b87d20d4e3 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:43:41.151736 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 566/1137] 10.222.0.57 () {56 vars in 1108 bytes} [Fri Sep 16 07:43:41 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:43:41.157424 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e388a7-56d0-4a37-8623-7870891a3804 None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:43:41.190967 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:43:41.254255 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e388a7-56d0-4a37-8623-7870891a3804 None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:43:41.286822 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8235be2-1fed-4021-824f-a638a046c5a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:43:41.287501 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8235be2-1fed-4021-824f-a638a046c5a3 None admin] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:43:41.287872 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8235be2-1fed-4021-824f-a638a046c5a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:43:41.288146 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8235be2-1fed-4021-824f-a638a046c5a3 None admin] PATH_INFO: `/v3/users` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:43:41.288784 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8235be2-1fed-4021-824f-a638a046c5a3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:43:41.290242 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8235be2-1fed-4021-824f-a638a046c5a3 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:43:41.311490 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 572/1138] 10.222.0.57 () {60 vars in 1132 bytes} [Fri Sep 16 07:43:41 2022] POST /identity/v3/users => generated 286 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 07:43:43.465821 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3743409-eb53-426f-9380-c54c8ce139d8 None None] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:43:43.466314 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3743409-eb53-426f-9380-c54c8ce139d8 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:43:43.466314 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3743409-eb53-426f-9380-c54c8ce139d8 None None] PATH_INFO: `/` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:43:43.467622 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 567/1139] 10.222.0.57 () {54 vars in 927 bytes} [Fri Sep 16 07:43:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 07:43:43.472897 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2238507f-b057-49ed-852a-0e26067ba94e None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:43:43.473264 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2238507f-b057-49ed-852a-0e26067ba94e None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:43:43.473432 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2238507f-b057-49ed-852a-0e26067ba94e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:43:43.491660 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-2238507f-b057-49ed-852a-0e26067ba94e None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:43:43.492826 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-2238507f-b057-49ed-852a-0e26067ba94e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:43:43.556543 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 573/1140] 10.222.0.57 () {58 vars in 1024 bytes} [Fri Sep 16 07:43:43 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 16 07:43:43.827205 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3743409-eb53-426f-9380-c54c8ce139d8 None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:43:43.925472 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3743409-eb53-426f-9380-c54c8ce139d8 None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:43:43.957936 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7c7cb6-7a72-4355-8959-05b854587c41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:43:43.958548 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7c7cb6-7a72-4355-8959-05b854587c41 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:43:43.958843 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7c7cb6-7a72-4355-8959-05b854587c41 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:43:43.959115 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7c7cb6-7a72-4355-8959-05b854587c41 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:43:43.968919 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7c7cb6-7a72-4355-8959-05b854587c41 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 07:43:43.973635 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application [None req-6e7c7cb6-7a72-4355-8959-05b854587c41 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 16 07:43:43.973635 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 07:43:43.973635 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 07:43:43.973635 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 07:43:43.973635 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 07:43:43.973635 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 07:43:43.973635 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 07:43:43.973635 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 07:43:43.973635 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 07:43:43.973635 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 07:43:43.973635 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 07:43:43.973635 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 07:43:43.973635 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 07:43:43.973635 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 07:43:43.973635 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 07:43:43.973635 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 07:43:43.975283 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 07:43:43.975283 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 07:43:43.975283 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 07:43:43.975283 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 07:43:43.975283 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 07:43:43.975283 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 07:43:43.975283 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 07:43:43.975283 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 07:43:43.975283 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 07:43:43.975283 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 07:43:43.975283 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 07:43:43.975283 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application with Lock( Sep 16 07:43:43.975283 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 07:43:43.975283 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._enter() Sep 16 07:43:43.975283 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 07:43:43.975283 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 07:43:43.976372 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 07:43:43.976372 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.creator() Sep 16 07:43:43.976372 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 07:43:43.976372 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application created_value = creator( Sep 16 07:43:43.976372 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 07:43:43.976372 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 07:43:43.976372 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 07:43:43.976372 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 07:43:43.976372 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 07:43:43.976372 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 07:43:43.976372 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 16 07:43:43.976372 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Sep 16 07:43:43.976372 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 568/1141] 10.222.0.57 () {56 vars in 1096 bytes} [Fri Sep 16 07:43:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 07:43:43.981292 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2238507f-b057-49ed-852a-0e26067ba94e None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:43:44.004741 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:43:44.077859 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2238507f-b057-49ed-852a-0e26067ba94e None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:43:44.111363 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16db209-84b9-4774-90ab-b59f58e18b0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:43:44.111966 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16db209-84b9-4774-90ab-b59f58e18b0c None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:43:44.112247 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16db209-84b9-4774-90ab-b59f58e18b0c None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:43:44.112520 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16db209-84b9-4774-90ab-b59f58e18b0c None admin] PATH_INFO: `/v3/roles` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:43:44.113180 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16db209-84b9-4774-90ab-b59f58e18b0c None admin] RBAC: Adding query filter params (name=admin) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:43:44.113487 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16db209-84b9-4774-90ab-b59f58e18b0c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:43:44.114877 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16db209-84b9-4774-90ab-b59f58e18b0c None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:43:44.123953 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 574/1142] 10.222.0.57 () {56 vars in 1099 bytes} [Fri Sep 16 07:43:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:43:44.130112 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7c7cb6-7a72-4355-8959-05b854587c41 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:43:44.144134 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:43:44.231784 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7c7cb6-7a72-4355-8959-05b854587c41 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:43:44.264203 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88d9d95-aa14-47b2-a8d6-fe549560c9ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:43:44.264818 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88d9d95-aa14-47b2-a8d6-fe549560c9ea None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:43:44.265092 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88d9d95-aa14-47b2-a8d6-fe549560c9ea None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:43:44.265361 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88d9d95-aa14-47b2-a8d6-fe549560c9ea None admin] PATH_INFO: `/v3/users/914553de29d94b128ab49779d546d6e7` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:43:44.278442 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88d9d95-aa14-47b2-a8d6-fe549560c9ea None admin] RBAC: Authorizing `identity:get_user(user_id=914553de29d94b128ab49779d546d6e7)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:43:44.279868 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88d9d95-aa14-47b2-a8d6-fe549560c9ea None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:43:44.281438 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 569/1143] 10.222.0.57 () {56 vars in 1177 bytes} [Fri Sep 16 07:43:44 2022] GET /identity/v3/users/914553de29d94b128ab49779d546d6e7 => generated 286 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:43:44.287846 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16db209-84b9-4774-90ab-b59f58e18b0c None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:43:44.367844 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:43:44.383357 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16db209-84b9-4774-90ab-b59f58e18b0c None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:43:44.416231 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88747fb6-677c-4726-95da-533b4be8c3cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:43:44.416848 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88747fb6-677c-4726-95da-533b4be8c3cc None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:43:44.417125 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88747fb6-677c-4726-95da-533b4be8c3cc None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:43:44.417401 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88747fb6-677c-4726-95da-533b4be8c3cc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:43:44.481829 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88747fb6-677c-4726-95da-533b4be8c3cc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:43:44.483254 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88747fb6-677c-4726-95da-533b4be8c3cc None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:43:44.561965 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:43:44.578503 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 575/1144] 10.222.0.57 () {58 vars in 1282 bytes} [Fri Sep 16 07:43:44 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 16 07:43:44.585159 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88d9d95-aa14-47b2-a8d6-fe549560c9ea None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:43:44.647717 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:43:44.680974 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88d9d95-aa14-47b2-a8d6-fe549560c9ea None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:43:44.714296 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c61ead-1775-4b0a-a5ce-291c75bf8351 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:43:44.714907 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c61ead-1775-4b0a-a5ce-291c75bf8351 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:43:44.715180 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c61ead-1775-4b0a-a5ce-291c75bf8351 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:43:44.715444 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c61ead-1775-4b0a-a5ce-291c75bf8351 None admin] PATH_INFO: `/v3/projects/4da3c875986041ce9db2cb663a104c12` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:43:44.716522 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c61ead-1775-4b0a-a5ce-291c75bf8351 None admin] RBAC: Authorizing `identity:get_project(project_id=4da3c875986041ce9db2cb663a104c12)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:43:44.717950 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c61ead-1775-4b0a-a5ce-291c75bf8351 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:43:44.719539 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 570/1145] 10.222.0.57 () {56 vars in 1186 bytes} [Fri Sep 16 07:43:44 2022] GET /identity/v3/projects/4da3c875986041ce9db2cb663a104c12 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:43:44.725788 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88747fb6-677c-4726-95da-533b4be8c3cc None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:43:44.821952 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88747fb6-677c-4726-95da-533b4be8c3cc None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:43:44.854034 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbf219c-58a3-4e98-9c6b-7ea70a4c227e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:43:44.854620 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbf219c-58a3-4e98-9c6b-7ea70a4c227e None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:43:44.854897 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbf219c-58a3-4e98-9c6b-7ea70a4c227e None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:43:44.855169 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbf219c-58a3-4e98-9c6b-7ea70a4c227e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:43:44.855883 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbf219c-58a3-4e98-9c6b-7ea70a4c227e None admin] RBAC: Adding query filter params (role.id=567db03c91854ad9af1e9a87ec1bd275, scope.project.id=4da3c875986041ce9db2cb663a104c12, user.id=914553de29d94b128ab49779d546d6e7) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:43:44.856186 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbf219c-58a3-4e98-9c6b-7ea70a4c227e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:43:44.857589 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbf219c-58a3-4e98-9c6b-7ea70a4c227e None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:43:44.862734 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 576/1146] 10.222.0.57 () {56 vars in 1374 bytes} [Fri Sep 16 07:43:44 2022] GET /identity/v3/role_assignments?user.id=914553de29d94b128ab49779d546d6e7&scope.project.id=4da3c875986041ce9db2cb663a104c12&role.id=567db03c91854ad9af1e9a87ec1bd275 => generated 259 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:43:46.957182 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46c7fe7-37aa-4b04-8d49-b411eee506b6 None None] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:43:46.957806 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46c7fe7-37aa-4b04-8d49-b411eee506b6 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:43:46.957806 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46c7fe7-37aa-4b04-8d49-b411eee506b6 None None] PATH_INFO: `/` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:43:46.959904 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 571/1147] 10.222.0.57 () {54 vars in 927 bytes} [Fri Sep 16 07:43:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 07:43:46.964912 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c888c176-7931-47bd-970c-ab4d67ed72dd None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:43:46.965365 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c888c176-7931-47bd-970c-ab4d67ed72dd None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:43:46.965466 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c888c176-7931-47bd-970c-ab4d67ed72dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:43:46.983564 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-c888c176-7931-47bd-970c-ab4d67ed72dd None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:43:46.984741 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-c888c176-7931-47bd-970c-ab4d67ed72dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:43:47.027204 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:43:47.049844 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 577/1148] 10.222.0.57 () {58 vars in 1024 bytes} [Fri Sep 16 07:43:46 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 16 07:43:47.324629 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46c7fe7-37aa-4b04-8d49-b411eee506b6 None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:43:47.422730 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46c7fe7-37aa-4b04-8d49-b411eee506b6 None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:43:47.456168 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7616468e-91bd-4b56-95a7-86f865c16544 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:43:47.456779 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7616468e-91bd-4b56-95a7-86f865c16544 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:43:47.457058 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7616468e-91bd-4b56-95a7-86f865c16544 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:43:47.457333 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7616468e-91bd-4b56-95a7-86f865c16544 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:43:47.459458 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:43:47.468513 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7616468e-91bd-4b56-95a7-86f865c16544 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 07:43:47.473244 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application [None req-7616468e-91bd-4b56-95a7-86f865c16544 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 16 07:43:47.473244 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 07:43:47.473244 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 07:43:47.473244 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 07:43:47.473244 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 07:43:47.473244 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 07:43:47.473244 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 07:43:47.473244 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 07:43:47.473244 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 07:43:47.473244 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 07:43:47.473244 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 07:43:47.473244 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 07:43:47.473244 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 07:43:47.473244 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 07:43:47.473244 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 07:43:47.473244 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 07:43:47.474946 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 07:43:47.474946 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 07:43:47.474946 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 07:43:47.474946 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 07:43:47.474946 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 07:43:47.474946 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 07:43:47.474946 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 07:43:47.474946 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 07:43:47.474946 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 07:43:47.474946 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 07:43:47.474946 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 07:43:47.474946 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application with Lock( Sep 16 07:43:47.474946 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 07:43:47.474946 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._enter() Sep 16 07:43:47.474946 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 07:43:47.474946 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 07:43:47.475944 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 07:43:47.475944 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.creator() Sep 16 07:43:47.475944 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 07:43:47.475944 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application created_value = creator( Sep 16 07:43:47.475944 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 07:43:47.475944 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 07:43:47.475944 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 07:43:47.475944 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 07:43:47.475944 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 07:43:47.475944 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 07:43:47.475944 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 16 07:43:47.475944 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Sep 16 07:43:47.475944 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 572/1149] 10.222.0.57 () {56 vars in 1096 bytes} [Fri Sep 16 07:43:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 07:43:47.480797 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c888c176-7931-47bd-970c-ab4d67ed72dd None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:43:47.577082 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c888c176-7931-47bd-970c-ab4d67ed72dd None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:43:47.610014 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c11ce2-f361-4850-855c-6e412ce73981 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:43:47.610608 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c11ce2-f361-4850-855c-6e412ce73981 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:43:47.610888 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c11ce2-f361-4850-855c-6e412ce73981 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:43:47.611160 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c11ce2-f361-4850-855c-6e412ce73981 None admin] PATH_INFO: `/v3/roles` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:43:47.611813 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c11ce2-f361-4850-855c-6e412ce73981 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:43:47.612117 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c11ce2-f361-4850-855c-6e412ce73981 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:43:47.613476 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c11ce2-f361-4850-855c-6e412ce73981 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:43:47.621922 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 578/1150] 10.222.0.57 () {56 vars in 1099 bytes} [Fri Sep 16 07:43:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:43:47.627945 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7616468e-91bd-4b56-95a7-86f865c16544 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:43:47.725167 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7616468e-91bd-4b56-95a7-86f865c16544 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:43:47.758672 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec00874-65cd-4226-8a2a-4278ac29cc15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:43:47.759280 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec00874-65cd-4226-8a2a-4278ac29cc15 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:43:47.759556 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec00874-65cd-4226-8a2a-4278ac29cc15 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:43:47.759825 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec00874-65cd-4226-8a2a-4278ac29cc15 None admin] PATH_INFO: `/v3/users/914553de29d94b128ab49779d546d6e7` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:43:47.760923 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec00874-65cd-4226-8a2a-4278ac29cc15 None admin] RBAC: Authorizing `identity:get_user(user_id=914553de29d94b128ab49779d546d6e7)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:43:47.762368 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec00874-65cd-4226-8a2a-4278ac29cc15 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:43:47.763913 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 573/1151] 10.222.0.57 () {56 vars in 1177 bytes} [Fri Sep 16 07:43:47 2022] GET /identity/v3/users/914553de29d94b128ab49779d546d6e7 => generated 286 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:43:47.769588 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c11ce2-f361-4850-855c-6e412ce73981 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:43:47.810549 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:43:47.866418 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c11ce2-f361-4850-855c-6e412ce73981 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:43:47.898885 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4998b3-7bd4-4ad2-a3a3-0de47c64f4b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:43:47.899496 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4998b3-7bd4-4ad2-a3a3-0de47c64f4b1 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:43:47.899774 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4998b3-7bd4-4ad2-a3a3-0de47c64f4b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:43:47.900048 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4998b3-7bd4-4ad2-a3a3-0de47c64f4b1 None admin] PATH_INFO: `/v3/projects/4da3c875986041ce9db2cb663a104c12` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:43:47.901160 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4998b3-7bd4-4ad2-a3a3-0de47c64f4b1 None admin] RBAC: Authorizing `identity:get_project(project_id=4da3c875986041ce9db2cb663a104c12)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:43:47.902609 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4998b3-7bd4-4ad2-a3a3-0de47c64f4b1 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:43:47.904198 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 579/1152] 10.222.0.57 () {56 vars in 1186 bytes} [Fri Sep 16 07:43:47 2022] GET /identity/v3/projects/4da3c875986041ce9db2cb663a104c12 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:43:47.910209 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec00874-65cd-4226-8a2a-4278ac29cc15 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:43:47.969802 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:43:48.007800 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec00874-65cd-4226-8a2a-4278ac29cc15 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:43:48.040887 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643c989e-e546-466f-8213-461dc50b1857 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:43:48.041524 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643c989e-e546-466f-8213-461dc50b1857 None admin] REQUEST_METHOD: `PUT` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:43:48.041830 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643c989e-e546-466f-8213-461dc50b1857 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:43:48.042102 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643c989e-e546-466f-8213-461dc50b1857 None admin] PATH_INFO: `/v3/projects/4da3c875986041ce9db2cb663a104c12/users/914553de29d94b128ab49779d546d6e7/roles/567db03c91854ad9af1e9a87ec1bd275` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:43:48.043971 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643c989e-e546-466f-8213-461dc50b1857 None admin] RBAC: Authorizing `identity:create_grant(project_id=4da3c875986041ce9db2cb663a104c12, user_id=914553de29d94b128ab49779d546d6e7, role_id=567db03c91854ad9af1e9a87ec1bd275)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:43:48.045379 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643c989e-e546-466f-8213-461dc50b1857 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:43:48.057698 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 574/1153] 10.222.0.57 () {58 vars in 1439 bytes} [Fri Sep 16 07:43:47 2022] PUT /identity/v3/projects/4da3c875986041ce9db2cb663a104c12/users/914553de29d94b128ab49779d546d6e7/roles/567db03c91854ad9af1e9a87ec1bd275 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 07:43:50.186164 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81db0ef6-f239-48e5-b8c2-c5cae676454c None None] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:43:50.186684 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81db0ef6-f239-48e5-b8c2-c5cae676454c None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:43:50.186684 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81db0ef6-f239-48e5-b8c2-c5cae676454c None None] PATH_INFO: `/` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:43:50.188005 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 580/1154] 10.222.0.57 () {54 vars in 927 bytes} [Fri Sep 16 07:43:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 07:43:50.193382 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08d2c3e-1697-4795-95fc-4cbba96ef66c None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:43:50.193988 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08d2c3e-1697-4795-95fc-4cbba96ef66c None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:43:50.193988 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08d2c3e-1697-4795-95fc-4cbba96ef66c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:43:50.212822 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-b08d2c3e-1697-4795-95fc-4cbba96ef66c None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:43:50.214066 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-b08d2c3e-1697-4795-95fc-4cbba96ef66c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:43:50.278904 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 575/1155] 10.222.0.57 () {58 vars in 1024 bytes} [Fri Sep 16 07:43:50 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 16 07:43:50.548957 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81db0ef6-f239-48e5-b8c2-c5cae676454c None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:43:50.649912 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81db0ef6-f239-48e5-b8c2-c5cae676454c None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:43:50.658354 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:43:50.683464 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52362ec-94dc-4d2e-a23e-bbb8cdfe42ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:43:50.684081 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52362ec-94dc-4d2e-a23e-bbb8cdfe42ab None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:43:50.684358 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52362ec-94dc-4d2e-a23e-bbb8cdfe42ab None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:43:50.684625 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52362ec-94dc-4d2e-a23e-bbb8cdfe42ab None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:43:50.694771 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52362ec-94dc-4d2e-a23e-bbb8cdfe42ab None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 07:43:50.699476 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application [None req-b52362ec-94dc-4d2e-a23e-bbb8cdfe42ab None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 16 07:43:50.699476 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 07:43:50.699476 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 07:43:50.699476 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 07:43:50.699476 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 07:43:50.699476 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 07:43:50.699476 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 07:43:50.699476 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 07:43:50.699476 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 07:43:50.699476 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 07:43:50.699476 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 07:43:50.699476 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 07:43:50.699476 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 07:43:50.699476 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 07:43:50.699476 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 07:43:50.699476 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 07:43:50.700568 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 07:43:50.700568 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 07:43:50.700568 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 07:43:50.700568 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 07:43:50.700568 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 07:43:50.700568 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 07:43:50.700568 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 07:43:50.700568 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 07:43:50.700568 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 07:43:50.700568 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 07:43:50.700568 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 07:43:50.700568 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application with Lock( Sep 16 07:43:50.700568 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 07:43:50.700568 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._enter() Sep 16 07:43:50.700568 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 07:43:50.700568 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 07:43:50.701620 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 07:43:50.701620 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.creator() Sep 16 07:43:50.701620 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 07:43:50.701620 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application created_value = creator( Sep 16 07:43:50.701620 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 07:43:50.701620 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 07:43:50.701620 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 07:43:50.701620 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 07:43:50.701620 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 07:43:50.701620 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 07:43:50.701620 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 16 07:43:50.701620 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Sep 16 07:43:50.701620 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 581/1156] 10.222.0.57 () {56 vars in 1096 bytes} [Fri Sep 16 07:43:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 07:43:50.706791 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08d2c3e-1697-4795-95fc-4cbba96ef66c None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:43:50.758661 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:43:50.804920 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08d2c3e-1697-4795-95fc-4cbba96ef66c None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:43:50.839972 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b071c6-6b2d-44a9-829b-ab60924cf6e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:43:50.840571 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b071c6-6b2d-44a9-829b-ab60924cf6e2 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:43:50.840850 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b071c6-6b2d-44a9-829b-ab60924cf6e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:43:50.841122 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b071c6-6b2d-44a9-829b-ab60924cf6e2 None admin] PATH_INFO: `/v3/roles` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:43:50.841813 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b071c6-6b2d-44a9-829b-ab60924cf6e2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:43:50.842117 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b071c6-6b2d-44a9-829b-ab60924cf6e2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:43:50.843477 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b071c6-6b2d-44a9-829b-ab60924cf6e2 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:43:50.851842 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 576/1157] 10.222.0.57 () {56 vars in 1099 bytes} [Fri Sep 16 07:43:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:43:50.857934 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52362ec-94dc-4d2e-a23e-bbb8cdfe42ab None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:43:50.953936 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52362ec-94dc-4d2e-a23e-bbb8cdfe42ab None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:43:50.986762 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4bc87a-23f6-4416-94af-a33ba0c1116b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:43:50.987367 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4bc87a-23f6-4416-94af-a33ba0c1116b None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:43:50.987641 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4bc87a-23f6-4416-94af-a33ba0c1116b None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:43:50.987913 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4bc87a-23f6-4416-94af-a33ba0c1116b None admin] PATH_INFO: `/v3/users/914553de29d94b128ab49779d546d6e7` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:43:50.989014 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4bc87a-23f6-4416-94af-a33ba0c1116b None admin] RBAC: Authorizing `identity:get_user(user_id=914553de29d94b128ab49779d546d6e7)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:43:50.990517 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4bc87a-23f6-4416-94af-a33ba0c1116b None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:43:50.992049 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 582/1158] 10.222.0.57 () {56 vars in 1177 bytes} [Fri Sep 16 07:43:50 2022] GET /identity/v3/users/914553de29d94b128ab49779d546d6e7 => generated 286 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:43:50.997785 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b071c6-6b2d-44a9-829b-ab60924cf6e2 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:43:51.094916 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b071c6-6b2d-44a9-829b-ab60924cf6e2 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:43:51.108647 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:43:51.128640 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b279f3ee-c3a4-4470-8456-cd5d117c9fb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:43:51.129237 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b279f3ee-c3a4-4470-8456-cd5d117c9fb9 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:43:51.129511 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b279f3ee-c3a4-4470-8456-cd5d117c9fb9 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:43:51.129813 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b279f3ee-c3a4-4470-8456-cd5d117c9fb9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:43:51.195386 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b279f3ee-c3a4-4470-8456-cd5d117c9fb9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:43:51.196817 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b279f3ee-c3a4-4470-8456-cd5d117c9fb9 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:43:51.291750 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 577/1159] 10.222.0.57 () {58 vars in 1282 bytes} [Fri Sep 16 07:43:50 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 16 07:43:51.297780 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4bc87a-23f6-4416-94af-a33ba0c1116b None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:43:51.332461 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:43:51.394703 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4bc87a-23f6-4416-94af-a33ba0c1116b None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:43:51.426784 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6fb8dd-523f-4609-93e6-e0f587e1977b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:43:51.427590 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6fb8dd-523f-4609-93e6-e0f587e1977b None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:43:51.427934 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6fb8dd-523f-4609-93e6-e0f587e1977b None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:43:51.428208 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6fb8dd-523f-4609-93e6-e0f587e1977b None admin] PATH_INFO: `/v3/projects/4da3c875986041ce9db2cb663a104c12` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:43:51.429316 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6fb8dd-523f-4609-93e6-e0f587e1977b None admin] RBAC: Authorizing `identity:get_project(project_id=4da3c875986041ce9db2cb663a104c12)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:43:51.430761 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6fb8dd-523f-4609-93e6-e0f587e1977b None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:43:51.432339 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 583/1160] 10.222.0.57 () {56 vars in 1186 bytes} [Fri Sep 16 07:43:51 2022] GET /identity/v3/projects/4da3c875986041ce9db2cb663a104c12 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:43:51.438492 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b279f3ee-c3a4-4470-8456-cd5d117c9fb9 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:43:51.453558 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:43:51.534853 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b279f3ee-c3a4-4470-8456-cd5d117c9fb9 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:43:51.567840 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d4a355-37c7-4162-9f7b-0a39d8c208ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:43:51.568504 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d4a355-37c7-4162-9f7b-0a39d8c208ce None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:43:51.568778 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d4a355-37c7-4162-9f7b-0a39d8c208ce None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:43:51.569048 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d4a355-37c7-4162-9f7b-0a39d8c208ce None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:43:51.569775 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d4a355-37c7-4162-9f7b-0a39d8c208ce None admin] RBAC: Adding query filter params (role.id=567db03c91854ad9af1e9a87ec1bd275, scope.project.id=4da3c875986041ce9db2cb663a104c12, user.id=914553de29d94b128ab49779d546d6e7) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:43:51.570082 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d4a355-37c7-4162-9f7b-0a39d8c208ce None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:43:51.571490 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d4a355-37c7-4162-9f7b-0a39d8c208ce None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:43:51.577520 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 578/1161] 10.222.0.57 () {56 vars in 1374 bytes} [Fri Sep 16 07:43:51 2022] GET /identity/v3/role_assignments?user.id=914553de29d94b128ab49779d546d6e7&scope.project.id=4da3c875986041ce9db2cb663a104c12&role.id=567db03c91854ad9af1e9a87ec1bd275 => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:43:53.716296 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef39ac9-35cb-4f94-9316-f3cc1837343e None None] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:43:53.716861 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef39ac9-35cb-4f94-9316-f3cc1837343e None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:43:53.716861 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef39ac9-35cb-4f94-9316-f3cc1837343e None None] PATH_INFO: `/` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:43:53.718348 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 584/1162] 10.222.0.57 () {54 vars in 927 bytes} [Fri Sep 16 07:43:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 07:43:53.723464 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a82240-8bcf-4562-8bb3-a847fc36c1d4 None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:43:53.724339 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a82240-8bcf-4562-8bb3-a847fc36c1d4 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:43:53.724555 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a82240-8bcf-4562-8bb3-a847fc36c1d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:43:53.742835 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-76a82240-8bcf-4562-8bb3-a847fc36c1d4 None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:43:53.744015 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-76a82240-8bcf-4562-8bb3-a847fc36c1d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:43:53.808547 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 579/1163] 10.222.0.57 () {58 vars in 1024 bytes} [Fri Sep 16 07:43:53 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 16 07:43:54.078375 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef39ac9-35cb-4f94-9316-f3cc1837343e None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:43:54.178898 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef39ac9-35cb-4f94-9316-f3cc1837343e None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:43:54.181165 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:43:54.212491 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99529fe4-d2fd-4534-853c-a937f090195c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:43:54.213089 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99529fe4-d2fd-4534-853c-a937f090195c None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:43:54.213368 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99529fe4-d2fd-4534-853c-a937f090195c None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:43:54.213640 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99529fe4-d2fd-4534-853c-a937f090195c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:43:54.284796 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99529fe4-d2fd-4534-853c-a937f090195c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:43:54.286302 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99529fe4-d2fd-4534-853c-a937f090195c None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:43:54.381195 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 585/1164] 10.222.0.57 () {58 vars in 1282 bytes} [Fri Sep 16 07:43:54 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 16 07:43:54.387184 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a82240-8bcf-4562-8bb3-a847fc36c1d4 None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:43:54.397746 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:43:54.483691 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a82240-8bcf-4562-8bb3-a847fc36c1d4 None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:43:54.516214 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02bd8c8-0f0a-4b6a-829b-5a494408db8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:43:54.516831 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02bd8c8-0f0a-4b6a-829b-5a494408db8d None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:43:54.517107 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02bd8c8-0f0a-4b6a-829b-5a494408db8d None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:43:54.517374 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02bd8c8-0f0a-4b6a-829b-5a494408db8d None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:43:54.524333 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02bd8c8-0f0a-4b6a-829b-5a494408db8d None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:43:54.525822 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02bd8c8-0f0a-4b6a-829b-5a494408db8d None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:43:54.537105 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application [None req-d02bd8c8-0f0a-4b6a-829b-5a494408db8d None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Sep 16 07:43:54.537105 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 07:43:54.537105 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Sep 16 07:43:54.537105 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Sep 16 07:43:54.537105 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 16 07:43:54.537105 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 16 07:43:54.537105 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 16 07:43:54.537105 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 16 07:43:54.537105 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Sep 16 07:43:54.537105 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Sep 16 07:43:54.537105 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 16 07:43:54.537105 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Sep 16 07:43:54.537105 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 07:43:54.537105 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 07:43:54.537105 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 07:43:54.537105 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 07:43:54.537105 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 07:43:54.538337 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 07:43:54.538337 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 07:43:54.538337 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 07:43:54.538337 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 07:43:54.538337 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 07:43:54.538337 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 07:43:54.538337 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 07:43:54.538337 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 07:43:54.538337 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 07:43:54.538337 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 07:43:54.538337 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 07:43:54.538337 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 07:43:54.538337 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 07:43:54.538337 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 07:43:54.538337 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 07:43:54.538337 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 07:43:54.539222 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 07:43:54.539222 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application with Lock( Sep 16 07:43:54.539222 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 07:43:54.539222 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._enter() Sep 16 07:43:54.539222 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 07:43:54.539222 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 07:43:54.539222 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 07:43:54.539222 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.creator() Sep 16 07:43:54.539222 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 07:43:54.539222 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application created_value = creator( Sep 16 07:43:54.539222 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Sep 16 07:43:54.539222 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 07:43:54.539222 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Sep 16 07:43:54.539222 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Sep 16 07:43:54.539222 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 580/1165] 10.222.0.57 () {56 vars in 1117 bytes} [Fri Sep 16 07:43:54 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 07:43:54.544275 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99529fe4-d2fd-4534-853c-a937f090195c None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:43:54.547393 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:43:54.641907 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99529fe4-d2fd-4534-853c-a937f090195c None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:43:54.674839 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857664f0-0f9e-4f0d-b997-b3ae452e6b33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:43:54.675431 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857664f0-0f9e-4f0d-b997-b3ae452e6b33 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:43:54.675709 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857664f0-0f9e-4f0d-b997-b3ae452e6b33 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:43:54.675976 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857664f0-0f9e-4f0d-b997-b3ae452e6b33 None admin] PATH_INFO: `/v3/domains` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:43:54.676601 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857664f0-0f9e-4f0d-b997-b3ae452e6b33 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:43:54.677427 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857664f0-0f9e-4f0d-b997-b3ae452e6b33 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:43:54.678825 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857664f0-0f9e-4f0d-b997-b3ae452e6b33 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:43:54.685783 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 586/1166] 10.222.0.57 () {56 vars in 1115 bytes} [Fri Sep 16 07:43:54 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:43:56.840406 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1beae292-8549-46eb-a4b3-0ce09ca9e29c None None] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:43:56.840975 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1beae292-8549-46eb-a4b3-0ce09ca9e29c None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:43:56.840975 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1beae292-8549-46eb-a4b3-0ce09ca9e29c None None] PATH_INFO: `/` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:43:56.842308 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 581/1167] 10.222.0.57 () {54 vars in 927 bytes} [Fri Sep 16 07:43:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 07:43:56.847899 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8347f014-565e-442f-b9be-ed7b29af1150 None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:43:56.848328 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8347f014-565e-442f-b9be-ed7b29af1150 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:43:56.848430 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8347f014-565e-442f-b9be-ed7b29af1150 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:43:56.867356 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-8347f014-565e-442f-b9be-ed7b29af1150 None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:43:56.868586 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-8347f014-565e-442f-b9be-ed7b29af1150 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:43:56.935092 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:43:56.941367 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 587/1168] 10.222.0.57 () {58 vars in 1024 bytes} [Fri Sep 16 07:43:56 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 16 07:43:57.215487 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1beae292-8549-46eb-a4b3-0ce09ca9e29c None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:43:57.281974 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:43:57.316118 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1beae292-8549-46eb-a4b3-0ce09ca9e29c None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:43:57.349277 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da096f8-f821-45c4-b70f-7f816661b5dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:43:57.349883 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da096f8-f821-45c4-b70f-7f816661b5dd None admin] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:43:57.350158 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da096f8-f821-45c4-b70f-7f816661b5dd None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:43:57.350422 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da096f8-f821-45c4-b70f-7f816661b5dd None admin] PATH_INFO: `/v3/domains` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:43:57.351074 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da096f8-f821-45c4-b70f-7f816661b5dd None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:43:57.352418 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da096f8-f821-45c4-b70f-7f816661b5dd None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:43:57.367718 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 582/1169] 10.222.0.57 () {60 vars in 1138 bytes} [Fri Sep 16 07:43:57 2022] POST /identity/v3/domains => generated 267 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 07:43:59.520134 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be064e39-2fb8-4398-84f0-1f92909c99ac None None] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:43:59.520635 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be064e39-2fb8-4398-84f0-1f92909c99ac None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:43:59.520635 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be064e39-2fb8-4398-84f0-1f92909c99ac None None] PATH_INFO: `/` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:43:59.521986 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 588/1170] 10.222.0.57 () {54 vars in 927 bytes} [Fri Sep 16 07:43:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 07:43:59.527245 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e901591-7b2b-4bf8-a148-7bdbe74c1072 None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:43:59.527664 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e901591-7b2b-4bf8-a148-7bdbe74c1072 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:43:59.527800 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e901591-7b2b-4bf8-a148-7bdbe74c1072 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:43:59.546216 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-5e901591-7b2b-4bf8-a148-7bdbe74c1072 None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:43:59.547402 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-5e901591-7b2b-4bf8-a148-7bdbe74c1072 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:43:59.621642 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 583/1171] 10.222.0.57 () {58 vars in 1024 bytes} [Fri Sep 16 07:43:59 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 16 07:43:59.900651 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be064e39-2fb8-4398-84f0-1f92909c99ac None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:44:00.000532 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be064e39-2fb8-4398-84f0-1f92909c99ac None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:44:00.034124 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc5122d-7550-46ec-91cd-36988129902b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:44:00.034735 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc5122d-7550-46ec-91cd-36988129902b None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:44:00.035013 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc5122d-7550-46ec-91cd-36988129902b None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:44:00.035284 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc5122d-7550-46ec-91cd-36988129902b None admin] PATH_INFO: `/v3/domains/a9c4e6c8319b48e39da579c18fffe824` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:44:00.046385 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc5122d-7550-46ec-91cd-36988129902b None admin] RBAC: Authorizing `identity:get_domain(domain_id=a9c4e6c8319b48e39da579c18fffe824)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:44:00.047813 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc5122d-7550-46ec-91cd-36988129902b None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:44:00.049368 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 589/1172] 10.222.0.57 () {56 vars in 1183 bytes} [Fri Sep 16 07:43:59 2022] GET /identity/v3/domains/a9c4e6c8319b48e39da579c18fffe824 => generated 267 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:44:00.055074 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e901591-7b2b-4bf8-a148-7bdbe74c1072 None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:44:00.111802 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:44:00.152825 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e901591-7b2b-4bf8-a148-7bdbe74c1072 None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:44:00.186086 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c900302-a259-4d25-9665-5ec88a34240a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:44:00.186676 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c900302-a259-4d25-9665-5ec88a34240a None admin] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:44:00.186950 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c900302-a259-4d25-9665-5ec88a34240a None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:44:00.187218 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c900302-a259-4d25-9665-5ec88a34240a None admin] PATH_INFO: `/v3/projects` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:44:00.187857 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c900302-a259-4d25-9665-5ec88a34240a None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:44:00.189264 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c900302-a259-4d25-9665-5ec88a34240a None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:44:00.214962 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 584/1173] 10.222.0.57 () {60 vars in 1141 bytes} [Fri Sep 16 07:44:00 2022] POST /identity/v3/projects => generated 361 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 16 07:44:02.363838 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dcac85-fde4-481a-85ab-4b33fa0208d1 None None] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:44:02.364592 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dcac85-fde4-481a-85ab-4b33fa0208d1 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:44:02.364592 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dcac85-fde4-481a-85ab-4b33fa0208d1 None None] PATH_INFO: `/` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:44:02.365622 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 590/1174] 10.222.0.57 () {54 vars in 927 bytes} [Fri Sep 16 07:44:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 07:44:02.370707 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fb18a2-a9ac-4888-a092-25c957ae725b None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:44:02.371122 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fb18a2-a9ac-4888-a092-25c957ae725b None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:44:02.371264 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fb18a2-a9ac-4888-a092-25c957ae725b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:44:02.389806 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-16fb18a2-a9ac-4888-a092-25c957ae725b None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:44:02.390990 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-16fb18a2-a9ac-4888-a092-25c957ae725b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:44:02.458299 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 585/1175] 10.222.0.57 () {58 vars in 1024 bytes} [Fri Sep 16 07:44:02 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 16 07:44:02.725881 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04dcac85-fde4-481a-85ab-4b33fa0208d1 None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:44:02.785456 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:44:02.828103 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04dcac85-fde4-481a-85ab-4b33fa0208d1 None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:44:02.861511 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69dec0dc-36b5-479f-9c04-a08cf567fcd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:44:02.862156 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dec0dc-36b5-479f-9c04-a08cf567fcd7 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:44:02.862437 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dec0dc-36b5-479f-9c04-a08cf567fcd7 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:44:02.862710 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dec0dc-36b5-479f-9c04-a08cf567fcd7 None admin] PATH_INFO: `/v3/domains/a9c4e6c8319b48e39da579c18fffe824` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:44:02.863862 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69dec0dc-36b5-479f-9c04-a08cf567fcd7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=a9c4e6c8319b48e39da579c18fffe824)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:44:02.865511 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69dec0dc-36b5-479f-9c04-a08cf567fcd7 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:44:02.867201 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 591/1176] 10.222.0.57 () {56 vars in 1183 bytes} [Fri Sep 16 07:44:02 2022] GET /identity/v3/domains/a9c4e6c8319b48e39da579c18fffe824 => generated 267 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:44:02.872927 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fb18a2-a9ac-4888-a092-25c957ae725b None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:44:02.913700 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:44:02.970096 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fb18a2-a9ac-4888-a092-25c957ae725b None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:44:03.003210 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4575ab-f44b-4114-8bc3-3e603f16c642 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:44:03.003746 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4575ab-f44b-4114-8bc3-3e603f16c642 None admin] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:44:03.004021 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4575ab-f44b-4114-8bc3-3e603f16c642 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:44:03.004290 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4575ab-f44b-4114-8bc3-3e603f16c642 None admin] PATH_INFO: `/v3/users` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:44:03.005113 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4575ab-f44b-4114-8bc3-3e603f16c642 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:44:03.006568 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4575ab-f44b-4114-8bc3-3e603f16c642 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:44:03.027507 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 586/1177] 10.222.0.57 () {60 vars in 1132 bytes} [Fri Sep 16 07:44:02 2022] POST /identity/v3/users => generated 311 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 16 07:44:05.241569 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05ef6e6-3676-47bb-8a8d-991e78209073 None None] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:44:05.242148 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05ef6e6-3676-47bb-8a8d-991e78209073 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:44:05.242292 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05ef6e6-3676-47bb-8a8d-991e78209073 None None] PATH_INFO: `/` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:44:05.243602 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 592/1178] 10.222.0.57 () {54 vars in 927 bytes} [Fri Sep 16 07:44:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 07:44:05.248879 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf95cb48-9f40-499b-8c6c-074be322feb0 None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:44:05.249259 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf95cb48-9f40-499b-8c6c-074be322feb0 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:44:05.249429 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf95cb48-9f40-499b-8c6c-074be322feb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:44:05.268193 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-bf95cb48-9f40-499b-8c6c-074be322feb0 None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:44:05.269372 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-bf95cb48-9f40-499b-8c6c-074be322feb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:44:05.333607 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 587/1179] 10.222.0.57 () {58 vars in 1024 bytes} [Fri Sep 16 07:44:05 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 16 07:44:05.603309 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05ef6e6-3676-47bb-8a8d-991e78209073 None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:44:05.709799 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05ef6e6-3676-47bb-8a8d-991e78209073 None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:44:05.734632 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:44:05.744475 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cee2520-0a1d-441c-9ef0-95355250ba51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:44:05.745103 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cee2520-0a1d-441c-9ef0-95355250ba51 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:44:05.745385 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cee2520-0a1d-441c-9ef0-95355250ba51 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:44:05.745658 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cee2520-0a1d-441c-9ef0-95355250ba51 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:44:05.757116 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cee2520-0a1d-441c-9ef0-95355250ba51 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 07:44:05.761890 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application [None req-3cee2520-0a1d-441c-9ef0-95355250ba51 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 16 07:44:05.761890 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 07:44:05.761890 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 07:44:05.761890 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 07:44:05.761890 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 07:44:05.761890 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 07:44:05.761890 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 07:44:05.761890 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 07:44:05.761890 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 07:44:05.761890 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 07:44:05.761890 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 07:44:05.761890 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 07:44:05.761890 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 07:44:05.761890 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 07:44:05.761890 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 07:44:05.761890 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 07:44:05.763004 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 07:44:05.763004 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 07:44:05.763004 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 07:44:05.763004 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 07:44:05.763004 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 07:44:05.763004 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 07:44:05.763004 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 07:44:05.763004 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 07:44:05.763004 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 07:44:05.763004 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 07:44:05.763004 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 07:44:05.763004 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application with Lock( Sep 16 07:44:05.763004 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 07:44:05.763004 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._enter() Sep 16 07:44:05.763004 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 07:44:05.763004 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 07:44:05.764034 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 07:44:05.764034 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.creator() Sep 16 07:44:05.764034 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 07:44:05.764034 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application created_value = creator( Sep 16 07:44:05.764034 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 07:44:05.764034 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 07:44:05.764034 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 07:44:05.764034 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 07:44:05.764034 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 07:44:05.764034 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 07:44:05.764034 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 16 07:44:05.764034 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Sep 16 07:44:05.764034 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 593/1180] 10.222.0.57 () {56 vars in 1096 bytes} [Fri Sep 16 07:44:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 07:44:05.769033 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf95cb48-9f40-499b-8c6c-074be322feb0 None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:44:05.794979 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:44:05.865092 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf95cb48-9f40-499b-8c6c-074be322feb0 None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:44:05.898232 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b65ee1-5778-44e9-b65d-a57eb8b7641e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:44:05.898814 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b65ee1-5778-44e9-b65d-a57eb8b7641e None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:44:05.899085 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b65ee1-5778-44e9-b65d-a57eb8b7641e None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:44:05.899348 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b65ee1-5778-44e9-b65d-a57eb8b7641e None admin] PATH_INFO: `/v3/roles` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:44:05.899988 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b65ee1-5778-44e9-b65d-a57eb8b7641e None admin] RBAC: Adding query filter params (name=admin) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:44:05.900282 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b65ee1-5778-44e9-b65d-a57eb8b7641e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:44:05.901629 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b65ee1-5778-44e9-b65d-a57eb8b7641e None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:44:05.909236 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 588/1181] 10.222.0.57 () {56 vars in 1099 bytes} [Fri Sep 16 07:44:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:44:05.915516 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cee2520-0a1d-441c-9ef0-95355250ba51 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:44:06.012306 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cee2520-0a1d-441c-9ef0-95355250ba51 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:44:06.043746 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9d7cdb-ddb9-4cf4-b81f-8b1b00c25b8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:44:06.044356 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9d7cdb-ddb9-4cf4-b81f-8b1b00c25b8f None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:44:06.044633 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9d7cdb-ddb9-4cf4-b81f-8b1b00c25b8f None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:44:06.044905 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9d7cdb-ddb9-4cf4-b81f-8b1b00c25b8f None admin] PATH_INFO: `/v3/users/d04f486757004b46868fce6dd80647c0` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:44:06.059040 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9d7cdb-ddb9-4cf4-b81f-8b1b00c25b8f None admin] RBAC: Authorizing `identity:get_user(user_id=d04f486757004b46868fce6dd80647c0)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:44:06.060471 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9d7cdb-ddb9-4cf4-b81f-8b1b00c25b8f None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:44:06.062096 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 594/1182] 10.222.0.57 () {56 vars in 1177 bytes} [Fri Sep 16 07:44:05 2022] GET /identity/v3/users/d04f486757004b46868fce6dd80647c0 => generated 311 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:44:06.068654 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b65ee1-5778-44e9-b65d-a57eb8b7641e None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:44:06.153928 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:44:06.165776 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b65ee1-5778-44e9-b65d-a57eb8b7641e None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:44:06.198368 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4256bed-a311-4345-8da5-71f0caf1cb2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:44:06.198958 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4256bed-a311-4345-8da5-71f0caf1cb2b None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:44:06.199229 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4256bed-a311-4345-8da5-71f0caf1cb2b None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:44:06.199491 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4256bed-a311-4345-8da5-71f0caf1cb2b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:44:06.263227 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4256bed-a311-4345-8da5-71f0caf1cb2b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:44:06.264643 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4256bed-a311-4345-8da5-71f0caf1cb2b None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:44:06.345287 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:44:06.358552 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 589/1183] 10.222.0.57 () {58 vars in 1282 bytes} [Fri Sep 16 07:44:06 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 16 07:44:06.365031 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9d7cdb-ddb9-4cf4-b81f-8b1b00c25b8f None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:44:06.408652 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:44:06.460378 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9d7cdb-ddb9-4cf4-b81f-8b1b00c25b8f None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:44:06.493513 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0930e01-820d-478c-b130-185b8d85d894 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:44:06.494152 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0930e01-820d-478c-b130-185b8d85d894 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:44:06.494431 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0930e01-820d-478c-b130-185b8d85d894 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:44:06.494697 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0930e01-820d-478c-b130-185b8d85d894 None admin] PATH_INFO: `/v3/projects/397cc0ad92f84d2a825e736127d4fc91` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:44:06.495799 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0930e01-820d-478c-b130-185b8d85d894 None admin] RBAC: Authorizing `identity:get_project(project_id=397cc0ad92f84d2a825e736127d4fc91)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:44:06.497195 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0930e01-820d-478c-b130-185b8d85d894 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:44:06.498800 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 595/1184] 10.222.0.57 () {56 vars in 1186 bytes} [Fri Sep 16 07:44:06 2022] GET /identity/v3/projects/397cc0ad92f84d2a825e736127d4fc91 => generated 361 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:44:06.505065 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4256bed-a311-4345-8da5-71f0caf1cb2b None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:44:06.600503 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4256bed-a311-4345-8da5-71f0caf1cb2b None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:44:06.633091 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e4ba19-e429-429b-8867-12b86c18d096 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:44:06.633675 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e4ba19-e429-429b-8867-12b86c18d096 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:44:06.633974 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e4ba19-e429-429b-8867-12b86c18d096 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:44:06.634241 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e4ba19-e429-429b-8867-12b86c18d096 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:44:06.634937 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e4ba19-e429-429b-8867-12b86c18d096 None admin] RBAC: Adding query filter params (role.id=567db03c91854ad9af1e9a87ec1bd275, scope.project.id=397cc0ad92f84d2a825e736127d4fc91, user.id=d04f486757004b46868fce6dd80647c0) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:44:06.635239 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e4ba19-e429-429b-8867-12b86c18d096 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:44:06.636647 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e4ba19-e429-429b-8867-12b86c18d096 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:44:06.641776 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 590/1185] 10.222.0.57 () {56 vars in 1374 bytes} [Fri Sep 16 07:44:06 2022] GET /identity/v3/role_assignments?user.id=d04f486757004b46868fce6dd80647c0&scope.project.id=397cc0ad92f84d2a825e736127d4fc91&role.id=567db03c91854ad9af1e9a87ec1bd275 => generated 259 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 07:44:08.761041 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bee1d40-b48c-4b65-9a75-f8055bffa004 None None] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:44:08.761571 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bee1d40-b48c-4b65-9a75-f8055bffa004 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:44:08.761571 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bee1d40-b48c-4b65-9a75-f8055bffa004 None None] PATH_INFO: `/` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:44:08.762942 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 596/1186] 10.222.0.57 () {54 vars in 927 bytes} [Fri Sep 16 07:44:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 07:44:08.768075 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ead784e-bfd9-4716-aac5-f1bafee2a70f None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:44:08.768454 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ead784e-bfd9-4716-aac5-f1bafee2a70f None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:44:08.768618 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ead784e-bfd9-4716-aac5-f1bafee2a70f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:44:08.786747 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-9ead784e-bfd9-4716-aac5-f1bafee2a70f None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:44:08.787913 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-9ead784e-bfd9-4716-aac5-f1bafee2a70f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:44:08.833855 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:44:08.853147 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 591/1187] 10.222.0.57 () {58 vars in 1024 bytes} [Fri Sep 16 07:44:08 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 16 07:44:09.119590 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bee1d40-b48c-4b65-9a75-f8055bffa004 None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:44:09.218762 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bee1d40-b48c-4b65-9a75-f8055bffa004 None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:44:09.231355 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:44:09.251731 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd5254a-3ab1-4bcb-9f54-24b19192e319 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:44:09.252353 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd5254a-3ab1-4bcb-9f54-24b19192e319 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:44:09.252630 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd5254a-3ab1-4bcb-9f54-24b19192e319 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:44:09.252899 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd5254a-3ab1-4bcb-9f54-24b19192e319 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:44:09.263088 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd5254a-3ab1-4bcb-9f54-24b19192e319 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 07:44:09.267893 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application [None req-4fd5254a-3ab1-4bcb-9f54-24b19192e319 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 16 07:44:09.267893 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 07:44:09.267893 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 07:44:09.267893 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 07:44:09.267893 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 07:44:09.267893 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 07:44:09.267893 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 07:44:09.267893 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 07:44:09.267893 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 07:44:09.267893 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 07:44:09.267893 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 07:44:09.267893 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 07:44:09.267893 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 07:44:09.267893 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 07:44:09.267893 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 07:44:09.267893 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 07:44:09.268958 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 07:44:09.268958 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 07:44:09.268958 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 07:44:09.268958 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 07:44:09.268958 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 07:44:09.268958 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 07:44:09.268958 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 07:44:09.268958 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 07:44:09.268958 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 07:44:09.268958 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 07:44:09.268958 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 07:44:09.268958 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application with Lock( Sep 16 07:44:09.268958 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 07:44:09.268958 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._enter() Sep 16 07:44:09.268958 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 07:44:09.268958 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 07:44:09.270093 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 07:44:09.270093 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.creator() Sep 16 07:44:09.270093 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 07:44:09.270093 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application created_value = creator( Sep 16 07:44:09.270093 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 07:44:09.270093 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 07:44:09.270093 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 07:44:09.270093 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 07:44:09.270093 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 07:44:09.270093 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 07:44:09.270093 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 16 07:44:09.270093 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Sep 16 07:44:09.270093 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 597/1188] 10.222.0.57 () {56 vars in 1096 bytes} [Fri Sep 16 07:44:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 07:44:09.275907 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ead784e-bfd9-4716-aac5-f1bafee2a70f None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:44:09.370645 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ead784e-bfd9-4716-aac5-f1bafee2a70f None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:44:09.404483 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83dd6a9-8f7a-4bc8-b7b4-187d830f3342 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:44:09.405080 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83dd6a9-8f7a-4bc8-b7b4-187d830f3342 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:44:09.405357 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83dd6a9-8f7a-4bc8-b7b4-187d830f3342 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:44:09.405624 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83dd6a9-8f7a-4bc8-b7b4-187d830f3342 None admin] PATH_INFO: `/v3/roles` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:44:09.406304 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83dd6a9-8f7a-4bc8-b7b4-187d830f3342 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:44:09.406602 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83dd6a9-8f7a-4bc8-b7b4-187d830f3342 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:44:09.407950 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83dd6a9-8f7a-4bc8-b7b4-187d830f3342 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:44:09.415908 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 592/1189] 10.222.0.57 () {56 vars in 1099 bytes} [Fri Sep 16 07:44:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:44:09.421815 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd5254a-3ab1-4bcb-9f54-24b19192e319 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:44:09.518195 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd5254a-3ab1-4bcb-9f54-24b19192e319 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:44:09.550525 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60672250-34a3-483c-aeef-a0ac2f2f46bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:44:09.551726 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60672250-34a3-483c-aeef-a0ac2f2f46bd None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:44:09.552126 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60672250-34a3-483c-aeef-a0ac2f2f46bd None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:44:09.552398 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60672250-34a3-483c-aeef-a0ac2f2f46bd None admin] PATH_INFO: `/v3/users/d04f486757004b46868fce6dd80647c0` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:44:09.553497 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60672250-34a3-483c-aeef-a0ac2f2f46bd None admin] RBAC: Authorizing `identity:get_user(user_id=d04f486757004b46868fce6dd80647c0)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:44:09.554941 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60672250-34a3-483c-aeef-a0ac2f2f46bd None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:44:09.556472 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 598/1190] 10.222.0.57 () {56 vars in 1177 bytes} [Fri Sep 16 07:44:09 2022] GET /identity/v3/users/d04f486757004b46868fce6dd80647c0 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:44:09.562265 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83dd6a9-8f7a-4bc8-b7b4-187d830f3342 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:44:09.607340 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:44:09.659756 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83dd6a9-8f7a-4bc8-b7b4-187d830f3342 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:44:09.692172 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074cc8bf-75c1-4df5-9ed4-807bada6d311 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:44:09.692949 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074cc8bf-75c1-4df5-9ed4-807bada6d311 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:44:09.693226 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074cc8bf-75c1-4df5-9ed4-807bada6d311 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:44:09.693493 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074cc8bf-75c1-4df5-9ed4-807bada6d311 None admin] PATH_INFO: `/v3/projects/397cc0ad92f84d2a825e736127d4fc91` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:44:09.694634 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074cc8bf-75c1-4df5-9ed4-807bada6d311 None admin] RBAC: Authorizing `identity:get_project(project_id=397cc0ad92f84d2a825e736127d4fc91)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:44:09.696045 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074cc8bf-75c1-4df5-9ed4-807bada6d311 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:44:09.697644 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 593/1191] 10.222.0.57 () {56 vars in 1186 bytes} [Fri Sep 16 07:44:09 2022] GET /identity/v3/projects/397cc0ad92f84d2a825e736127d4fc91 => generated 361 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:44:09.712586 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60672250-34a3-483c-aeef-a0ac2f2f46bd None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:44:09.755445 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:44:09.811021 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60672250-34a3-483c-aeef-a0ac2f2f46bd None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:44:09.843847 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17992818-a28a-4dde-8985-d91ea4727860 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:44:09.844487 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17992818-a28a-4dde-8985-d91ea4727860 None admin] REQUEST_METHOD: `PUT` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:44:09.844761 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17992818-a28a-4dde-8985-d91ea4727860 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:44:09.845028 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17992818-a28a-4dde-8985-d91ea4727860 None admin] PATH_INFO: `/v3/projects/397cc0ad92f84d2a825e736127d4fc91/users/d04f486757004b46868fce6dd80647c0/roles/567db03c91854ad9af1e9a87ec1bd275` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:44:09.846907 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17992818-a28a-4dde-8985-d91ea4727860 None admin] RBAC: Authorizing `identity:create_grant(project_id=397cc0ad92f84d2a825e736127d4fc91, user_id=d04f486757004b46868fce6dd80647c0, role_id=567db03c91854ad9af1e9a87ec1bd275)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:44:09.848347 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17992818-a28a-4dde-8985-d91ea4727860 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:44:09.861319 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 599/1192] 10.222.0.57 () {58 vars in 1439 bytes} [Fri Sep 16 07:44:09 2022] PUT /identity/v3/projects/397cc0ad92f84d2a825e736127d4fc91/users/d04f486757004b46868fce6dd80647c0/roles/567db03c91854ad9af1e9a87ec1bd275 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 07:44:11.976111 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4963e3-6c38-4063-adff-41a8613091aa None None] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:44:11.976670 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4963e3-6c38-4063-adff-41a8613091aa None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:44:11.976670 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4963e3-6c38-4063-adff-41a8613091aa None None] PATH_INFO: `/` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:44:11.978080 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 594/1193] 10.222.0.57 () {54 vars in 927 bytes} [Fri Sep 16 07:44:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 07:44:11.983344 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb97653d-5ce3-43b5-a658-40283388c709 None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:44:11.983753 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb97653d-5ce3-43b5-a658-40283388c709 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:44:11.983901 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb97653d-5ce3-43b5-a658-40283388c709 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:44:12.002462 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-fb97653d-5ce3-43b5-a658-40283388c709 None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:44:12.003647 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-fb97653d-5ce3-43b5-a658-40283388c709 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:44:12.068223 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 600/1194] 10.222.0.57 () {58 vars in 1024 bytes} [Fri Sep 16 07:44:11 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 16 07:44:12.336053 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4963e3-6c38-4063-adff-41a8613091aa None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:44:12.435169 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4963e3-6c38-4063-adff-41a8613091aa None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:44:12.447732 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:44:12.468176 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f93d8f-5083-4d68-8279-ab47a61ce09a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:44:12.468790 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f93d8f-5083-4d68-8279-ab47a61ce09a None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:44:12.469064 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f93d8f-5083-4d68-8279-ab47a61ce09a None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:44:12.469333 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f93d8f-5083-4d68-8279-ab47a61ce09a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:44:12.479536 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f93d8f-5083-4d68-8279-ab47a61ce09a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 07:44:12.484236 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application [None req-a8f93d8f-5083-4d68-8279-ab47a61ce09a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 16 07:44:12.484236 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 07:44:12.484236 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 07:44:12.484236 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 07:44:12.484236 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 07:44:12.484236 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 07:44:12.484236 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 07:44:12.484236 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 07:44:12.484236 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 07:44:12.484236 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 07:44:12.484236 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 07:44:12.484236 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 07:44:12.484236 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 07:44:12.484236 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 07:44:12.484236 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 07:44:12.484236 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 07:44:12.485339 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 07:44:12.485339 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 07:44:12.485339 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 07:44:12.485339 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 07:44:12.485339 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 07:44:12.485339 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 07:44:12.485339 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 07:44:12.485339 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 07:44:12.485339 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 07:44:12.485339 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 07:44:12.485339 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 07:44:12.485339 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application with Lock( Sep 16 07:44:12.485339 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 07:44:12.485339 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._enter() Sep 16 07:44:12.485339 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 07:44:12.485339 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 07:44:12.486669 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 07:44:12.486669 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.creator() Sep 16 07:44:12.486669 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 07:44:12.486669 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application created_value = creator( Sep 16 07:44:12.486669 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 07:44:12.486669 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 07:44:12.486669 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 07:44:12.486669 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 07:44:12.486669 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 07:44:12.486669 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 07:44:12.486669 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 16 07:44:12.486669 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Sep 16 07:44:12.486669 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 595/1195] 10.222.0.57 () {56 vars in 1096 bytes} [Fri Sep 16 07:44:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 07:44:12.492013 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb97653d-5ce3-43b5-a658-40283388c709 None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:44:12.520874 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:44:12.589688 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb97653d-5ce3-43b5-a658-40283388c709 None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:44:12.622493 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e827be-0bd6-4f60-9026-f5f0c1ac2a5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:44:12.623084 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e827be-0bd6-4f60-9026-f5f0c1ac2a5e None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:44:12.623363 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e827be-0bd6-4f60-9026-f5f0c1ac2a5e None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:44:12.623633 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e827be-0bd6-4f60-9026-f5f0c1ac2a5e None admin] PATH_INFO: `/v3/roles` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:44:12.624278 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e827be-0bd6-4f60-9026-f5f0c1ac2a5e None admin] RBAC: Adding query filter params (name=admin) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:44:12.624578 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e827be-0bd6-4f60-9026-f5f0c1ac2a5e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:44:12.625958 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e827be-0bd6-4f60-9026-f5f0c1ac2a5e None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:44:12.634076 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 601/1196] 10.222.0.57 () {56 vars in 1099 bytes} [Fri Sep 16 07:44:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:44:12.639953 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f93d8f-5083-4d68-8279-ab47a61ce09a None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:44:12.737168 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f93d8f-5083-4d68-8279-ab47a61ce09a None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:44:12.771097 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e669ef0d-c796-48c9-9d4c-db1b6e4c1a21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:44:12.771715 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e669ef0d-c796-48c9-9d4c-db1b6e4c1a21 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:44:12.771991 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e669ef0d-c796-48c9-9d4c-db1b6e4c1a21 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:44:12.772260 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e669ef0d-c796-48c9-9d4c-db1b6e4c1a21 None admin] PATH_INFO: `/v3/users/d04f486757004b46868fce6dd80647c0` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:44:12.773365 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e669ef0d-c796-48c9-9d4c-db1b6e4c1a21 None admin] RBAC: Authorizing `identity:get_user(user_id=d04f486757004b46868fce6dd80647c0)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:44:12.774812 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e669ef0d-c796-48c9-9d4c-db1b6e4c1a21 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:44:12.776408 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 596/1197] 10.222.0.57 () {56 vars in 1177 bytes} [Fri Sep 16 07:44:12 2022] GET /identity/v3/users/d04f486757004b46868fce6dd80647c0 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:44:12.782533 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e827be-0bd6-4f60-9026-f5f0c1ac2a5e None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:44:12.869627 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:44:12.879523 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e827be-0bd6-4f60-9026-f5f0c1ac2a5e None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:44:12.911155 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30820580-78fc-4f86-a453-7e9313c680f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:44:12.911740 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30820580-78fc-4f86-a453-7e9313c680f5 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:44:12.912015 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30820580-78fc-4f86-a453-7e9313c680f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:44:12.912282 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30820580-78fc-4f86-a453-7e9313c680f5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:44:12.976904 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30820580-78fc-4f86-a453-7e9313c680f5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:44:12.978357 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30820580-78fc-4f86-a453-7e9313c680f5 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:44:13.065113 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:44:13.074994 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 602/1198] 10.222.0.57 () {58 vars in 1282 bytes} [Fri Sep 16 07:44:12 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 16 07:44:13.080897 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e669ef0d-c796-48c9-9d4c-db1b6e4c1a21 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:44:13.122289 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:44:13.178570 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e669ef0d-c796-48c9-9d4c-db1b6e4c1a21 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:44:13.211209 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8440e9-b22b-4243-8ac9-49b1462b0bd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:44:13.211821 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8440e9-b22b-4243-8ac9-49b1462b0bd9 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:44:13.212094 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8440e9-b22b-4243-8ac9-49b1462b0bd9 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:44:13.212363 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8440e9-b22b-4243-8ac9-49b1462b0bd9 None admin] PATH_INFO: `/v3/projects/397cc0ad92f84d2a825e736127d4fc91` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:44:13.213448 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8440e9-b22b-4243-8ac9-49b1462b0bd9 None admin] RBAC: Authorizing `identity:get_project(project_id=397cc0ad92f84d2a825e736127d4fc91)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:44:13.214900 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8440e9-b22b-4243-8ac9-49b1462b0bd9 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:44:13.216496 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 597/1199] 10.222.0.57 () {56 vars in 1186 bytes} [Fri Sep 16 07:44:13 2022] GET /identity/v3/projects/397cc0ad92f84d2a825e736127d4fc91 => generated 361 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:44:13.223165 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30820580-78fc-4f86-a453-7e9313c680f5 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:44:13.318783 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30820580-78fc-4f86-a453-7e9313c680f5 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:44:13.351942 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2a59fc-a8e4-4caa-a668-4035bf330758 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:44:13.352527 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2a59fc-a8e4-4caa-a668-4035bf330758 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:44:13.352805 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2a59fc-a8e4-4caa-a668-4035bf330758 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:44:13.353078 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2a59fc-a8e4-4caa-a668-4035bf330758 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:44:13.353820 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2a59fc-a8e4-4caa-a668-4035bf330758 None admin] RBAC: Adding query filter params (role.id=567db03c91854ad9af1e9a87ec1bd275, scope.project.id=397cc0ad92f84d2a825e736127d4fc91, user.id=d04f486757004b46868fce6dd80647c0) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:44:13.354126 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2a59fc-a8e4-4caa-a668-4035bf330758 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:44:13.355603 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2a59fc-a8e4-4caa-a668-4035bf330758 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:44:13.361101 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 603/1200] 10.222.0.57 () {56 vars in 1374 bytes} [Fri Sep 16 07:44:13 2022] GET /identity/v3/role_assignments?user.id=d04f486757004b46868fce6dd80647c0&scope.project.id=397cc0ad92f84d2a825e736127d4fc91&role.id=567db03c91854ad9af1e9a87ec1bd275 => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:44:23.207175 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=46 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:44:23.358761 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=72 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:45:09.161831 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166e2bd4-5eff-4246-807b-59175f853bd4 None None] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:45:09.162450 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166e2bd4-5eff-4246-807b-59175f853bd4 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:45:09.162450 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166e2bd4-5eff-4246-807b-59175f853bd4 None None] PATH_INFO: `/` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:45:09.164060 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 598/1201] 10.222.0.57 () {54 vars in 927 bytes} [Fri Sep 16 07:45:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 07:45:09.170562 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717df557-d517-4178-86a2-373629d13280 None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:45:09.170562 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717df557-d517-4178-86a2-373629d13280 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:45:09.173768 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717df557-d517-4178-86a2-373629d13280 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:45:09.194933 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-717df557-d517-4178-86a2-373629d13280 None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:45:09.196309 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-717df557-d517-4178-86a2-373629d13280 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:45:09.300639 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 604/1202] 10.222.0.57 () {58 vars in 1024 bytes} [Fri Sep 16 07:45:09 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 16 07:45:09.582846 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166e2bd4-5eff-4246-807b-59175f853bd4 None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:45:09.714286 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166e2bd4-5eff-4246-807b-59175f853bd4 None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:45:09.764258 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f2f94b-e21c-4b5a-9994-3d80f3addac1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:45:09.765423 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f2f94b-e21c-4b5a-9994-3d80f3addac1 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:45:09.765966 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f2f94b-e21c-4b5a-9994-3d80f3addac1 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:45:09.766630 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f2f94b-e21c-4b5a-9994-3d80f3addac1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:45:09.778662 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f2f94b-e21c-4b5a-9994-3d80f3addac1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:45:09.780510 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f2f94b-e21c-4b5a-9994-3d80f3addac1 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:45:09.802327 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application [None req-42f2f94b-e21c-4b5a-9994-3d80f3addac1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 07:45:09.802327 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 07:45:09.802327 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 07:45:09.802327 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 07:45:09.802327 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 07:45:09.802327 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 07:45:09.802327 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 07:45:09.802327 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 07:45:09.802327 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 07:45:09.802327 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 07:45:09.802327 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 07:45:09.802327 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 07:45:09.802327 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 07:45:09.802327 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 07:45:09.802327 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 07:45:09.802327 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 07:45:09.803679 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 07:45:09.803679 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 07:45:09.803679 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 07:45:09.803679 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 07:45:09.803679 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 07:45:09.803679 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 07:45:09.803679 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 07:45:09.803679 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application with Lock( Sep 16 07:45:09.803679 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 07:45:09.803679 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._enter() Sep 16 07:45:09.803679 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 07:45:09.803679 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 07:45:09.803679 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 07:45:09.803679 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.creator() Sep 16 07:45:09.803679 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 07:45:09.803679 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application created_value = creator( Sep 16 07:45:09.803679 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 07:45:09.804680 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 07:45:09.804680 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 07:45:09.804680 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Sep 16 07:45:09.804680 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 599/1203] 10.222.0.57 () {56 vars in 1108 bytes} [Fri Sep 16 07:45:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 07:45:09.810077 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717df557-d517-4178-86a2-373629d13280 None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:45:09.933674 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717df557-d517-4178-86a2-373629d13280 None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:45:09.971185 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:45:09.980215 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86242c71-0ad1-45b2-8847-d80ddf76c9b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:45:09.980956 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86242c71-0ad1-45b2-8847-d80ddf76c9b0 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:45:09.981284 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86242c71-0ad1-45b2-8847-d80ddf76c9b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:45:09.981559 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86242c71-0ad1-45b2-8847-d80ddf76c9b0 None admin] PATH_INFO: `/v3/domains` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:45:09.982408 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86242c71-0ad1-45b2-8847-d80ddf76c9b0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:45:09.982747 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86242c71-0ad1-45b2-8847-d80ddf76c9b0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:45:09.985520 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86242c71-0ad1-45b2-8847-d80ddf76c9b0 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:45:10.001814 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 605/1204] 10.222.0.57 () {56 vars in 1109 bytes} [Fri Sep 16 07:45:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:45:10.007442 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f2f94b-e21c-4b5a-9994-3d80f3addac1 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:45:10.071147 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:45:10.137798 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f2f94b-e21c-4b5a-9994-3d80f3addac1 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:45:10.184242 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbc3880-d36c-49bc-989b-04ec2f79d5a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:45:10.186188 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbc3880-d36c-49bc-989b-04ec2f79d5a5 None admin] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:45:10.186637 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbc3880-d36c-49bc-989b-04ec2f79d5a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:45:10.187114 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbc3880-d36c-49bc-989b-04ec2f79d5a5 None admin] PATH_INFO: `/v3/users` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:45:10.187929 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbc3880-d36c-49bc-989b-04ec2f79d5a5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:45:10.189410 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbc3880-d36c-49bc-989b-04ec2f79d5a5 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:45:10.214516 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 600/1205] 10.222.0.57 () {60 vars in 1132 bytes} [Fri Sep 16 07:45:10 2022] POST /identity/v3/users => generated 251 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 07:45:12.939193 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9f4061-56d9-404e-ab52-2712c39914da None None] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:45:12.939757 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9f4061-56d9-404e-ab52-2712c39914da None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:45:12.939757 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9f4061-56d9-404e-ab52-2712c39914da None None] PATH_INFO: `/` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:45:12.941055 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 606/1206] 10.222.0.57 () {54 vars in 927 bytes} [Fri Sep 16 07:45:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 07:45:12.948151 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcc73db-477f-4917-9a97-59a17bf9f002 None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:45:12.948608 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcc73db-477f-4917-9a97-59a17bf9f002 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:45:12.948688 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcc73db-477f-4917-9a97-59a17bf9f002 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:45:12.969910 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-ffcc73db-477f-4917-9a97-59a17bf9f002 None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:45:12.971118 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-ffcc73db-477f-4917-9a97-59a17bf9f002 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:45:13.050227 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 601/1207] 10.222.0.57 () {58 vars in 1024 bytes} [Fri Sep 16 07:45:12 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 16 07:45:13.351103 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9f4061-56d9-404e-ab52-2712c39914da None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:45:13.481577 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9f4061-56d9-404e-ab52-2712c39914da None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:45:13.533059 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06d706c-f16d-45b6-886c-ad603c25fc65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:45:13.533770 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06d706c-f16d-45b6-886c-ad603c25fc65 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:45:13.534046 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06d706c-f16d-45b6-886c-ad603c25fc65 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:45:13.534319 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06d706c-f16d-45b6-886c-ad603c25fc65 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:45:13.547553 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06d706c-f16d-45b6-886c-ad603c25fc65 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 07:45:13.552795 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application [None req-a06d706c-f16d-45b6-886c-ad603c25fc65 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 16 07:45:13.552795 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 07:45:13.552795 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 07:45:13.552795 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 07:45:13.552795 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 07:45:13.552795 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 07:45:13.552795 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 07:45:13.552795 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 07:45:13.552795 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 07:45:13.552795 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 07:45:13.552795 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 07:45:13.552795 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 07:45:13.552795 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 07:45:13.552795 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 07:45:13.552795 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 07:45:13.552795 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 07:45:13.558307 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 07:45:13.558307 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 07:45:13.558307 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 07:45:13.558307 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 07:45:13.558307 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 07:45:13.558307 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 07:45:13.558307 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 07:45:13.558307 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 07:45:13.558307 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 07:45:13.558307 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 07:45:13.558307 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 07:45:13.558307 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application with Lock( Sep 16 07:45:13.558307 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 07:45:13.558307 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._enter() Sep 16 07:45:13.558307 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 07:45:13.558307 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 07:45:13.559355 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 07:45:13.559355 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.creator() Sep 16 07:45:13.559355 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 07:45:13.559355 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application created_value = creator( Sep 16 07:45:13.559355 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 07:45:13.559355 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 07:45:13.559355 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 07:45:13.559355 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 07:45:13.559355 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 07:45:13.559355 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 07:45:13.559355 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 16 07:45:13.559355 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Sep 16 07:45:13.559355 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 607/1208] 10.222.0.57 () {56 vars in 1102 bytes} [Fri Sep 16 07:45:13 2022] GET /identity/v3/roles/service => generated 85 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 07:45:13.560491 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcc73db-477f-4917-9a97-59a17bf9f002 None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:45:13.611536 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:45:13.681444 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcc73db-477f-4917-9a97-59a17bf9f002 None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:45:13.720012 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fab912c-5ecb-49ea-a9a1-3839e39a20b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:45:13.720629 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fab912c-5ecb-49ea-a9a1-3839e39a20b9 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:45:13.720904 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fab912c-5ecb-49ea-a9a1-3839e39a20b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:45:13.721202 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fab912c-5ecb-49ea-a9a1-3839e39a20b9 None admin] PATH_INFO: `/v3/roles` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:45:13.721833 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fab912c-5ecb-49ea-a9a1-3839e39a20b9 None admin] RBAC: Adding query filter params (name=service) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:45:13.722211 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fab912c-5ecb-49ea-a9a1-3839e39a20b9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:45:13.723598 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fab912c-5ecb-49ea-a9a1-3839e39a20b9 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:45:13.734125 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 602/1209] 10.222.0.57 () {56 vars in 1103 bytes} [Fri Sep 16 07:45:13 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:45:13.740396 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06d706c-f16d-45b6-886c-ad603c25fc65 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:45:13.812890 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:45:13.879092 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06d706c-f16d-45b6-886c-ad603c25fc65 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:45:13.919951 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e8f28c-5a5a-4c62-9b55-826f9fca936a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:45:13.920813 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e8f28c-5a5a-4c62-9b55-826f9fca936a None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:45:13.921322 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e8f28c-5a5a-4c62-9b55-826f9fca936a None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:45:13.921660 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e8f28c-5a5a-4c62-9b55-826f9fca936a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:45:13.934292 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e8f28c-5a5a-4c62-9b55-826f9fca936a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:45:13.935719 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e8f28c-5a5a-4c62-9b55-826f9fca936a None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:45:13.950551 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application [None req-24e8f28c-5a5a-4c62-9b55-826f9fca936a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 07:45:13.950551 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 07:45:13.950551 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 07:45:13.950551 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 07:45:13.950551 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 07:45:13.950551 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 07:45:13.950551 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 07:45:13.950551 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 07:45:13.950551 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 07:45:13.950551 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 07:45:13.950551 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 07:45:13.950551 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 07:45:13.950551 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 07:45:13.950551 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 07:45:13.950551 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 07:45:13.950551 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 07:45:13.952138 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 07:45:13.952138 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 07:45:13.952138 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 07:45:13.952138 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 07:45:13.952138 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 07:45:13.952138 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 07:45:13.952138 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 07:45:13.952138 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application with Lock( Sep 16 07:45:13.952138 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 07:45:13.952138 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._enter() Sep 16 07:45:13.952138 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 07:45:13.952138 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 07:45:13.952138 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 07:45:13.952138 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.creator() Sep 16 07:45:13.952138 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 07:45:13.952138 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application created_value = creator( Sep 16 07:45:13.952138 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 07:45:13.954131 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 07:45:13.954131 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 07:45:13.954131 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Sep 16 07:45:13.954131 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 608/1210] 10.222.0.57 () {56 vars in 1108 bytes} [Fri Sep 16 07:45:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 07:45:13.958005 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fab912c-5ecb-49ea-a9a1-3839e39a20b9 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:45:14.078974 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:45:14.086280 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fab912c-5ecb-49ea-a9a1-3839e39a20b9 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:45:14.132305 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d71bcd8-5d67-4f5b-bfe2-a668efd512c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:45:14.132850 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d71bcd8-5d67-4f5b-bfe2-a668efd512c7 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:45:14.133110 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d71bcd8-5d67-4f5b-bfe2-a668efd512c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:45:14.133377 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d71bcd8-5d67-4f5b-bfe2-a668efd512c7 None admin] PATH_INFO: `/v3/domains` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:45:14.134034 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d71bcd8-5d67-4f5b-bfe2-a668efd512c7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:45:14.134758 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d71bcd8-5d67-4f5b-bfe2-a668efd512c7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:45:14.135690 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d71bcd8-5d67-4f5b-bfe2-a668efd512c7 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:45:14.153752 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 603/1211] 10.222.0.57 () {56 vars in 1109 bytes} [Fri Sep 16 07:45:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:45:14.157225 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e8f28c-5a5a-4c62-9b55-826f9fca936a None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:45:14.267139 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e8f28c-5a5a-4c62-9b55-826f9fca936a None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:45:14.268786 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:45:14.306682 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da4d4e2-1fdb-4966-8bca-d0a2adfeb30f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:45:14.307366 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da4d4e2-1fdb-4966-8bca-d0a2adfeb30f None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:45:14.307682 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da4d4e2-1fdb-4966-8bca-d0a2adfeb30f None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:45:14.308004 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da4d4e2-1fdb-4966-8bca-d0a2adfeb30f None admin] PATH_INFO: `/v3/users/placement` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:45:14.317448 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da4d4e2-1fdb-4966-8bca-d0a2adfeb30f None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:45:14.318919 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da4d4e2-1fdb-4966-8bca-d0a2adfeb30f None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:45:14.331244 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application [None req-2da4d4e2-1fdb-4966-8bca-d0a2adfeb30f None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 16 07:45:14.331244 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 07:45:14.331244 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 07:45:14.331244 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 07:45:14.331244 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 07:45:14.331244 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 07:45:14.331244 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 07:45:14.331244 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 07:45:14.331244 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 07:45:14.331244 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 07:45:14.331244 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 07:45:14.331244 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 07:45:14.331244 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 16 07:45:14.331244 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 16 07:45:14.331244 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 16 07:45:14.331244 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 16 07:45:14.332235 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 07:45:14.332235 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 07:45:14.332235 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 16 07:45:14.332235 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 07:45:14.332235 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 16 07:45:14.332235 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 07:45:14.332235 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 07:45:14.332235 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 07:45:14.332235 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 07:45:14.332235 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 07:45:14.332235 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 07:45:14.332235 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application with Lock( Sep 16 07:45:14.332235 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 07:45:14.332235 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._enter() Sep 16 07:45:14.332235 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 07:45:14.332235 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 07:45:14.332235 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 07:45:14.332235 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.creator() Sep 16 07:45:14.333244 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 07:45:14.333244 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application created_value = creator( Sep 16 07:45:14.333244 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 16 07:45:14.333244 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 16 07:45:14.333244 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 16 07:45:14.333244 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 16 07:45:14.333244 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 16 07:45:14.333244 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 16 07:45:14.333244 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 16 07:45:14.333244 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Sep 16 07:45:14.337808 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 609/1212] 10.222.0.57 () {56 vars in 1108 bytes} [Fri Sep 16 07:45:14 2022] GET /identity/v3/users/placement => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 07:45:14.338360 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d71bcd8-5d67-4f5b-bfe2-a668efd512c7 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:45:14.466890 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d71bcd8-5d67-4f5b-bfe2-a668efd512c7 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:45:14.507916 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0918d1d-f56b-4ef2-baeb-58b35c18a0d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:45:14.508636 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0918d1d-f56b-4ef2-baeb-58b35c18a0d5 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:45:14.508920 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0918d1d-f56b-4ef2-baeb-58b35c18a0d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:45:14.509276 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0918d1d-f56b-4ef2-baeb-58b35c18a0d5 None admin] PATH_INFO: `/v3/users` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:45:14.510079 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0918d1d-f56b-4ef2-baeb-58b35c18a0d5 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:45:14.510384 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0918d1d-f56b-4ef2-baeb-58b35c18a0d5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:45:14.512157 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0918d1d-f56b-4ef2-baeb-58b35c18a0d5 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:45:14.535546 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 604/1213] 10.222.0.57 () {56 vars in 1143 bytes} [Fri Sep 16 07:45:14 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:45:14.542091 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da4d4e2-1fdb-4966-8bca-d0a2adfeb30f None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:45:14.659932 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da4d4e2-1fdb-4966-8bca-d0a2adfeb30f None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:45:14.696586 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b4a829-0057-4658-b23b-3e86daa8d26a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:45:14.697302 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b4a829-0057-4658-b23b-3e86daa8d26a None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:45:14.697523 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b4a829-0057-4658-b23b-3e86daa8d26a None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:45:14.697785 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b4a829-0057-4658-b23b-3e86daa8d26a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:45:14.733048 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:45:14.793488 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b4a829-0057-4658-b23b-3e86daa8d26a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:45:14.794976 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b4a829-0057-4658-b23b-3e86daa8d26a None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:45:14.924676 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 610/1214] 10.222.0.57 () {58 vars in 1282 bytes} [Fri Sep 16 07:45:14 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 16 07:45:14.930637 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0918d1d-f56b-4ef2-baeb-58b35c18a0d5 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:45:14.955017 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:45:15.059004 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0918d1d-f56b-4ef2-baeb-58b35c18a0d5 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:45:15.099996 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c77d4b1-83a4-4cf0-be89-8273f0858b7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:45:15.100621 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c77d4b1-83a4-4cf0-be89-8273f0858b7d None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:45:15.100892 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c77d4b1-83a4-4cf0-be89-8273f0858b7d None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:45:15.103647 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c77d4b1-83a4-4cf0-be89-8273f0858b7d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:45:15.123981 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c77d4b1-83a4-4cf0-be89-8273f0858b7d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:45:15.125820 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c77d4b1-83a4-4cf0-be89-8273f0858b7d None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:45:15.145221 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application [None req-7c77d4b1-83a4-4cf0-be89-8273f0858b7d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 07:45:15.145221 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 07:45:15.145221 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 07:45:15.145221 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 07:45:15.145221 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 07:45:15.145221 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 07:45:15.145221 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 07:45:15.145221 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 07:45:15.145221 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 07:45:15.145221 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 07:45:15.145221 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 07:45:15.145221 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 07:45:15.145221 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 07:45:15.145221 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 07:45:15.145221 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 07:45:15.145221 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 07:45:15.146624 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 07:45:15.146624 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 07:45:15.146624 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 07:45:15.146624 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 07:45:15.146624 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 07:45:15.146624 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 07:45:15.146624 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 07:45:15.146624 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application with Lock( Sep 16 07:45:15.146624 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 07:45:15.146624 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._enter() Sep 16 07:45:15.146624 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 07:45:15.146624 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 07:45:15.146624 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 07:45:15.146624 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.creator() Sep 16 07:45:15.146624 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 07:45:15.146624 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application created_value = creator( Sep 16 07:45:15.146624 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 07:45:15.147738 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 07:45:15.147738 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 07:45:15.147738 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Sep 16 07:45:15.147738 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 605/1215] 10.222.0.57 () {56 vars in 1108 bytes} [Fri Sep 16 07:45:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 07:45:15.152605 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b4a829-0057-4658-b23b-3e86daa8d26a None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:45:15.224024 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:45:15.270886 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b4a829-0057-4658-b23b-3e86daa8d26a None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:45:15.308566 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0690dd9-910b-4999-8be9-e052fce83c84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:45:15.309466 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0690dd9-910b-4999-8be9-e052fce83c84 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:45:15.309695 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0690dd9-910b-4999-8be9-e052fce83c84 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:45:15.309968 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0690dd9-910b-4999-8be9-e052fce83c84 None admin] PATH_INFO: `/v3/domains` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:45:15.310710 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0690dd9-910b-4999-8be9-e052fce83c84 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:45:15.311085 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0690dd9-910b-4999-8be9-e052fce83c84 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:45:15.313799 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0690dd9-910b-4999-8be9-e052fce83c84 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:45:15.330949 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 611/1216] 10.222.0.57 () {56 vars in 1109 bytes} [Fri Sep 16 07:45:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 07:45:15.337270 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c77d4b1-83a4-4cf0-be89-8273f0858b7d None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:45:15.417174 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:45:15.460147 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c77d4b1-83a4-4cf0-be89-8273f0858b7d None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:45:15.498282 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca71c93b-9ce4-4c1f-b353-d80e9a874cd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:45:15.499898 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca71c93b-9ce4-4c1f-b353-d80e9a874cd6 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:45:15.500208 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca71c93b-9ce4-4c1f-b353-d80e9a874cd6 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:45:15.500510 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca71c93b-9ce4-4c1f-b353-d80e9a874cd6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:45:15.509929 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca71c93b-9ce4-4c1f-b353-d80e9a874cd6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:45:15.511714 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca71c93b-9ce4-4c1f-b353-d80e9a874cd6 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:45:15.524276 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application [None req-ca71c93b-9ce4-4c1f-b353-d80e9a874cd6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 07:45:15.524276 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 07:45:15.524276 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 07:45:15.524276 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 07:45:15.524276 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 07:45:15.524276 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 07:45:15.524276 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 07:45:15.524276 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 07:45:15.524276 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 07:45:15.524276 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 07:45:15.524276 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 07:45:15.524276 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 07:45:15.524276 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 16 07:45:15.524276 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 16 07:45:15.524276 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 16 07:45:15.525368 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 16 07:45:15.525368 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 07:45:15.525368 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 07:45:15.525368 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 07:45:15.525368 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 07:45:15.525368 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 07:45:15.525368 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 07:45:15.525368 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 07:45:15.525368 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application with Lock( Sep 16 07:45:15.525368 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 07:45:15.525368 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._enter() Sep 16 07:45:15.525368 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 07:45:15.525368 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 07:45:15.525368 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 07:45:15.525368 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.creator() Sep 16 07:45:15.525368 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 07:45:15.525368 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application created_value = creator( Sep 16 07:45:15.526441 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 16 07:45:15.526441 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 16 07:45:15.526441 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 16 07:45:15.526441 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 16 07:45:15.526441 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 16 07:45:15.526441 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 16 07:45:15.526441 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 07:45:15.526441 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Sep 16 07:45:15.526441 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 606/1217] 10.222.0.57 () {56 vars in 1111 bytes} [Fri Sep 16 07:45:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 07:45:15.531951 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0690dd9-910b-4999-8be9-e052fce83c84 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:45:15.644805 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0690dd9-910b-4999-8be9-e052fce83c84 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:45:15.671911 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:45:15.684569 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c41f75-1df7-4684-8dd0-16abf2404417 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:45:15.685174 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c41f75-1df7-4684-8dd0-16abf2404417 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:45:15.685457 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c41f75-1df7-4684-8dd0-16abf2404417 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:45:15.685745 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c41f75-1df7-4684-8dd0-16abf2404417 None admin] PATH_INFO: `/v3/projects` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:45:15.686472 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c41f75-1df7-4684-8dd0-16abf2404417 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:45:15.687519 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c41f75-1df7-4684-8dd0-16abf2404417 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:45:15.688951 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c41f75-1df7-4684-8dd0-16abf2404417 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:45:15.700908 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 612/1218] 10.222.0.57 () {56 vars in 1148 bytes} [Fri Sep 16 07:45:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:45:15.707925 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca71c93b-9ce4-4c1f-b353-d80e9a874cd6 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:45:15.824843 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca71c93b-9ce4-4c1f-b353-d80e9a874cd6 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:45:15.853790 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:45:15.861708 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a78f62a-7928-4c1e-b2db-cb165e159514 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:45:15.862342 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a78f62a-7928-4c1e-b2db-cb165e159514 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:45:15.862621 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a78f62a-7928-4c1e-b2db-cb165e159514 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:45:15.862942 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a78f62a-7928-4c1e-b2db-cb165e159514 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:45:15.863754 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a78f62a-7928-4c1e-b2db-cb165e159514 None admin] RBAC: Adding query filter params (role.id=f59220af7e7f4a8dbc30ba6325c7827c, scope.project.id=4735f453c0c24cc4a1c14e9ac84a0b46, user.id=c7d4ccdd6ef9400ba9e344df0964da1e) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:45:15.864060 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a78f62a-7928-4c1e-b2db-cb165e159514 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:45:15.865502 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a78f62a-7928-4c1e-b2db-cb165e159514 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:45:15.870978 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 607/1219] 10.222.0.57 () {56 vars in 1374 bytes} [Fri Sep 16 07:45:15 2022] GET /identity/v3/role_assignments?user.id=c7d4ccdd6ef9400ba9e344df0964da1e&scope.project.id=4735f453c0c24cc4a1c14e9ac84a0b46&role.id=f59220af7e7f4a8dbc30ba6325c7827c => generated 259 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:45:18.123417 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a505ec-18da-4f79-aac8-74017209c8e4 None None] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:45:18.124902 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a505ec-18da-4f79-aac8-74017209c8e4 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:45:18.124902 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a505ec-18da-4f79-aac8-74017209c8e4 None None] PATH_INFO: `/` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:45:18.126518 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 613/1220] 10.222.0.57 () {54 vars in 927 bytes} [Fri Sep 16 07:45:18 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 07:45:18.132210 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eca608d-cbd9-423a-b316-93b0da5899d3 None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:45:18.132708 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eca608d-cbd9-423a-b316-93b0da5899d3 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:45:18.132820 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eca608d-cbd9-423a-b316-93b0da5899d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:45:18.152218 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-3eca608d-cbd9-423a-b316-93b0da5899d3 None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:45:18.153427 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-3eca608d-cbd9-423a-b316-93b0da5899d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:45:18.228779 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 608/1221] 10.222.0.57 () {58 vars in 1024 bytes} [Fri Sep 16 07:45:18 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 16 07:45:18.537176 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a505ec-18da-4f79-aac8-74017209c8e4 None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:45:18.650729 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a505ec-18da-4f79-aac8-74017209c8e4 None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:45:18.690123 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea22686-b8e9-4a6c-b1d9-f838e40f2790 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:45:18.690750 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea22686-b8e9-4a6c-b1d9-f838e40f2790 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:45:18.691029 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea22686-b8e9-4a6c-b1d9-f838e40f2790 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:45:18.691300 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea22686-b8e9-4a6c-b1d9-f838e40f2790 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:45:18.702572 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea22686-b8e9-4a6c-b1d9-f838e40f2790 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 07:45:18.707506 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application [None req-0ea22686-b8e9-4a6c-b1d9-f838e40f2790 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 16 07:45:18.707506 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 07:45:18.707506 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 07:45:18.707506 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 07:45:18.707506 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 07:45:18.707506 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 07:45:18.707506 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 07:45:18.707506 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 07:45:18.707506 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 07:45:18.707506 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 07:45:18.707506 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 07:45:18.707506 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 07:45:18.707506 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 07:45:18.707506 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 07:45:18.707506 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 07:45:18.707506 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 07:45:18.708835 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 07:45:18.708835 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 07:45:18.708835 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 07:45:18.708835 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 07:45:18.708835 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 07:45:18.708835 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 07:45:18.708835 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 07:45:18.708835 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 07:45:18.708835 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 07:45:18.708835 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 07:45:18.708835 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 07:45:18.708835 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application with Lock( Sep 16 07:45:18.708835 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 07:45:18.708835 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._enter() Sep 16 07:45:18.708835 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 07:45:18.708835 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 07:45:18.710043 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 07:45:18.710043 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.creator() Sep 16 07:45:18.710043 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 07:45:18.710043 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application created_value = creator( Sep 16 07:45:18.710043 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 07:45:18.710043 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 07:45:18.710043 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 07:45:18.710043 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 07:45:18.710043 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 07:45:18.710043 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 07:45:18.710043 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 16 07:45:18.710043 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Sep 16 07:45:18.716697 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 614/1222] 10.222.0.57 () {56 vars in 1102 bytes} [Fri Sep 16 07:45:18 2022] GET /identity/v3/roles/service => generated 85 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 07:45:18.716845 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eca608d-cbd9-423a-b316-93b0da5899d3 None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:45:18.847256 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eca608d-cbd9-423a-b316-93b0da5899d3 None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:45:18.873538 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:45:18.886030 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393d8066-2e77-411b-9502-086f94665e54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:45:18.886698 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393d8066-2e77-411b-9502-086f94665e54 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:45:18.887016 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393d8066-2e77-411b-9502-086f94665e54 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:45:18.887251 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393d8066-2e77-411b-9502-086f94665e54 None admin] PATH_INFO: `/v3/roles` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:45:18.887975 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393d8066-2e77-411b-9502-086f94665e54 None admin] RBAC: Adding query filter params (name=service) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:45:18.888280 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393d8066-2e77-411b-9502-086f94665e54 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:45:18.890270 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393d8066-2e77-411b-9502-086f94665e54 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:45:18.899045 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 609/1223] 10.222.0.57 () {56 vars in 1103 bytes} [Fri Sep 16 07:45:18 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:45:18.906013 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea22686-b8e9-4a6c-b1d9-f838e40f2790 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:45:18.955126 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:45:19.019128 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea22686-b8e9-4a6c-b1d9-f838e40f2790 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:45:19.059142 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a2274d-83be-490f-87ef-d184228586f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:45:19.060187 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a2274d-83be-490f-87ef-d184228586f4 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:45:19.060187 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a2274d-83be-490f-87ef-d184228586f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:45:19.060396 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a2274d-83be-490f-87ef-d184228586f4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:45:19.072725 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a2274d-83be-490f-87ef-d184228586f4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:45:19.074260 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a2274d-83be-490f-87ef-d184228586f4 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:45:19.093649 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application [None req-b2a2274d-83be-490f-87ef-d184228586f4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 07:45:19.093649 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 07:45:19.093649 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 07:45:19.093649 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 07:45:19.093649 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 07:45:19.093649 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 07:45:19.093649 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 07:45:19.093649 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 07:45:19.093649 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 07:45:19.093649 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 07:45:19.093649 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 07:45:19.093649 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 07:45:19.093649 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 07:45:19.093649 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 07:45:19.093649 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 07:45:19.093649 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 07:45:19.094749 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 07:45:19.094749 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 07:45:19.094749 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 07:45:19.094749 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 07:45:19.094749 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 07:45:19.094749 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 07:45:19.094749 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 07:45:19.094749 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application with Lock( Sep 16 07:45:19.094749 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 07:45:19.094749 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._enter() Sep 16 07:45:19.094749 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 07:45:19.094749 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 07:45:19.094749 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 07:45:19.094749 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.creator() Sep 16 07:45:19.094749 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 07:45:19.094749 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application created_value = creator( Sep 16 07:45:19.094749 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 07:45:19.095701 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 07:45:19.095701 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 07:45:19.095701 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Sep 16 07:45:19.095701 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 615/1224] 10.222.0.57 () {56 vars in 1108 bytes} [Fri Sep 16 07:45:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 16 07:45:19.100998 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393d8066-2e77-411b-9502-086f94665e54 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:45:19.220203 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393d8066-2e77-411b-9502-086f94665e54 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:45:19.257684 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb85c05-0f2f-406a-8d1e-54d432f0d0c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:45:19.258427 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb85c05-0f2f-406a-8d1e-54d432f0d0c9 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:45:19.258726 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb85c05-0f2f-406a-8d1e-54d432f0d0c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:45:19.259132 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb85c05-0f2f-406a-8d1e-54d432f0d0c9 None admin] PATH_INFO: `/v3/domains` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:45:19.261079 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb85c05-0f2f-406a-8d1e-54d432f0d0c9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:45:19.261079 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb85c05-0f2f-406a-8d1e-54d432f0d0c9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:45:19.261495 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb85c05-0f2f-406a-8d1e-54d432f0d0c9 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:45:19.274482 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 610/1225] 10.222.0.57 () {56 vars in 1109 bytes} [Fri Sep 16 07:45:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 07:45:19.280258 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a2274d-83be-490f-87ef-d184228586f4 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:45:19.380322 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:45:19.388607 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a2274d-83be-490f-87ef-d184228586f4 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:45:19.428860 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508c5d71-44be-4d19-9fa8-c46a54b1e517 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:45:19.429868 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508c5d71-44be-4d19-9fa8-c46a54b1e517 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:45:19.430146 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508c5d71-44be-4d19-9fa8-c46a54b1e517 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:45:19.430425 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508c5d71-44be-4d19-9fa8-c46a54b1e517 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:45:19.438978 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508c5d71-44be-4d19-9fa8-c46a54b1e517 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:45:19.440588 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508c5d71-44be-4d19-9fa8-c46a54b1e517 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:45:19.451901 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application [None req-508c5d71-44be-4d19-9fa8-c46a54b1e517 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 16 07:45:19.451901 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 07:45:19.451901 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 07:45:19.451901 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 07:45:19.451901 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 07:45:19.451901 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 07:45:19.451901 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 07:45:19.451901 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 07:45:19.451901 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 07:45:19.451901 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 07:45:19.451901 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 07:45:19.451901 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 07:45:19.451901 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 16 07:45:19.451901 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 16 07:45:19.451901 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 16 07:45:19.451901 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 16 07:45:19.453142 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 07:45:19.453142 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 07:45:19.453142 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 16 07:45:19.453142 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 07:45:19.453142 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 16 07:45:19.453142 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 07:45:19.453142 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 07:45:19.453142 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 07:45:19.453142 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 07:45:19.453142 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 07:45:19.453142 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 07:45:19.453142 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application with Lock( Sep 16 07:45:19.453142 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 07:45:19.453142 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._enter() Sep 16 07:45:19.453142 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 07:45:19.453142 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 07:45:19.453142 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 07:45:19.453142 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.creator() Sep 16 07:45:19.454322 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 07:45:19.454322 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application created_value = creator( Sep 16 07:45:19.454322 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 16 07:45:19.454322 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 16 07:45:19.454322 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 16 07:45:19.454322 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 16 07:45:19.454322 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 16 07:45:19.454322 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 16 07:45:19.454322 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 16 07:45:19.454322 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Sep 16 07:45:19.454322 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 616/1226] 10.222.0.57 () {56 vars in 1108 bytes} [Fri Sep 16 07:45:19 2022] GET /identity/v3/users/placement => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 07:45:19.459366 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb85c05-0f2f-406a-8d1e-54d432f0d0c9 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:45:19.516851 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:45:19.575704 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb85c05-0f2f-406a-8d1e-54d432f0d0c9 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:45:19.614873 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6451fc-0ca3-4e7a-9a12-0d32d136fc38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:45:19.615804 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6451fc-0ca3-4e7a-9a12-0d32d136fc38 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:45:19.616090 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6451fc-0ca3-4e7a-9a12-0d32d136fc38 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:45:19.616379 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6451fc-0ca3-4e7a-9a12-0d32d136fc38 None admin] PATH_INFO: `/v3/users` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:45:19.618090 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6451fc-0ca3-4e7a-9a12-0d32d136fc38 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:45:19.618404 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6451fc-0ca3-4e7a-9a12-0d32d136fc38 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:45:19.619914 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6451fc-0ca3-4e7a-9a12-0d32d136fc38 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:45:19.641903 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 611/1227] 10.222.0.57 () {56 vars in 1143 bytes} [Fri Sep 16 07:45:19 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:45:19.647712 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508c5d71-44be-4d19-9fa8-c46a54b1e517 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:45:19.760267 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508c5d71-44be-4d19-9fa8-c46a54b1e517 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:45:19.808731 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64650a33-c47c-483d-8414-1459c40af956 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:45:19.809360 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64650a33-c47c-483d-8414-1459c40af956 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:45:19.809812 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64650a33-c47c-483d-8414-1459c40af956 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:45:19.810213 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64650a33-c47c-483d-8414-1459c40af956 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:45:19.824323 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64650a33-c47c-483d-8414-1459c40af956 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:45:19.826130 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64650a33-c47c-483d-8414-1459c40af956 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:45:19.843414 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application [None req-64650a33-c47c-483d-8414-1459c40af956 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 07:45:19.843414 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 07:45:19.843414 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 07:45:19.843414 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 07:45:19.843414 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 07:45:19.843414 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 07:45:19.843414 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 07:45:19.843414 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 07:45:19.843414 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 07:45:19.843414 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 07:45:19.843414 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 07:45:19.843414 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 07:45:19.843414 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 07:45:19.843414 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 07:45:19.843414 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 07:45:19.843414 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 07:45:19.844449 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 07:45:19.844449 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 07:45:19.844449 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 07:45:19.844449 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 07:45:19.844449 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 07:45:19.844449 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 07:45:19.844449 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 07:45:19.844449 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application with Lock( Sep 16 07:45:19.844449 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 07:45:19.844449 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._enter() Sep 16 07:45:19.844449 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 07:45:19.844449 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 07:45:19.844449 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 07:45:19.844449 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.creator() Sep 16 07:45:19.844449 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 07:45:19.844449 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application created_value = creator( Sep 16 07:45:19.844449 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 07:45:19.845369 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 07:45:19.845369 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 07:45:19.845369 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Sep 16 07:45:19.845369 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 617/1228] 10.222.0.57 () {56 vars in 1108 bytes} [Fri Sep 16 07:45:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 07:45:19.850912 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6451fc-0ca3-4e7a-9a12-0d32d136fc38 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:45:19.956782 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6451fc-0ca3-4e7a-9a12-0d32d136fc38 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:45:19.959142 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:45:19.992795 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc4e2a7-4b57-452f-8d7b-c6322cc99c8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:45:19.993413 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc4e2a7-4b57-452f-8d7b-c6322cc99c8f None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:45:19.993693 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc4e2a7-4b57-452f-8d7b-c6322cc99c8f None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:45:19.993989 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc4e2a7-4b57-452f-8d7b-c6322cc99c8f None admin] PATH_INFO: `/v3/domains` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:45:19.994629 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc4e2a7-4b57-452f-8d7b-c6322cc99c8f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:45:19.994929 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc4e2a7-4b57-452f-8d7b-c6322cc99c8f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:45:19.996297 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc4e2a7-4b57-452f-8d7b-c6322cc99c8f None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:45:20.009646 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 612/1229] 10.222.0.57 () {56 vars in 1109 bytes} [Fri Sep 16 07:45:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:45:20.016267 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64650a33-c47c-483d-8414-1459c40af956 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:45:20.026487 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:45:20.128489 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64650a33-c47c-483d-8414-1459c40af956 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:45:20.167504 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56080c3-cfc6-4da2-a078-185bcf1d82e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:45:20.168157 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56080c3-cfc6-4da2-a078-185bcf1d82e5 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:45:20.168413 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56080c3-cfc6-4da2-a078-185bcf1d82e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:45:20.168751 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56080c3-cfc6-4da2-a078-185bcf1d82e5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:45:20.176389 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56080c3-cfc6-4da2-a078-185bcf1d82e5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:45:20.177865 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56080c3-cfc6-4da2-a078-185bcf1d82e5 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:45:20.189559 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application [None req-d56080c3-cfc6-4da2-a078-185bcf1d82e5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 07:45:20.189559 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 07:45:20.189559 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 07:45:20.189559 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 07:45:20.189559 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 07:45:20.189559 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 07:45:20.189559 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 07:45:20.189559 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 07:45:20.189559 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 07:45:20.189559 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 07:45:20.189559 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 07:45:20.189559 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 07:45:20.189559 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 16 07:45:20.189559 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 16 07:45:20.189559 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 16 07:45:20.190731 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 16 07:45:20.190731 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 07:45:20.190731 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 07:45:20.190731 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 07:45:20.190731 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 07:45:20.190731 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 07:45:20.190731 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 07:45:20.190731 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 07:45:20.190731 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application with Lock( Sep 16 07:45:20.190731 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 07:45:20.190731 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._enter() Sep 16 07:45:20.190731 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 07:45:20.190731 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 07:45:20.190731 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 07:45:20.190731 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.creator() Sep 16 07:45:20.190731 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 07:45:20.190731 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application created_value = creator( Sep 16 07:45:20.198015 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 16 07:45:20.198015 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 16 07:45:20.198015 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 16 07:45:20.198015 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 16 07:45:20.198015 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 16 07:45:20.198015 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 16 07:45:20.198015 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 07:45:20.198015 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Sep 16 07:45:20.198015 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 618/1230] 10.222.0.57 () {56 vars in 1111 bytes} [Fri Sep 16 07:45:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 07:45:20.198668 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc4e2a7-4b57-452f-8d7b-c6322cc99c8f None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:45:20.305615 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc4e2a7-4b57-452f-8d7b-c6322cc99c8f None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:45:20.340032 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fb4097-2b3d-4e07-8063-6ea53a8a3e39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:45:20.340625 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fb4097-2b3d-4e07-8063-6ea53a8a3e39 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:45:20.340927 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fb4097-2b3d-4e07-8063-6ea53a8a3e39 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:45:20.341189 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fb4097-2b3d-4e07-8063-6ea53a8a3e39 None admin] PATH_INFO: `/v3/projects` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:45:20.341946 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61fb4097-2b3d-4e07-8063-6ea53a8a3e39 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:45:20.342247 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61fb4097-2b3d-4e07-8063-6ea53a8a3e39 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:45:20.343890 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61fb4097-2b3d-4e07-8063-6ea53a8a3e39 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:45:20.357094 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 613/1231] 10.222.0.57 () {56 vars in 1148 bytes} [Fri Sep 16 07:45:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:45:20.364068 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56080c3-cfc6-4da2-a078-185bcf1d82e5 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:45:20.439888 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:45:20.479192 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56080c3-cfc6-4da2-a078-185bcf1d82e5 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:45:20.516179 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e979754-9ab1-4b07-8e4b-c2597941f6d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:45:20.516976 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e979754-9ab1-4b07-8e4b-c2597941f6d4 None admin] REQUEST_METHOD: `PUT` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:45:20.517244 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e979754-9ab1-4b07-8e4b-c2597941f6d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:45:20.517518 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e979754-9ab1-4b07-8e4b-c2597941f6d4 None admin] PATH_INFO: `/v3/projects/4735f453c0c24cc4a1c14e9ac84a0b46/users/c7d4ccdd6ef9400ba9e344df0964da1e/roles/f59220af7e7f4a8dbc30ba6325c7827c` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:45:20.535407 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e979754-9ab1-4b07-8e4b-c2597941f6d4 None admin] RBAC: Authorizing `identity:create_grant(project_id=4735f453c0c24cc4a1c14e9ac84a0b46, user_id=c7d4ccdd6ef9400ba9e344df0964da1e, role_id=f59220af7e7f4a8dbc30ba6325c7827c)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:45:20.536985 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e979754-9ab1-4b07-8e4b-c2597941f6d4 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:45:20.550553 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 619/1232] 10.222.0.57 () {58 vars in 1439 bytes} [Fri Sep 16 07:45:20 2022] PUT /identity/v3/projects/4735f453c0c24cc4a1c14e9ac84a0b46/users/c7d4ccdd6ef9400ba9e344df0964da1e/roles/f59220af7e7f4a8dbc30ba6325c7827c => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 16 07:45:22.926839 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d20a00d-a423-400e-a84c-e98146f4fdb9 None None] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:45:22.927392 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d20a00d-a423-400e-a84c-e98146f4fdb9 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:45:22.927650 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d20a00d-a423-400e-a84c-e98146f4fdb9 None None] PATH_INFO: `/` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:45:22.929578 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 614/1233] 10.222.0.57 () {54 vars in 927 bytes} [Fri Sep 16 07:45:22 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 07:45:22.935850 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fb5f3a-8f57-4418-b216-76259ebca276 None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:45:22.936812 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fb5f3a-8f57-4418-b216-76259ebca276 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:45:22.937167 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fb5f3a-8f57-4418-b216-76259ebca276 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:45:22.959444 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-91fb5f3a-8f57-4418-b216-76259ebca276 None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:45:22.961408 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-91fb5f3a-8f57-4418-b216-76259ebca276 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:45:23.040726 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 620/1234] 10.222.0.57 () {58 vars in 1024 bytes} [Fri Sep 16 07:45:22 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 16 07:45:23.327590 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d20a00d-a423-400e-a84c-e98146f4fdb9 None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:45:23.352619 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:45:23.435377 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d20a00d-a423-400e-a84c-e98146f4fdb9 None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:45:23.472909 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492ba504-b893-46d6-b3d8-2b1bb26c62b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:45:23.473566 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492ba504-b893-46d6-b3d8-2b1bb26c62b4 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:45:23.473960 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492ba504-b893-46d6-b3d8-2b1bb26c62b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:45:23.474250 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492ba504-b893-46d6-b3d8-2b1bb26c62b4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:45:23.486501 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492ba504-b893-46d6-b3d8-2b1bb26c62b4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 07:45:23.491325 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application [None req-492ba504-b893-46d6-b3d8-2b1bb26c62b4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 16 07:45:23.491325 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 07:45:23.491325 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 07:45:23.491325 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 07:45:23.491325 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 07:45:23.491325 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 07:45:23.491325 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 07:45:23.491325 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 07:45:23.491325 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 07:45:23.491325 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 07:45:23.491325 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 07:45:23.491325 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 07:45:23.491325 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 07:45:23.491325 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 07:45:23.491325 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 07:45:23.491325 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 07:45:23.492303 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 07:45:23.492303 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 07:45:23.492303 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 07:45:23.492303 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 07:45:23.492303 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 07:45:23.492303 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 07:45:23.492303 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 07:45:23.492303 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 07:45:23.492303 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 07:45:23.492303 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 07:45:23.492303 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 07:45:23.492303 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application with Lock( Sep 16 07:45:23.492303 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 07:45:23.492303 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._enter() Sep 16 07:45:23.492303 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 07:45:23.492303 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 07:45:23.493151 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 07:45:23.493151 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.creator() Sep 16 07:45:23.493151 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 07:45:23.493151 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application created_value = creator( Sep 16 07:45:23.493151 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 07:45:23.493151 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 07:45:23.493151 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 07:45:23.493151 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 07:45:23.493151 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 07:45:23.493151 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 07:45:23.493151 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 16 07:45:23.493151 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Sep 16 07:45:23.493151 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 615/1235] 10.222.0.57 () {56 vars in 1102 bytes} [Fri Sep 16 07:45:23 2022] GET /identity/v3/roles/service => generated 85 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 07:45:23.499239 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fb5f3a-8f57-4418-b216-76259ebca276 None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:45:23.548341 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:45:23.605349 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fb5f3a-8f57-4418-b216-76259ebca276 None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:45:23.640870 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b263be8-1c3e-4c4f-9e4e-bd2ed4272adc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:45:23.641493 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b263be8-1c3e-4c4f-9e4e-bd2ed4272adc None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:45:23.641810 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b263be8-1c3e-4c4f-9e4e-bd2ed4272adc None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:45:23.642075 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b263be8-1c3e-4c4f-9e4e-bd2ed4272adc None admin] PATH_INFO: `/v3/roles` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:45:23.642747 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b263be8-1c3e-4c4f-9e4e-bd2ed4272adc None admin] RBAC: Adding query filter params (name=service) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:45:23.643101 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b263be8-1c3e-4c4f-9e4e-bd2ed4272adc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:45:23.644410 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b263be8-1c3e-4c4f-9e4e-bd2ed4272adc None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:45:23.653064 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 621/1236] 10.222.0.57 () {56 vars in 1103 bytes} [Fri Sep 16 07:45:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:45:23.660142 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492ba504-b893-46d6-b3d8-2b1bb26c62b4 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:45:23.751474 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:45:23.768734 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492ba504-b893-46d6-b3d8-2b1bb26c62b4 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:45:23.810233 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4472c2f-0abe-43cd-a8b0-74a0eeabba96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:45:23.810927 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4472c2f-0abe-43cd-a8b0-74a0eeabba96 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:45:23.811377 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4472c2f-0abe-43cd-a8b0-74a0eeabba96 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:45:23.811869 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4472c2f-0abe-43cd-a8b0-74a0eeabba96 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:45:23.824233 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4472c2f-0abe-43cd-a8b0-74a0eeabba96 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:45:23.825676 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4472c2f-0abe-43cd-a8b0-74a0eeabba96 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:45:23.845063 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application [None req-f4472c2f-0abe-43cd-a8b0-74a0eeabba96 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 07:45:23.845063 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 07:45:23.845063 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 07:45:23.845063 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 07:45:23.845063 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 07:45:23.845063 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 07:45:23.845063 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 07:45:23.845063 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 07:45:23.845063 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 07:45:23.845063 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 07:45:23.845063 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 07:45:23.845063 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 07:45:23.845063 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 07:45:23.845063 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 07:45:23.845063 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 07:45:23.845063 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 07:45:23.846346 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 07:45:23.846346 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 07:45:23.846346 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 07:45:23.846346 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 07:45:23.846346 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 07:45:23.846346 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 07:45:23.846346 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 07:45:23.846346 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application with Lock( Sep 16 07:45:23.846346 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 07:45:23.846346 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._enter() Sep 16 07:45:23.846346 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 07:45:23.846346 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 07:45:23.846346 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 07:45:23.846346 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.creator() Sep 16 07:45:23.846346 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 07:45:23.846346 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application created_value = creator( Sep 16 07:45:23.846346 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 07:45:23.847483 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 07:45:23.847483 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 07:45:23.847483 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Sep 16 07:45:23.847483 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 616/1237] 10.222.0.57 () {56 vars in 1108 bytes} [Fri Sep 16 07:45:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 07:45:23.853443 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b263be8-1c3e-4c4f-9e4e-bd2ed4272adc None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:45:23.974918 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b263be8-1c3e-4c4f-9e4e-bd2ed4272adc None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:45:23.984688 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:45:24.016790 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0ec403-01e1-4f19-95b4-cf5191d8e1d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:45:24.017438 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0ec403-01e1-4f19-95b4-cf5191d8e1d1 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:45:24.017995 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0ec403-01e1-4f19-95b4-cf5191d8e1d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:45:24.018407 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0ec403-01e1-4f19-95b4-cf5191d8e1d1 None admin] PATH_INFO: `/v3/domains` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:45:24.019515 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0ec403-01e1-4f19-95b4-cf5191d8e1d1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:45:24.019820 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0ec403-01e1-4f19-95b4-cf5191d8e1d1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:45:24.021421 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0ec403-01e1-4f19-95b4-cf5191d8e1d1 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:45:24.036512 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 622/1238] 10.222.0.57 () {56 vars in 1109 bytes} [Fri Sep 16 07:45:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:45:24.042436 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4472c2f-0abe-43cd-a8b0-74a0eeabba96 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:45:24.159533 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4472c2f-0abe-43cd-a8b0-74a0eeabba96 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:45:24.200300 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e98736-244a-49ea-a081-376d377ec4a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:45:24.201466 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e98736-244a-49ea-a081-376d377ec4a3 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:45:24.202197 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e98736-244a-49ea-a081-376d377ec4a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:45:24.202484 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e98736-244a-49ea-a081-376d377ec4a3 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:45:24.205942 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:45:24.213598 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e98736-244a-49ea-a081-376d377ec4a3 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:45:24.215982 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e98736-244a-49ea-a081-376d377ec4a3 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:45:24.228998 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application [None req-28e98736-244a-49ea-a081-376d377ec4a3 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 16 07:45:24.228998 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 07:45:24.228998 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 07:45:24.228998 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 07:45:24.228998 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 07:45:24.228998 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 07:45:24.228998 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 07:45:24.228998 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 07:45:24.228998 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 07:45:24.228998 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 07:45:24.228998 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 07:45:24.228998 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 07:45:24.228998 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 16 07:45:24.228998 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 16 07:45:24.228998 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 16 07:45:24.228998 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 16 07:45:24.230216 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 07:45:24.230216 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 07:45:24.230216 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 16 07:45:24.230216 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 07:45:24.230216 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 16 07:45:24.230216 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 07:45:24.230216 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 07:45:24.230216 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 07:45:24.230216 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 07:45:24.230216 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 07:45:24.230216 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 07:45:24.230216 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application with Lock( Sep 16 07:45:24.230216 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 07:45:24.230216 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._enter() Sep 16 07:45:24.230216 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 07:45:24.230216 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 07:45:24.230216 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 07:45:24.230216 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.creator() Sep 16 07:45:24.231403 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 07:45:24.231403 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application created_value = creator( Sep 16 07:45:24.231403 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 16 07:45:24.231403 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 16 07:45:24.231403 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 16 07:45:24.231403 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 16 07:45:24.231403 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 16 07:45:24.231403 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 16 07:45:24.231403 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 16 07:45:24.231403 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Sep 16 07:45:24.235744 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 617/1239] 10.222.0.57 () {56 vars in 1108 bytes} [Fri Sep 16 07:45:24 2022] GET /identity/v3/users/placement => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 07:45:24.237248 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0ec403-01e1-4f19-95b4-cf5191d8e1d1 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:45:24.353463 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0ec403-01e1-4f19-95b4-cf5191d8e1d1 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:45:24.390359 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a1113d-df2c-4bee-b81e-b16f08fc19b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:45:24.390959 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a1113d-df2c-4bee-b81e-b16f08fc19b6 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:45:24.391244 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a1113d-df2c-4bee-b81e-b16f08fc19b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:45:24.391543 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a1113d-df2c-4bee-b81e-b16f08fc19b6 None admin] PATH_INFO: `/v3/users` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:45:24.392260 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a1113d-df2c-4bee-b81e-b16f08fc19b6 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:45:24.392565 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a1113d-df2c-4bee-b81e-b16f08fc19b6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:45:24.394033 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a1113d-df2c-4bee-b81e-b16f08fc19b6 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:45:24.412682 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 623/1240] 10.222.0.57 () {56 vars in 1143 bytes} [Fri Sep 16 07:45:24 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 07:45:24.418758 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e98736-244a-49ea-a081-376d377ec4a3 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:45:24.536983 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e98736-244a-49ea-a081-376d377ec4a3 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:45:24.581233 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d6405a-f49b-48d0-b6e0-d3e6e1a1ffcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:45:24.581822 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d6405a-f49b-48d0-b6e0-d3e6e1a1ffcf None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:45:24.582103 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d6405a-f49b-48d0-b6e0-d3e6e1a1ffcf None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:45:24.582373 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d6405a-f49b-48d0-b6e0-d3e6e1a1ffcf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:45:24.656896 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:45:24.665891 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d6405a-f49b-48d0-b6e0-d3e6e1a1ffcf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:45:24.668341 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d6405a-f49b-48d0-b6e0-d3e6e1a1ffcf None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:45:24.784959 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 618/1241] 10.222.0.57 () {58 vars in 1282 bytes} [Fri Sep 16 07:45:24 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 16 07:45:24.791157 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a1113d-df2c-4bee-b81e-b16f08fc19b6 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:45:24.820030 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:45:24.907960 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a1113d-df2c-4bee-b81e-b16f08fc19b6 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:45:24.946295 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146039be-023b-427d-bec2-7a22968c7b09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:45:24.947224 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146039be-023b-427d-bec2-7a22968c7b09 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:45:24.947543 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146039be-023b-427d-bec2-7a22968c7b09 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:45:24.947815 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146039be-023b-427d-bec2-7a22968c7b09 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:45:24.959265 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146039be-023b-427d-bec2-7a22968c7b09 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:45:24.960691 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146039be-023b-427d-bec2-7a22968c7b09 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:45:24.975881 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application [None req-146039be-023b-427d-bec2-7a22968c7b09 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 07:45:24.975881 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 07:45:24.975881 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 07:45:24.975881 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 07:45:24.975881 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 07:45:24.975881 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 07:45:24.975881 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 07:45:24.975881 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 07:45:24.975881 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 07:45:24.975881 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 07:45:24.975881 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 07:45:24.975881 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 07:45:24.975881 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 07:45:24.975881 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 07:45:24.975881 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 07:45:24.975881 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 07:45:24.977573 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 07:45:24.977573 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 07:45:24.977573 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 07:45:24.977573 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 07:45:24.977573 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 07:45:24.977573 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 07:45:24.977573 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 07:45:24.977573 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application with Lock( Sep 16 07:45:24.977573 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 07:45:24.977573 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._enter() Sep 16 07:45:24.977573 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 07:45:24.977573 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 07:45:24.977573 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 07:45:24.977573 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.creator() Sep 16 07:45:24.977573 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 07:45:24.977573 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application created_value = creator( Sep 16 07:45:24.977573 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 07:45:24.978595 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 07:45:24.978595 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 07:45:24.978595 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Sep 16 07:45:24.978595 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 624/1242] 10.222.0.57 () {56 vars in 1108 bytes} [Fri Sep 16 07:45:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 07:45:24.983023 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d6405a-f49b-48d0-b6e0-d3e6e1a1ffcf None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:45:25.089975 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:45:25.099524 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d6405a-f49b-48d0-b6e0-d3e6e1a1ffcf None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:45:25.141734 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c507918-3411-4ac3-9f5a-9184d839d4b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:45:25.142374 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c507918-3411-4ac3-9f5a-9184d839d4b4 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:45:25.142649 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c507918-3411-4ac3-9f5a-9184d839d4b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:45:25.142969 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c507918-3411-4ac3-9f5a-9184d839d4b4 None admin] PATH_INFO: `/v3/domains` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:45:25.143606 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c507918-3411-4ac3-9f5a-9184d839d4b4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:45:25.143959 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c507918-3411-4ac3-9f5a-9184d839d4b4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:45:25.145355 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c507918-3411-4ac3-9f5a-9184d839d4b4 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:45:25.158639 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 619/1243] 10.222.0.57 () {56 vars in 1109 bytes} [Fri Sep 16 07:45:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 07:45:25.164821 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146039be-023b-427d-bec2-7a22968c7b09 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:45:25.272726 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:45:25.304239 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146039be-023b-427d-bec2-7a22968c7b09 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:45:25.349953 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01edf62-9e4e-4f5d-98fe-e5ddc9f93e66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:45:25.350608 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01edf62-9e4e-4f5d-98fe-e5ddc9f93e66 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:45:25.350854 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01edf62-9e4e-4f5d-98fe-e5ddc9f93e66 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:45:25.351182 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01edf62-9e4e-4f5d-98fe-e5ddc9f93e66 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:45:25.359468 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01edf62-9e4e-4f5d-98fe-e5ddc9f93e66 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:45:25.361056 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01edf62-9e4e-4f5d-98fe-e5ddc9f93e66 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:45:25.374924 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application [None req-d01edf62-9e4e-4f5d-98fe-e5ddc9f93e66 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 07:45:25.374924 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 07:45:25.374924 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 07:45:25.374924 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 07:45:25.374924 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 07:45:25.374924 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 07:45:25.374924 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 07:45:25.374924 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 07:45:25.374924 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 07:45:25.374924 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 07:45:25.374924 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 07:45:25.374924 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 07:45:25.374924 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 16 07:45:25.374924 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 16 07:45:25.374924 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 16 07:45:25.376387 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 16 07:45:25.376387 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 07:45:25.376387 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 07:45:25.376387 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 07:45:25.376387 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 07:45:25.376387 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 07:45:25.376387 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 07:45:25.376387 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 07:45:25.376387 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application with Lock( Sep 16 07:45:25.376387 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 07:45:25.376387 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._enter() Sep 16 07:45:25.376387 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 07:45:25.376387 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 07:45:25.376387 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 07:45:25.376387 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.creator() Sep 16 07:45:25.376387 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 07:45:25.376387 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application created_value = creator( Sep 16 07:45:25.377548 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 16 07:45:25.377548 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 16 07:45:25.377548 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 16 07:45:25.377548 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 16 07:45:25.377548 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 16 07:45:25.377548 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 16 07:45:25.377548 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 07:45:25.377548 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Sep 16 07:45:25.377548 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 625/1244] 10.222.0.57 () {56 vars in 1111 bytes} [Fri Sep 16 07:45:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 07:45:25.382925 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c507918-3411-4ac3-9f5a-9184d839d4b4 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:45:25.498547 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c507918-3411-4ac3-9f5a-9184d839d4b4 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:45:25.538218 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d43f9b-6e30-41ae-9e91-57e22d80e202 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:45:25.539074 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d43f9b-6e30-41ae-9e91-57e22d80e202 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:45:25.539456 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d43f9b-6e30-41ae-9e91-57e22d80e202 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:45:25.539828 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d43f9b-6e30-41ae-9e91-57e22d80e202 None admin] PATH_INFO: `/v3/projects` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:45:25.540752 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d43f9b-6e30-41ae-9e91-57e22d80e202 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:45:25.541051 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d43f9b-6e30-41ae-9e91-57e22d80e202 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:45:25.542492 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d43f9b-6e30-41ae-9e91-57e22d80e202 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:45:25.556349 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 620/1245] 10.222.0.57 () {56 vars in 1148 bytes} [Fri Sep 16 07:45:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:45:25.564516 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01edf62-9e4e-4f5d-98fe-e5ddc9f93e66 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:45:25.685337 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01edf62-9e4e-4f5d-98fe-e5ddc9f93e66 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:45:25.726727 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9758e53c-f493-47f3-b398-44f469c41495 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:45:25.727491 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9758e53c-f493-47f3-b398-44f469c41495 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:45:25.727815 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9758e53c-f493-47f3-b398-44f469c41495 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:45:25.728224 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9758e53c-f493-47f3-b398-44f469c41495 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:45:25.728948 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9758e53c-f493-47f3-b398-44f469c41495 None admin] RBAC: Adding query filter params (role.id=f59220af7e7f4a8dbc30ba6325c7827c, scope.project.id=4735f453c0c24cc4a1c14e9ac84a0b46, user.id=c7d4ccdd6ef9400ba9e344df0964da1e) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:45:25.729256 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9758e53c-f493-47f3-b398-44f469c41495 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:45:25.730953 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9758e53c-f493-47f3-b398-44f469c41495 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:45:25.738017 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 626/1246] 10.222.0.57 () {56 vars in 1374 bytes} [Fri Sep 16 07:45:25 2022] GET /identity/v3/role_assignments?user.id=c7d4ccdd6ef9400ba9e344df0964da1e&scope.project.id=4735f453c0c24cc4a1c14e9ac84a0b46&role.id=f59220af7e7f4a8dbc30ba6325c7827c => generated 608 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:45:28.010060 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54091949-47c8-47d9-8376-378f992fe9a2 None None] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:45:28.010642 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54091949-47c8-47d9-8376-378f992fe9a2 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:45:28.010642 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54091949-47c8-47d9-8376-378f992fe9a2 None None] PATH_INFO: `/` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:45:28.011960 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 621/1247] 10.222.0.57 () {54 vars in 927 bytes} [Fri Sep 16 07:45:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 07:45:28.018357 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1869e3-dda2-42da-8258-7c9e0f1dbda7 None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:45:28.018357 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1869e3-dda2-42da-8258-7c9e0f1dbda7 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:45:28.019109 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1869e3-dda2-42da-8258-7c9e0f1dbda7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:45:28.026004 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:45:28.039568 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-4a1869e3-dda2-42da-8258-7c9e0f1dbda7 None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:45:28.040859 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-4a1869e3-dda2-42da-8258-7c9e0f1dbda7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:45:28.115888 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 627/1248] 10.222.0.57 () {58 vars in 1024 bytes} [Fri Sep 16 07:45:28 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 16 07:45:28.408352 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54091949-47c8-47d9-8376-378f992fe9a2 None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:45:28.430278 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:45:28.536036 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54091949-47c8-47d9-8376-378f992fe9a2 None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:45:28.575029 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068c941b-f252-4842-8290-8dffaa88a900 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:45:28.575661 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068c941b-f252-4842-8290-8dffaa88a900 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:45:28.575934 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068c941b-f252-4842-8290-8dffaa88a900 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:45:28.576204 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068c941b-f252-4842-8290-8dffaa88a900 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:45:28.587143 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068c941b-f252-4842-8290-8dffaa88a900 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 07:45:28.591940 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application [None req-068c941b-f252-4842-8290-8dffaa88a900 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 16 07:45:28.591940 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 07:45:28.591940 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 07:45:28.591940 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 07:45:28.591940 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 07:45:28.591940 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 07:45:28.591940 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 07:45:28.591940 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 07:45:28.591940 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 07:45:28.591940 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 07:45:28.591940 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 07:45:28.591940 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 07:45:28.591940 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 07:45:28.591940 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 07:45:28.591940 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 07:45:28.591940 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 07:45:28.593012 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 07:45:28.593012 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 07:45:28.593012 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 07:45:28.593012 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 07:45:28.593012 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 07:45:28.593012 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 07:45:28.593012 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 07:45:28.593012 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 07:45:28.593012 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 07:45:28.593012 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 07:45:28.593012 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 07:45:28.593012 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application with Lock( Sep 16 07:45:28.593012 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 07:45:28.593012 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._enter() Sep 16 07:45:28.593012 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 07:45:28.593012 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 07:45:28.593916 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 07:45:28.593916 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.creator() Sep 16 07:45:28.593916 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 07:45:28.593916 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application created_value = creator( Sep 16 07:45:28.593916 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 07:45:28.593916 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 07:45:28.593916 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 07:45:28.593916 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 07:45:28.593916 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 07:45:28.593916 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 07:45:28.593916 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 16 07:45:28.593916 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Sep 16 07:45:28.593916 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 622/1249] 10.222.0.57 () {56 vars in 1096 bytes} [Fri Sep 16 07:45:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 07:45:28.599630 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1869e3-dda2-42da-8258-7c9e0f1dbda7 None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:45:28.709207 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1869e3-dda2-42da-8258-7c9e0f1dbda7 None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:45:28.742311 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:45:28.749357 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c684c0-72f7-4f59-b366-b1580a33f09d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:45:28.750191 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c684c0-72f7-4f59-b366-b1580a33f09d None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:45:28.750563 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c684c0-72f7-4f59-b366-b1580a33f09d None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:45:28.750999 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c684c0-72f7-4f59-b366-b1580a33f09d None admin] PATH_INFO: `/v3/roles` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:45:28.752039 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c684c0-72f7-4f59-b366-b1580a33f09d None admin] RBAC: Adding query filter params (name=admin) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:45:28.752193 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c684c0-72f7-4f59-b366-b1580a33f09d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:45:28.754216 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c684c0-72f7-4f59-b366-b1580a33f09d None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:45:28.771723 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 628/1250] 10.222.0.57 () {56 vars in 1099 bytes} [Fri Sep 16 07:45:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 07:45:28.774920 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068c941b-f252-4842-8290-8dffaa88a900 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:45:28.862682 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:45:28.887340 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068c941b-f252-4842-8290-8dffaa88a900 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:45:28.923611 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41efe886-52c0-4ddd-bb96-f1498d1850b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:45:28.924255 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41efe886-52c0-4ddd-bb96-f1498d1850b5 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:45:28.924532 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41efe886-52c0-4ddd-bb96-f1498d1850b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:45:28.924802 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41efe886-52c0-4ddd-bb96-f1498d1850b5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:45:28.936389 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41efe886-52c0-4ddd-bb96-f1498d1850b5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:45:28.937903 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41efe886-52c0-4ddd-bb96-f1498d1850b5 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:45:28.954348 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application [None req-41efe886-52c0-4ddd-bb96-f1498d1850b5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 07:45:28.954348 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 07:45:28.954348 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 07:45:28.954348 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 07:45:28.954348 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 07:45:28.954348 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 07:45:28.954348 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 07:45:28.954348 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 07:45:28.954348 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 07:45:28.954348 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 07:45:28.954348 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 07:45:28.954348 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 07:45:28.954348 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 07:45:28.954348 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 07:45:28.954348 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 07:45:28.954348 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 07:45:28.960524 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 07:45:28.960524 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 07:45:28.960524 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 07:45:28.960524 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 07:45:28.960524 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 07:45:28.960524 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 07:45:28.960524 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 07:45:28.960524 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application with Lock( Sep 16 07:45:28.960524 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 07:45:28.960524 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._enter() Sep 16 07:45:28.960524 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 07:45:28.960524 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 07:45:28.960524 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 07:45:28.960524 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.creator() Sep 16 07:45:28.960524 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 07:45:28.960524 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application created_value = creator( Sep 16 07:45:28.960524 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 07:45:28.961757 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 07:45:28.961757 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 07:45:28.961757 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Sep 16 07:45:28.961757 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 623/1251] 10.222.0.57 () {56 vars in 1108 bytes} [Fri Sep 16 07:45:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 07:45:28.962058 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c684c0-72f7-4f59-b366-b1580a33f09d None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:45:29.063519 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c684c0-72f7-4f59-b366-b1580a33f09d None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:45:29.098108 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134a5b80-3650-4a5a-bad5-225cc100dfad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:45:29.098708 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134a5b80-3650-4a5a-bad5-225cc100dfad None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:45:29.098986 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134a5b80-3650-4a5a-bad5-225cc100dfad None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:45:29.099258 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134a5b80-3650-4a5a-bad5-225cc100dfad None admin] PATH_INFO: `/v3/domains` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:45:29.099904 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134a5b80-3650-4a5a-bad5-225cc100dfad None admin] RBAC: Adding query filter params (name=Default) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:45:29.100204 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134a5b80-3650-4a5a-bad5-225cc100dfad None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:45:29.101593 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134a5b80-3650-4a5a-bad5-225cc100dfad None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:45:29.113923 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 629/1252] 10.222.0.57 () {56 vars in 1109 bytes} [Fri Sep 16 07:45:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 07:45:29.119807 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41efe886-52c0-4ddd-bb96-f1498d1850b5 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:45:29.225783 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41efe886-52c0-4ddd-bb96-f1498d1850b5 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:45:29.252028 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:45:29.260178 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95201d1c-9b23-4db8-8c26-eecaadf9fe14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:45:29.260803 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95201d1c-9b23-4db8-8c26-eecaadf9fe14 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:45:29.261074 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95201d1c-9b23-4db8-8c26-eecaadf9fe14 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:45:29.261342 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95201d1c-9b23-4db8-8c26-eecaadf9fe14 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:45:29.269539 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95201d1c-9b23-4db8-8c26-eecaadf9fe14 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:45:29.272000 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95201d1c-9b23-4db8-8c26-eecaadf9fe14 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:45:29.287172 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application [None req-95201d1c-9b23-4db8-8c26-eecaadf9fe14 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 16 07:45:29.287172 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 07:45:29.287172 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 07:45:29.287172 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 07:45:29.287172 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 07:45:29.287172 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 07:45:29.287172 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 07:45:29.287172 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 07:45:29.287172 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 07:45:29.287172 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 07:45:29.287172 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 07:45:29.287172 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 07:45:29.287172 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 16 07:45:29.287172 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 16 07:45:29.287172 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 16 07:45:29.287172 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 16 07:45:29.288294 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 07:45:29.288294 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 07:45:29.288294 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 16 07:45:29.288294 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 07:45:29.288294 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 16 07:45:29.288294 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 07:45:29.288294 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 07:45:29.288294 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 07:45:29.288294 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 07:45:29.288294 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 07:45:29.288294 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 07:45:29.288294 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application with Lock( Sep 16 07:45:29.288294 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 07:45:29.288294 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._enter() Sep 16 07:45:29.288294 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 07:45:29.288294 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 07:45:29.288294 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 07:45:29.288294 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.creator() Sep 16 07:45:29.289443 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 07:45:29.289443 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application created_value = creator( Sep 16 07:45:29.289443 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 16 07:45:29.289443 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 16 07:45:29.289443 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 16 07:45:29.289443 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 16 07:45:29.289443 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 16 07:45:29.289443 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 16 07:45:29.289443 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 16 07:45:29.289443 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Sep 16 07:45:29.289443 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 624/1253] 10.222.0.57 () {56 vars in 1108 bytes} [Fri Sep 16 07:45:29 2022] GET /identity/v3/users/placement => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 07:45:29.294197 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134a5b80-3650-4a5a-bad5-225cc100dfad None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:45:29.348607 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:45:29.391504 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134a5b80-3650-4a5a-bad5-225cc100dfad None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:45:29.424244 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf77248-7576-4f21-978b-6f7dfbcbd1e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:45:29.424828 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf77248-7576-4f21-978b-6f7dfbcbd1e0 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:45:29.425104 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf77248-7576-4f21-978b-6f7dfbcbd1e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:45:29.425372 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf77248-7576-4f21-978b-6f7dfbcbd1e0 None admin] PATH_INFO: `/v3/users` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:45:29.426113 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf77248-7576-4f21-978b-6f7dfbcbd1e0 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:45:29.426418 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf77248-7576-4f21-978b-6f7dfbcbd1e0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:45:29.427821 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf77248-7576-4f21-978b-6f7dfbcbd1e0 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:45:29.444552 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 630/1254] 10.222.0.57 () {56 vars in 1143 bytes} [Fri Sep 16 07:45:29 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:45:29.450353 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95201d1c-9b23-4db8-8c26-eecaadf9fe14 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:45:29.548843 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95201d1c-9b23-4db8-8c26-eecaadf9fe14 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:45:29.581806 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d37dc6-95ca-408b-ad53-a84875ea5d7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:45:29.582389 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d37dc6-95ca-408b-ad53-a84875ea5d7a None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:45:29.582664 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d37dc6-95ca-408b-ad53-a84875ea5d7a None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:45:29.582931 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d37dc6-95ca-408b-ad53-a84875ea5d7a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:45:29.635639 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:45:29.648530 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d37dc6-95ca-408b-ad53-a84875ea5d7a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:45:29.649998 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d37dc6-95ca-408b-ad53-a84875ea5d7a None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:45:29.747568 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 625/1255] 10.222.0.57 () {58 vars in 1282 bytes} [Fri Sep 16 07:45:29 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 16 07:45:29.755610 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf77248-7576-4f21-978b-6f7dfbcbd1e0 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:45:29.856044 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf77248-7576-4f21-978b-6f7dfbcbd1e0 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:45:29.869087 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:45:29.890794 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd3d925-862a-4684-b7b2-2d54b5072f9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:45:29.891412 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd3d925-862a-4684-b7b2-2d54b5072f9d None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:45:29.891689 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd3d925-862a-4684-b7b2-2d54b5072f9d None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:45:29.891959 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd3d925-862a-4684-b7b2-2d54b5072f9d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:45:29.901582 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd3d925-862a-4684-b7b2-2d54b5072f9d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:45:29.903057 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd3d925-862a-4684-b7b2-2d54b5072f9d None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:45:29.917213 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application [None req-7bd3d925-862a-4684-b7b2-2d54b5072f9d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 07:45:29.917213 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 07:45:29.917213 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 07:45:29.917213 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 07:45:29.917213 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 07:45:29.917213 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 07:45:29.917213 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 07:45:29.917213 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 07:45:29.917213 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 07:45:29.917213 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 07:45:29.917213 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 07:45:29.917213 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 07:45:29.917213 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 07:45:29.917213 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 07:45:29.917213 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 07:45:29.917213 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 07:45:29.918346 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 07:45:29.918346 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 07:45:29.918346 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 07:45:29.918346 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 07:45:29.918346 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 07:45:29.918346 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 07:45:29.918346 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 07:45:29.918346 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application with Lock( Sep 16 07:45:29.918346 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 07:45:29.918346 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._enter() Sep 16 07:45:29.918346 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 07:45:29.918346 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 07:45:29.918346 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 07:45:29.918346 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.creator() Sep 16 07:45:29.918346 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 07:45:29.918346 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application created_value = creator( Sep 16 07:45:29.918346 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 07:45:29.919459 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 07:45:29.919459 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 07:45:29.919459 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Sep 16 07:45:29.919459 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 631/1256] 10.222.0.57 () {56 vars in 1108 bytes} [Fri Sep 16 07:45:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 07:45:29.924734 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d37dc6-95ca-408b-ad53-a84875ea5d7a None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:45:30.011100 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:45:30.023238 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d37dc6-95ca-408b-ad53-a84875ea5d7a None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:45:30.055681 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75ef1b2-e7cd-4209-95c3-1840398c82d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:45:30.056269 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75ef1b2-e7cd-4209-95c3-1840398c82d7 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:45:30.056543 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75ef1b2-e7cd-4209-95c3-1840398c82d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:45:30.056807 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75ef1b2-e7cd-4209-95c3-1840398c82d7 None admin] PATH_INFO: `/v3/domains` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:45:30.057421 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75ef1b2-e7cd-4209-95c3-1840398c82d7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:45:30.057715 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75ef1b2-e7cd-4209-95c3-1840398c82d7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:45:30.059084 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75ef1b2-e7cd-4209-95c3-1840398c82d7 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:45:30.070390 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 626/1257] 10.222.0.57 () {56 vars in 1109 bytes} [Fri Sep 16 07:45:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:45:30.076027 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd3d925-862a-4684-b7b2-2d54b5072f9d None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:45:30.173633 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd3d925-862a-4684-b7b2-2d54b5072f9d None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:45:30.205518 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d8f90c-96e6-4e76-acd2-255ee637118d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:45:30.206158 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d8f90c-96e6-4e76-acd2-255ee637118d None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:45:30.206435 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d8f90c-96e6-4e76-acd2-255ee637118d None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:45:30.206704 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d8f90c-96e6-4e76-acd2-255ee637118d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:45:30.213063 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d8f90c-96e6-4e76-acd2-255ee637118d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:45:30.214516 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d8f90c-96e6-4e76-acd2-255ee637118d None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:45:30.226003 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application [None req-b4d8f90c-96e6-4e76-acd2-255ee637118d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 07:45:30.226003 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 07:45:30.226003 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 07:45:30.226003 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 07:45:30.226003 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 07:45:30.226003 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 07:45:30.226003 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 07:45:30.226003 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 07:45:30.226003 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 07:45:30.226003 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 07:45:30.226003 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 07:45:30.226003 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 07:45:30.226003 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 16 07:45:30.226003 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 16 07:45:30.226003 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 16 07:45:30.227051 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 16 07:45:30.227051 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 07:45:30.227051 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 07:45:30.227051 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 07:45:30.227051 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 07:45:30.227051 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 07:45:30.227051 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 07:45:30.227051 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 07:45:30.227051 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application with Lock( Sep 16 07:45:30.227051 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 07:45:30.227051 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._enter() Sep 16 07:45:30.227051 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 07:45:30.227051 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 07:45:30.227051 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 07:45:30.227051 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.creator() Sep 16 07:45:30.227051 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 07:45:30.227051 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application created_value = creator( Sep 16 07:45:30.228328 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 16 07:45:30.228328 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 16 07:45:30.228328 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 16 07:45:30.228328 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 16 07:45:30.228328 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 16 07:45:30.228328 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 16 07:45:30.228328 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 07:45:30.228328 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Sep 16 07:45:30.228328 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 632/1258] 10.222.0.57 () {56 vars in 1111 bytes} [Fri Sep 16 07:45:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 07:45:30.233438 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75ef1b2-e7cd-4209-95c3-1840398c82d7 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:45:30.329655 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75ef1b2-e7cd-4209-95c3-1840398c82d7 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:45:30.362148 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9306011c-cb54-4966-8e79-ecf91c142ee2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:45:30.362740 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9306011c-cb54-4966-8e79-ecf91c142ee2 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:45:30.363012 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9306011c-cb54-4966-8e79-ecf91c142ee2 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:45:30.363276 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9306011c-cb54-4966-8e79-ecf91c142ee2 None admin] PATH_INFO: `/v3/projects` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:45:30.363942 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9306011c-cb54-4966-8e79-ecf91c142ee2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:45:30.364237 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9306011c-cb54-4966-8e79-ecf91c142ee2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:45:30.365644 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9306011c-cb54-4966-8e79-ecf91c142ee2 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:45:30.377343 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 627/1259] 10.222.0.57 () {56 vars in 1148 bytes} [Fri Sep 16 07:45:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:45:30.383510 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d8f90c-96e6-4e76-acd2-255ee637118d None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:45:30.409518 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:45:30.481119 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d8f90c-96e6-4e76-acd2-255ee637118d None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:45:30.513931 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a89c39b-f822-43fd-833f-c40ace8ab175 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:45:30.514515 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a89c39b-f822-43fd-833f-c40ace8ab175 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:45:30.514791 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a89c39b-f822-43fd-833f-c40ace8ab175 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:45:30.515063 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a89c39b-f822-43fd-833f-c40ace8ab175 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:45:30.515774 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a89c39b-f822-43fd-833f-c40ace8ab175 None admin] RBAC: Adding query filter params (role.id=567db03c91854ad9af1e9a87ec1bd275, scope.project.id=4735f453c0c24cc4a1c14e9ac84a0b46, user.id=c7d4ccdd6ef9400ba9e344df0964da1e) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:45:30.516079 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a89c39b-f822-43fd-833f-c40ace8ab175 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:45:30.517489 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a89c39b-f822-43fd-833f-c40ace8ab175 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:45:30.522669 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 633/1260] 10.222.0.57 () {56 vars in 1374 bytes} [Fri Sep 16 07:45:30 2022] GET /identity/v3/role_assignments?user.id=c7d4ccdd6ef9400ba9e344df0964da1e&scope.project.id=4735f453c0c24cc4a1c14e9ac84a0b46&role.id=567db03c91854ad9af1e9a87ec1bd275 => generated 259 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:45:32.633108 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f746be3-7e88-4450-a956-db6fcfdf66d6 None None] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:45:32.633621 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f746be3-7e88-4450-a956-db6fcfdf66d6 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:45:32.633621 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f746be3-7e88-4450-a956-db6fcfdf66d6 None None] PATH_INFO: `/` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:45:32.635003 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 628/1261] 10.222.0.57 () {54 vars in 927 bytes} [Fri Sep 16 07:45:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 07:45:32.640513 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bbcde5-6950-4980-ab79-b1ed9e1edc9a None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:45:32.640894 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bbcde5-6950-4980-ab79-b1ed9e1edc9a None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:45:32.641049 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bbcde5-6950-4980-ab79-b1ed9e1edc9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:45:32.658725 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-62bbcde5-6950-4980-ab79-b1ed9e1edc9a None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:45:32.659907 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-62bbcde5-6950-4980-ab79-b1ed9e1edc9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:45:32.725044 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 634/1262] 10.222.0.57 () {58 vars in 1024 bytes} [Fri Sep 16 07:45:32 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 16 07:45:33.011049 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f746be3-7e88-4450-a956-db6fcfdf66d6 None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:45:33.021844 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:45:33.109712 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f746be3-7e88-4450-a956-db6fcfdf66d6 None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:45:33.142223 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da4b229-20eb-4836-bfff-a30877b365c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:45:33.142826 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da4b229-20eb-4836-bfff-a30877b365c9 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:45:33.143097 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da4b229-20eb-4836-bfff-a30877b365c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:45:33.143363 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da4b229-20eb-4836-bfff-a30877b365c9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:45:33.152922 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da4b229-20eb-4836-bfff-a30877b365c9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 07:45:33.157935 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application [None req-5da4b229-20eb-4836-bfff-a30877b365c9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 16 07:45:33.157935 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 07:45:33.157935 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 07:45:33.157935 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 07:45:33.157935 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 07:45:33.157935 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 07:45:33.157935 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 07:45:33.157935 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 07:45:33.157935 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 07:45:33.157935 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 07:45:33.157935 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 07:45:33.157935 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 07:45:33.157935 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 07:45:33.157935 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 07:45:33.157935 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 07:45:33.157935 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 07:45:33.159029 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 07:45:33.159029 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 07:45:33.159029 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 07:45:33.159029 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 07:45:33.159029 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 07:45:33.159029 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 07:45:33.159029 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 07:45:33.159029 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 07:45:33.159029 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 07:45:33.159029 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 07:45:33.159029 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 07:45:33.159029 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application with Lock( Sep 16 07:45:33.159029 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 07:45:33.159029 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._enter() Sep 16 07:45:33.159029 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 07:45:33.159029 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 07:45:33.159984 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 07:45:33.159984 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.creator() Sep 16 07:45:33.159984 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 07:45:33.159984 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application created_value = creator( Sep 16 07:45:33.159984 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 07:45:33.159984 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 07:45:33.159984 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 07:45:33.159984 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 07:45:33.159984 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 07:45:33.159984 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 07:45:33.159984 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 16 07:45:33.159984 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Sep 16 07:45:33.159984 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 629/1263] 10.222.0.57 () {56 vars in 1096 bytes} [Fri Sep 16 07:45:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 07:45:33.165569 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bbcde5-6950-4980-ab79-b1ed9e1edc9a None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:45:33.184432 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:45:33.268758 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bbcde5-6950-4980-ab79-b1ed9e1edc9a None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:45:33.302303 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d19cff9-27c9-4496-b592-7e5db1c32efe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:45:33.302899 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d19cff9-27c9-4496-b592-7e5db1c32efe None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:45:33.303178 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d19cff9-27c9-4496-b592-7e5db1c32efe None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:45:33.303449 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d19cff9-27c9-4496-b592-7e5db1c32efe None admin] PATH_INFO: `/v3/roles` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:45:33.304105 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d19cff9-27c9-4496-b592-7e5db1c32efe None admin] RBAC: Adding query filter params (name=admin) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:45:33.304406 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d19cff9-27c9-4496-b592-7e5db1c32efe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:45:33.305898 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d19cff9-27c9-4496-b592-7e5db1c32efe None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:45:33.313972 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 635/1264] 10.222.0.57 () {56 vars in 1099 bytes} [Fri Sep 16 07:45:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:45:33.319707 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da4b229-20eb-4836-bfff-a30877b365c9 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:45:33.385231 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:45:33.417461 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da4b229-20eb-4836-bfff-a30877b365c9 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:45:33.450215 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e482e8-c42d-404b-ba2e-c6758511d675 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:45:33.450823 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e482e8-c42d-404b-ba2e-c6758511d675 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:45:33.451189 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e482e8-c42d-404b-ba2e-c6758511d675 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:45:33.451483 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e482e8-c42d-404b-ba2e-c6758511d675 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:45:33.461003 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e482e8-c42d-404b-ba2e-c6758511d675 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:45:33.462462 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e482e8-c42d-404b-ba2e-c6758511d675 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:45:33.476999 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application [None req-48e482e8-c42d-404b-ba2e-c6758511d675 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 07:45:33.476999 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 07:45:33.476999 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 07:45:33.476999 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 07:45:33.476999 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 07:45:33.476999 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 07:45:33.476999 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 07:45:33.476999 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 07:45:33.476999 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 07:45:33.476999 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 07:45:33.476999 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 07:45:33.476999 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 07:45:33.476999 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 07:45:33.476999 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 07:45:33.476999 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 07:45:33.476999 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 07:45:33.478181 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 07:45:33.478181 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 07:45:33.478181 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 07:45:33.478181 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 07:45:33.478181 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 07:45:33.478181 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 07:45:33.478181 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 07:45:33.478181 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application with Lock( Sep 16 07:45:33.478181 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 07:45:33.478181 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._enter() Sep 16 07:45:33.478181 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 07:45:33.478181 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 07:45:33.478181 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 07:45:33.478181 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.creator() Sep 16 07:45:33.478181 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 07:45:33.478181 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application created_value = creator( Sep 16 07:45:33.478181 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 07:45:33.479262 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 07:45:33.479262 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 07:45:33.479262 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Sep 16 07:45:33.479262 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 630/1265] 10.222.0.57 () {56 vars in 1108 bytes} [Fri Sep 16 07:45:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 07:45:33.484323 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d19cff9-27c9-4496-b592-7e5db1c32efe None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:45:33.562303 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:45:33.581300 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d19cff9-27c9-4496-b592-7e5db1c32efe None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:45:33.613170 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfab041-ea34-4fb3-9887-7879e0381673 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:45:33.613775 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfab041-ea34-4fb3-9887-7879e0381673 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:45:33.614050 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfab041-ea34-4fb3-9887-7879e0381673 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:45:33.614317 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfab041-ea34-4fb3-9887-7879e0381673 None admin] PATH_INFO: `/v3/domains` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:45:33.614939 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfab041-ea34-4fb3-9887-7879e0381673 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:45:33.615236 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfab041-ea34-4fb3-9887-7879e0381673 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:45:33.616571 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfab041-ea34-4fb3-9887-7879e0381673 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:45:33.627989 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 636/1266] 10.222.0.57 () {56 vars in 1109 bytes} [Fri Sep 16 07:45:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:45:33.633498 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e482e8-c42d-404b-ba2e-c6758511d675 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:45:33.731844 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e482e8-c42d-404b-ba2e-c6758511d675 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:45:33.752015 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:45:33.770298 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7118758d-bdae-417b-b14f-493d2b229751 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:45:33.770966 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7118758d-bdae-417b-b14f-493d2b229751 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:45:33.771251 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7118758d-bdae-417b-b14f-493d2b229751 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:45:33.771516 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7118758d-bdae-417b-b14f-493d2b229751 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:45:33.779041 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7118758d-bdae-417b-b14f-493d2b229751 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:45:33.781112 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7118758d-bdae-417b-b14f-493d2b229751 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:45:33.791965 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application [None req-7118758d-bdae-417b-b14f-493d2b229751 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 16 07:45:33.791965 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 07:45:33.791965 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 07:45:33.791965 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 07:45:33.791965 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 07:45:33.791965 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 07:45:33.791965 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 07:45:33.791965 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 07:45:33.791965 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 07:45:33.791965 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 07:45:33.791965 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 07:45:33.791965 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 07:45:33.791965 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 16 07:45:33.791965 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 16 07:45:33.791965 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 16 07:45:33.791965 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 16 07:45:33.793052 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 07:45:33.793052 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 07:45:33.793052 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 16 07:45:33.793052 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 07:45:33.793052 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 16 07:45:33.793052 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 07:45:33.793052 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 07:45:33.793052 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 07:45:33.793052 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 07:45:33.793052 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 07:45:33.793052 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 07:45:33.793052 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application with Lock( Sep 16 07:45:33.793052 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 07:45:33.793052 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._enter() Sep 16 07:45:33.793052 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 07:45:33.793052 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 07:45:33.793052 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 07:45:33.793052 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.creator() Sep 16 07:45:33.794053 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 07:45:33.794053 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application created_value = creator( Sep 16 07:45:33.794053 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 16 07:45:33.794053 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 16 07:45:33.794053 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 16 07:45:33.794053 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 16 07:45:33.794053 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 16 07:45:33.794053 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 16 07:45:33.794053 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 16 07:45:33.794053 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Sep 16 07:45:33.794053 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 631/1267] 10.222.0.57 () {56 vars in 1108 bytes} [Fri Sep 16 07:45:33 2022] GET /identity/v3/users/placement => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 07:45:33.799101 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfab041-ea34-4fb3-9887-7879e0381673 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:45:33.896493 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfab041-ea34-4fb3-9887-7879e0381673 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:45:33.929441 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc14fa52-b2a8-4b44-8d81-6ce01324a230 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:45:33.930058 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc14fa52-b2a8-4b44-8d81-6ce01324a230 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:45:33.930338 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc14fa52-b2a8-4b44-8d81-6ce01324a230 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:45:33.930610 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc14fa52-b2a8-4b44-8d81-6ce01324a230 None admin] PATH_INFO: `/v3/users` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:45:33.931324 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc14fa52-b2a8-4b44-8d81-6ce01324a230 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:45:33.931627 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc14fa52-b2a8-4b44-8d81-6ce01324a230 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:45:33.933037 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc14fa52-b2a8-4b44-8d81-6ce01324a230 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:45:33.942008 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:45:33.950346 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 637/1268] 10.222.0.57 () {56 vars in 1143 bytes} [Fri Sep 16 07:45:33 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:45:33.956641 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7118758d-bdae-417b-b14f-493d2b229751 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:45:34.057164 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7118758d-bdae-417b-b14f-493d2b229751 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:45:34.092411 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8dd9968-87bf-4e91-8bcb-d06143a14aa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:45:34.093035 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8dd9968-87bf-4e91-8bcb-d06143a14aa0 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:45:34.093315 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8dd9968-87bf-4e91-8bcb-d06143a14aa0 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:45:34.093585 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8dd9968-87bf-4e91-8bcb-d06143a14aa0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:45:34.104883 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8dd9968-87bf-4e91-8bcb-d06143a14aa0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:45:34.106101 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8dd9968-87bf-4e91-8bcb-d06143a14aa0 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:45:34.121281 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application [None req-d8dd9968-87bf-4e91-8bcb-d06143a14aa0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 07:45:34.121281 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 07:45:34.121281 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 07:45:34.121281 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 07:45:34.121281 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 07:45:34.121281 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 07:45:34.121281 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 07:45:34.121281 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 07:45:34.121281 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 07:45:34.121281 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 07:45:34.121281 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 07:45:34.121281 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 07:45:34.121281 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 07:45:34.121281 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 07:45:34.121281 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 07:45:34.121281 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 07:45:34.122296 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 07:45:34.122296 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 07:45:34.122296 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 07:45:34.122296 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 07:45:34.122296 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 07:45:34.122296 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 07:45:34.122296 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 07:45:34.122296 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application with Lock( Sep 16 07:45:34.122296 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 07:45:34.122296 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._enter() Sep 16 07:45:34.122296 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 07:45:34.122296 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 07:45:34.122296 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 07:45:34.122296 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.creator() Sep 16 07:45:34.122296 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 07:45:34.122296 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application created_value = creator( Sep 16 07:45:34.122296 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 07:45:34.123549 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 07:45:34.123549 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 07:45:34.123549 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Sep 16 07:45:34.126035 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 632/1269] 10.222.0.57 () {56 vars in 1108 bytes} [Fri Sep 16 07:45:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 07:45:34.128700 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc14fa52-b2a8-4b44-8d81-6ce01324a230 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:45:34.230129 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc14fa52-b2a8-4b44-8d81-6ce01324a230 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:45:34.264705 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664fbe51-b650-491f-8064-633251f6eb2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:45:34.265308 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664fbe51-b650-491f-8064-633251f6eb2e None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:45:34.265588 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664fbe51-b650-491f-8064-633251f6eb2e None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:45:34.265889 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664fbe51-b650-491f-8064-633251f6eb2e None admin] PATH_INFO: `/v3/domains` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:45:34.266547 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664fbe51-b650-491f-8064-633251f6eb2e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:45:34.266848 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664fbe51-b650-491f-8064-633251f6eb2e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:45:34.268286 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664fbe51-b650-491f-8064-633251f6eb2e None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:45:34.280279 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 638/1270] 10.222.0.57 () {56 vars in 1109 bytes} [Fri Sep 16 07:45:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:45:34.285837 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8dd9968-87bf-4e91-8bcb-d06143a14aa0 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:45:34.317744 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:45:34.386935 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8dd9968-87bf-4e91-8bcb-d06143a14aa0 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:45:34.420588 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2b66fd-77bb-4335-93ab-708e7c4f7138 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:45:34.421198 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2b66fd-77bb-4335-93ab-708e7c4f7138 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:45:34.421473 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2b66fd-77bb-4335-93ab-708e7c4f7138 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:45:34.421762 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2b66fd-77bb-4335-93ab-708e7c4f7138 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:45:34.428153 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2b66fd-77bb-4335-93ab-708e7c4f7138 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:45:34.429584 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2b66fd-77bb-4335-93ab-708e7c4f7138 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:45:34.440670 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application [None req-6e2b66fd-77bb-4335-93ab-708e7c4f7138 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 07:45:34.440670 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 07:45:34.440670 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 07:45:34.440670 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 07:45:34.440670 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 07:45:34.440670 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 07:45:34.440670 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 07:45:34.440670 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 07:45:34.440670 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 07:45:34.440670 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 07:45:34.440670 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 07:45:34.440670 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 07:45:34.440670 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 16 07:45:34.440670 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 16 07:45:34.440670 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 16 07:45:34.441747 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 16 07:45:34.441747 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 07:45:34.441747 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 07:45:34.441747 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 07:45:34.441747 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 07:45:34.441747 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 07:45:34.441747 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 07:45:34.441747 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 07:45:34.441747 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application with Lock( Sep 16 07:45:34.441747 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 07:45:34.441747 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._enter() Sep 16 07:45:34.441747 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 07:45:34.441747 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 07:45:34.441747 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 07:45:34.441747 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.creator() Sep 16 07:45:34.441747 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 07:45:34.441747 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application created_value = creator( Sep 16 07:45:34.442898 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 16 07:45:34.442898 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 16 07:45:34.442898 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 16 07:45:34.442898 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 16 07:45:34.442898 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 16 07:45:34.442898 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 16 07:45:34.442898 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 07:45:34.442898 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Sep 16 07:45:34.442898 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 633/1271] 10.222.0.57 () {56 vars in 1111 bytes} [Fri Sep 16 07:45:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 07:45:34.447763 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664fbe51-b650-491f-8064-633251f6eb2e None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:45:34.509433 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:45:34.553078 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664fbe51-b650-491f-8064-633251f6eb2e None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:45:34.587029 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b93b292-cfe0-4985-bb2b-8478e38d33e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:45:34.587662 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b93b292-cfe0-4985-bb2b-8478e38d33e5 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:45:34.587944 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b93b292-cfe0-4985-bb2b-8478e38d33e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:45:34.588220 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b93b292-cfe0-4985-bb2b-8478e38d33e5 None admin] PATH_INFO: `/v3/projects` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:45:34.588926 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b93b292-cfe0-4985-bb2b-8478e38d33e5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:45:34.589231 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b93b292-cfe0-4985-bb2b-8478e38d33e5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:45:34.590738 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b93b292-cfe0-4985-bb2b-8478e38d33e5 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:45:34.603511 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 639/1272] 10.222.0.57 () {56 vars in 1148 bytes} [Fri Sep 16 07:45:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:45:34.609788 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2b66fd-77bb-4335-93ab-708e7c4f7138 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:45:34.697004 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:45:34.706555 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2b66fd-77bb-4335-93ab-708e7c4f7138 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:45:34.738357 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0040ada-ccc0-4006-82d5-4f145249f038 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:45:34.738998 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0040ada-ccc0-4006-82d5-4f145249f038 None admin] REQUEST_METHOD: `PUT` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:45:34.739272 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0040ada-ccc0-4006-82d5-4f145249f038 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:45:34.739541 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0040ada-ccc0-4006-82d5-4f145249f038 None admin] PATH_INFO: `/v3/projects/4735f453c0c24cc4a1c14e9ac84a0b46/users/c7d4ccdd6ef9400ba9e344df0964da1e/roles/567db03c91854ad9af1e9a87ec1bd275` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:45:34.741809 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0040ada-ccc0-4006-82d5-4f145249f038 None admin] RBAC: Authorizing `identity:create_grant(project_id=4735f453c0c24cc4a1c14e9ac84a0b46, user_id=c7d4ccdd6ef9400ba9e344df0964da1e, role_id=567db03c91854ad9af1e9a87ec1bd275)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:45:34.744246 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0040ada-ccc0-4006-82d5-4f145249f038 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:45:34.761807 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 634/1273] 10.222.0.57 () {58 vars in 1439 bytes} [Fri Sep 16 07:45:34 2022] PUT /identity/v3/projects/4735f453c0c24cc4a1c14e9ac84a0b46/users/c7d4ccdd6ef9400ba9e344df0964da1e/roles/567db03c91854ad9af1e9a87ec1bd275 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 07:45:36.897685 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99605ee9-8bbc-45d9-86f6-ae1ac39f3a0f None None] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:45:36.898239 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99605ee9-8bbc-45d9-86f6-ae1ac39f3a0f None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:45:36.898357 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99605ee9-8bbc-45d9-86f6-ae1ac39f3a0f None None] PATH_INFO: `/` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:45:36.899594 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 640/1274] 10.222.0.57 () {54 vars in 927 bytes} [Fri Sep 16 07:45:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 07:45:36.904806 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fdac1d-3359-407f-8109-0e1c3f99d81d None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:45:36.905213 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fdac1d-3359-407f-8109-0e1c3f99d81d None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:45:36.905319 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fdac1d-3359-407f-8109-0e1c3f99d81d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:45:36.924086 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-b0fdac1d-3359-407f-8109-0e1c3f99d81d None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:45:36.925263 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-b0fdac1d-3359-407f-8109-0e1c3f99d81d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:45:36.990143 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 635/1275] 10.222.0.57 () {58 vars in 1024 bytes} [Fri Sep 16 07:45:36 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 16 07:45:37.256541 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99605ee9-8bbc-45d9-86f6-ae1ac39f3a0f None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:45:37.360789 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99605ee9-8bbc-45d9-86f6-ae1ac39f3a0f None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:45:37.377571 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:45:37.394693 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f52c7fe-3499-42b2-b2a5-4a9ce555c1c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:45:37.395310 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f52c7fe-3499-42b2-b2a5-4a9ce555c1c5 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:45:37.395589 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f52c7fe-3499-42b2-b2a5-4a9ce555c1c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:45:37.395859 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f52c7fe-3499-42b2-b2a5-4a9ce555c1c5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:45:37.406167 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f52c7fe-3499-42b2-b2a5-4a9ce555c1c5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 07:45:37.410925 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application [None req-4f52c7fe-3499-42b2-b2a5-4a9ce555c1c5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 16 07:45:37.410925 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 07:45:37.410925 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 07:45:37.410925 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 07:45:37.410925 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 07:45:37.410925 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 07:45:37.410925 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 07:45:37.410925 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 07:45:37.410925 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 07:45:37.410925 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 07:45:37.410925 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 07:45:37.410925 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 07:45:37.410925 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 07:45:37.410925 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 07:45:37.410925 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 07:45:37.410925 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 07:45:37.412008 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 07:45:37.412008 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 07:45:37.412008 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 07:45:37.412008 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 07:45:37.412008 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 07:45:37.412008 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 07:45:37.412008 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 07:45:37.412008 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 07:45:37.412008 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 07:45:37.412008 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 07:45:37.412008 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 07:45:37.412008 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application with Lock( Sep 16 07:45:37.412008 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 07:45:37.412008 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._enter() Sep 16 07:45:37.412008 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 07:45:37.412008 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 07:45:37.413039 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 07:45:37.413039 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.creator() Sep 16 07:45:37.413039 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 07:45:37.413039 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application created_value = creator( Sep 16 07:45:37.413039 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 07:45:37.413039 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 07:45:37.413039 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 07:45:37.413039 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 07:45:37.413039 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 07:45:37.413039 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 07:45:37.413039 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 16 07:45:37.413039 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Sep 16 07:45:37.413039 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 641/1276] 10.222.0.57 () {56 vars in 1096 bytes} [Fri Sep 16 07:45:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 07:45:37.417983 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fdac1d-3359-407f-8109-0e1c3f99d81d None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:45:37.496146 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:45:37.515289 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fdac1d-3359-407f-8109-0e1c3f99d81d None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:45:37.552723 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8530da-ad96-4277-81af-0cf15fc185ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:45:37.553329 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8530da-ad96-4277-81af-0cf15fc185ab None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:45:37.553608 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8530da-ad96-4277-81af-0cf15fc185ab None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:45:37.553910 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8530da-ad96-4277-81af-0cf15fc185ab None admin] PATH_INFO: `/v3/roles` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:45:37.554566 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8530da-ad96-4277-81af-0cf15fc185ab None admin] RBAC: Adding query filter params (name=admin) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:45:37.554865 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8530da-ad96-4277-81af-0cf15fc185ab None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:45:37.556225 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8530da-ad96-4277-81af-0cf15fc185ab None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:45:37.564376 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 636/1277] 10.222.0.57 () {56 vars in 1099 bytes} [Fri Sep 16 07:45:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:45:37.570247 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f52c7fe-3499-42b2-b2a5-4a9ce555c1c5 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:45:37.668961 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f52c7fe-3499-42b2-b2a5-4a9ce555c1c5 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:45:37.703387 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee16e5b-e4aa-4fba-afad-748db74435a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:45:37.704000 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee16e5b-e4aa-4fba-afad-748db74435a9 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:45:37.704273 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee16e5b-e4aa-4fba-afad-748db74435a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:45:37.704540 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee16e5b-e4aa-4fba-afad-748db74435a9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:45:37.714045 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee16e5b-e4aa-4fba-afad-748db74435a9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:45:37.715469 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee16e5b-e4aa-4fba-afad-748db74435a9 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:45:37.729375 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application [None req-2ee16e5b-e4aa-4fba-afad-748db74435a9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 07:45:37.729375 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 07:45:37.729375 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 07:45:37.729375 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 07:45:37.729375 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 07:45:37.729375 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 07:45:37.729375 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 07:45:37.729375 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 07:45:37.729375 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 07:45:37.729375 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 07:45:37.729375 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 07:45:37.729375 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 07:45:37.729375 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 07:45:37.729375 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 07:45:37.729375 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 07:45:37.729375 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 07:45:37.730596 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 07:45:37.730596 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 07:45:37.730596 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 07:45:37.730596 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 07:45:37.730596 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 07:45:37.730596 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 07:45:37.730596 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 07:45:37.730596 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application with Lock( Sep 16 07:45:37.730596 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 07:45:37.730596 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._enter() Sep 16 07:45:37.730596 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 07:45:37.730596 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 07:45:37.730596 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 07:45:37.730596 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.creator() Sep 16 07:45:37.730596 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 07:45:37.730596 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application created_value = creator( Sep 16 07:45:37.730596 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 07:45:37.731661 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 07:45:37.731661 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 07:45:37.731661 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Sep 16 07:45:37.731661 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 642/1278] 10.222.0.57 () {56 vars in 1108 bytes} [Fri Sep 16 07:45:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 07:45:37.736229 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8530da-ad96-4277-81af-0cf15fc185ab None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:45:37.845304 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8530da-ad96-4277-81af-0cf15fc185ab None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:45:37.878310 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0df4a65-f203-4b89-8595-f181453ae01d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:45:37.878912 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0df4a65-f203-4b89-8595-f181453ae01d None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:45:37.879191 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0df4a65-f203-4b89-8595-f181453ae01d None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:45:37.879461 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0df4a65-f203-4b89-8595-f181453ae01d None admin] PATH_INFO: `/v3/domains` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:45:37.880096 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0df4a65-f203-4b89-8595-f181453ae01d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:45:37.880398 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0df4a65-f203-4b89-8595-f181453ae01d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:45:37.881782 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0df4a65-f203-4b89-8595-f181453ae01d None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:45:37.894115 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 637/1279] 10.222.0.57 () {56 vars in 1109 bytes} [Fri Sep 16 07:45:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:45:37.899836 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee16e5b-e4aa-4fba-afad-748db74435a9 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:45:37.929688 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:45:37.999794 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee16e5b-e4aa-4fba-afad-748db74435a9 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:45:38.032213 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f255216-25bc-4f8e-83ea-5715b70d144c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:45:38.032825 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f255216-25bc-4f8e-83ea-5715b70d144c None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:45:38.033101 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f255216-25bc-4f8e-83ea-5715b70d144c None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:45:38.033370 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f255216-25bc-4f8e-83ea-5715b70d144c None admin] PATH_INFO: `/v3/users/placement` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:45:38.040456 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f255216-25bc-4f8e-83ea-5715b70d144c None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:45:38.041910 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f255216-25bc-4f8e-83ea-5715b70d144c None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:45:38.053270 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application [None req-8f255216-25bc-4f8e-83ea-5715b70d144c None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 16 07:45:38.053270 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 07:45:38.053270 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 07:45:38.053270 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 07:45:38.053270 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 07:45:38.053270 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 07:45:38.053270 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 07:45:38.053270 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 07:45:38.053270 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 07:45:38.053270 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 07:45:38.053270 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 07:45:38.053270 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 07:45:38.053270 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 16 07:45:38.053270 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 16 07:45:38.053270 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 16 07:45:38.053270 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 16 07:45:38.054352 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 07:45:38.054352 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 07:45:38.054352 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 16 07:45:38.054352 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 07:45:38.054352 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 16 07:45:38.054352 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 07:45:38.054352 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 07:45:38.054352 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 07:45:38.054352 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 07:45:38.054352 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 07:45:38.054352 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 07:45:38.054352 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application with Lock( Sep 16 07:45:38.054352 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 07:45:38.054352 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._enter() Sep 16 07:45:38.054352 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 07:45:38.054352 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 07:45:38.054352 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 07:45:38.054352 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.creator() Sep 16 07:45:38.055537 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 07:45:38.055537 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application created_value = creator( Sep 16 07:45:38.055537 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 16 07:45:38.055537 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 16 07:45:38.055537 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 16 07:45:38.055537 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 16 07:45:38.055537 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 16 07:45:38.055537 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 16 07:45:38.055537 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 16 07:45:38.055537 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Sep 16 07:45:38.055537 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 643/1280] 10.222.0.57 () {56 vars in 1108 bytes} [Fri Sep 16 07:45:37 2022] GET /identity/v3/users/placement => generated 87 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 07:45:38.060869 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0df4a65-f203-4b89-8595-f181453ae01d None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:45:38.064621 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:45:38.156340 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0df4a65-f203-4b89-8595-f181453ae01d None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:45:38.189313 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e4906e-2647-42b5-815d-7b99027e374d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:45:38.189928 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e4906e-2647-42b5-815d-7b99027e374d None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:45:38.190200 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e4906e-2647-42b5-815d-7b99027e374d None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:45:38.190465 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e4906e-2647-42b5-815d-7b99027e374d None admin] PATH_INFO: `/v3/users` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:45:38.191162 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e4906e-2647-42b5-815d-7b99027e374d None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:45:38.191459 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e4906e-2647-42b5-815d-7b99027e374d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:45:38.192875 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e4906e-2647-42b5-815d-7b99027e374d None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:45:38.210708 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 638/1281] 10.222.0.57 () {56 vars in 1143 bytes} [Fri Sep 16 07:45:38 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:45:38.216699 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f255216-25bc-4f8e-83ea-5715b70d144c None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:45:38.306112 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:45:38.315939 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f255216-25bc-4f8e-83ea-5715b70d144c None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:45:38.347533 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7817b49a-2732-4550-9a54-f24154563a0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:45:38.348124 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7817b49a-2732-4550-9a54-f24154563a0a None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:45:38.348400 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7817b49a-2732-4550-9a54-f24154563a0a None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:45:38.348668 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7817b49a-2732-4550-9a54-f24154563a0a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:45:38.412344 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7817b49a-2732-4550-9a54-f24154563a0a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:45:38.413743 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7817b49a-2732-4550-9a54-f24154563a0a None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:45:38.499055 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:45:38.509079 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 644/1282] 10.222.0.57 () {58 vars in 1282 bytes} [Fri Sep 16 07:45:38 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 16 07:45:38.515140 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e4906e-2647-42b5-815d-7b99027e374d None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:45:38.573920 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:45:38.611999 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e4906e-2647-42b5-815d-7b99027e374d None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:45:38.644380 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9cdea7-4e2e-4458-9e5a-c9510c41e277 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:45:38.644994 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9cdea7-4e2e-4458-9e5a-c9510c41e277 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:45:38.645269 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9cdea7-4e2e-4458-9e5a-c9510c41e277 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:45:38.645537 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9cdea7-4e2e-4458-9e5a-c9510c41e277 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:45:38.655562 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9cdea7-4e2e-4458-9e5a-c9510c41e277 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:45:38.656994 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9cdea7-4e2e-4458-9e5a-c9510c41e277 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:45:38.671633 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application [None req-2f9cdea7-4e2e-4458-9e5a-c9510c41e277 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 07:45:38.671633 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 07:45:38.671633 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 07:45:38.671633 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 07:45:38.671633 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 07:45:38.671633 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 07:45:38.671633 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 07:45:38.671633 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 07:45:38.671633 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 07:45:38.671633 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 07:45:38.671633 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 07:45:38.671633 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 07:45:38.671633 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 07:45:38.671633 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 07:45:38.671633 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 07:45:38.671633 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 07:45:38.672740 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 07:45:38.672740 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 07:45:38.672740 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 07:45:38.672740 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 07:45:38.672740 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 07:45:38.672740 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 07:45:38.672740 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 07:45:38.672740 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application with Lock( Sep 16 07:45:38.672740 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 07:45:38.672740 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._enter() Sep 16 07:45:38.672740 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 07:45:38.672740 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 07:45:38.672740 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 07:45:38.672740 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.creator() Sep 16 07:45:38.672740 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 07:45:38.672740 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application created_value = creator( Sep 16 07:45:38.672740 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 07:45:38.674046 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 07:45:38.674046 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 07:45:38.674046 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Sep 16 07:45:38.674046 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 639/1283] 10.222.0.57 () {56 vars in 1108 bytes} [Fri Sep 16 07:45:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 07:45:38.678344 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7817b49a-2732-4550-9a54-f24154563a0a None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:45:38.776115 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7817b49a-2732-4550-9a54-f24154563a0a None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:45:38.808907 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda00adb-6bb1-4ed1-a72e-bbeacbe4e3be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:45:38.809492 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda00adb-6bb1-4ed1-a72e-bbeacbe4e3be None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:45:38.809790 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda00adb-6bb1-4ed1-a72e-bbeacbe4e3be None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:45:38.810083 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda00adb-6bb1-4ed1-a72e-bbeacbe4e3be None admin] PATH_INFO: `/v3/domains` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:45:38.810708 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda00adb-6bb1-4ed1-a72e-bbeacbe4e3be None admin] RBAC: Adding query filter params (name=Default) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:45:38.810999 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda00adb-6bb1-4ed1-a72e-bbeacbe4e3be None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:45:38.812334 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda00adb-6bb1-4ed1-a72e-bbeacbe4e3be None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:45:38.822956 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 645/1284] 10.222.0.57 () {56 vars in 1109 bytes} [Fri Sep 16 07:45:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:45:38.829162 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9cdea7-4e2e-4458-9e5a-c9510c41e277 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:45:38.926557 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9cdea7-4e2e-4458-9e5a-c9510c41e277 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:45:38.939849 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:45:38.959678 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e95298-cff5-452f-ab33-087ff666f13f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:45:38.960292 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e95298-cff5-452f-ab33-087ff666f13f None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:45:38.960569 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e95298-cff5-452f-ab33-087ff666f13f None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:45:38.960838 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e95298-cff5-452f-ab33-087ff666f13f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:45:38.968019 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e95298-cff5-452f-ab33-087ff666f13f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:45:38.969444 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e95298-cff5-452f-ab33-087ff666f13f None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:45:38.980314 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application [None req-31e95298-cff5-452f-ab33-087ff666f13f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 07:45:38.980314 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 07:45:38.980314 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 07:45:38.980314 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 07:45:38.980314 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 07:45:38.980314 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 07:45:38.980314 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 07:45:38.980314 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 07:45:38.980314 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 07:45:38.980314 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 07:45:38.980314 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 07:45:38.980314 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 07:45:38.980314 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 16 07:45:38.980314 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 16 07:45:38.980314 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 16 07:45:38.981216 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 16 07:45:38.981216 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 07:45:38.981216 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 07:45:38.981216 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 07:45:38.981216 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 07:45:38.981216 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 07:45:38.981216 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 07:45:38.981216 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 07:45:38.981216 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application with Lock( Sep 16 07:45:38.981216 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 07:45:38.981216 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._enter() Sep 16 07:45:38.981216 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 07:45:38.981216 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 07:45:38.981216 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 07:45:38.981216 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.creator() Sep 16 07:45:38.981216 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 07:45:38.981216 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application created_value = creator( Sep 16 07:45:38.982198 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 16 07:45:38.982198 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 16 07:45:38.982198 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 16 07:45:38.982198 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 16 07:45:38.982198 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 16 07:45:38.982198 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 16 07:45:38.982198 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 07:45:38.982198 dv-cinder-740146-20-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Sep 16 07:45:38.982198 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 640/1285] 10.222.0.57 () {56 vars in 1111 bytes} [Fri Sep 16 07:45:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 07:45:38.987262 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda00adb-6bb1-4ed1-a72e-bbeacbe4e3be None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:45:39.036756 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:45:39.085888 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda00adb-6bb1-4ed1-a72e-bbeacbe4e3be None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:45:39.119052 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c42f5a-17b9-4e78-afe5-af13c8f5576d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:45:39.119651 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c42f5a-17b9-4e78-afe5-af13c8f5576d None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:45:39.119933 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c42f5a-17b9-4e78-afe5-af13c8f5576d None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:45:39.120207 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c42f5a-17b9-4e78-afe5-af13c8f5576d None admin] PATH_INFO: `/v3/projects` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:45:39.120888 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c42f5a-17b9-4e78-afe5-af13c8f5576d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:45:39.121195 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c42f5a-17b9-4e78-afe5-af13c8f5576d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:45:39.123070 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c42f5a-17b9-4e78-afe5-af13c8f5576d None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:45:39.134532 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 646/1286] 10.222.0.57 () {56 vars in 1148 bytes} [Fri Sep 16 07:45:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:45:39.141122 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e95298-cff5-452f-ab33-087ff666f13f None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:45:39.239628 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e95298-cff5-452f-ab33-087ff666f13f None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:45:39.273164 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f33f1d9-5a83-4bbc-abdb-2aaa45601ebe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:45:39.273778 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f33f1d9-5a83-4bbc-abdb-2aaa45601ebe None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:45:39.274056 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f33f1d9-5a83-4bbc-abdb-2aaa45601ebe None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:45:39.274321 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f33f1d9-5a83-4bbc-abdb-2aaa45601ebe None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:45:39.275019 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f33f1d9-5a83-4bbc-abdb-2aaa45601ebe None admin] RBAC: Adding query filter params (role.id=567db03c91854ad9af1e9a87ec1bd275, scope.project.id=4735f453c0c24cc4a1c14e9ac84a0b46, user.id=c7d4ccdd6ef9400ba9e344df0964da1e) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:45:39.275321 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f33f1d9-5a83-4bbc-abdb-2aaa45601ebe None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:45:39.276733 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f33f1d9-5a83-4bbc-abdb-2aaa45601ebe None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:45:39.282861 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 641/1287] 10.222.0.57 () {56 vars in 1374 bytes} [Fri Sep 16 07:45:39 2022] GET /identity/v3/role_assignments?user.id=c7d4ccdd6ef9400ba9e344df0964da1e&scope.project.id=4735f453c0c24cc4a1c14e9ac84a0b46&role.id=567db03c91854ad9af1e9a87ec1bd275 => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:45:41.425510 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42f2a1d-a4a8-459a-8a70-6b6dfb134d2e None None] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:45:41.426057 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42f2a1d-a4a8-459a-8a70-6b6dfb134d2e None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:45:41.426057 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42f2a1d-a4a8-459a-8a70-6b6dfb134d2e None None] PATH_INFO: `/` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:45:41.427314 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 647/1288] 10.222.0.57 () {54 vars in 927 bytes} [Fri Sep 16 07:45:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 07:45:41.432364 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1887c77-b1d6-4de7-bba8-8edae0219d61 None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:45:41.432827 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1887c77-b1d6-4de7-bba8-8edae0219d61 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:45:41.432918 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1887c77-b1d6-4de7-bba8-8edae0219d61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:45:41.451935 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-d1887c77-b1d6-4de7-bba8-8edae0219d61 None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:45:41.453110 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-d1887c77-b1d6-4de7-bba8-8edae0219d61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:45:41.481194 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:45:41.518414 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 642/1289] 10.222.0.57 () {58 vars in 1024 bytes} [Fri Sep 16 07:45:41 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 16 07:45:41.789451 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42f2a1d-a4a8-459a-8a70-6b6dfb134d2e None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:45:41.900945 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42f2a1d-a4a8-459a-8a70-6b6dfb134d2e None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:45:41.912261 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:45:41.934921 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9f52e9-209c-43d4-ac86-56d5113eb2b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:45:41.935612 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9f52e9-209c-43d4-ac86-56d5113eb2b6 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:45:41.935889 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9f52e9-209c-43d4-ac86-56d5113eb2b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:45:41.936157 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9f52e9-209c-43d4-ac86-56d5113eb2b6 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:45:41.936731 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9f52e9-209c-43d4-ac86-56d5113eb2b6 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:45:41.938107 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9f52e9-209c-43d4-ac86-56d5113eb2b6 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:45:41.946513 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application [None req-5f9f52e9-209c-43d4-ac86-56d5113eb2b6 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 16 07:45:41.946513 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 07:45:41.946513 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 16 07:45:41.946513 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 16 07:45:41.946513 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 16 07:45:41.946513 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 16 07:45:41.946513 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 16 07:45:41.946513 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 16 07:45:41.946513 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 16 07:45:41.946513 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Sep 16 07:45:41.946513 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 16 07:45:41.946513 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Sep 16 07:45:41.946513 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 07:45:41.946513 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 07:45:41.946513 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 07:45:41.946513 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 07:45:41.946513 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 07:45:41.947762 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 07:45:41.947762 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 07:45:41.947762 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 07:45:41.947762 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 07:45:41.947762 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 07:45:41.947762 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 07:45:41.947762 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 16 07:45:41.947762 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 16 07:45:41.947762 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 16 07:45:41.947762 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 16 07:45:41.947762 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 07:45:41.947762 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 07:45:41.947762 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 07:45:41.947762 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 07:45:41.947762 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 07:45:41.947762 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 07:45:41.948846 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 07:45:41.948846 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application with Lock( Sep 16 07:45:41.948846 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 07:45:41.948846 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._enter() Sep 16 07:45:41.948846 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 07:45:41.948846 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 07:45:41.948846 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 07:45:41.948846 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.creator() Sep 16 07:45:41.948846 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 07:45:41.948846 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application created_value = creator( Sep 16 07:45:41.948846 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 16 07:45:41.948846 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 16 07:45:41.948846 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 16 07:45:41.948846 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Sep 16 07:45:41.948846 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 648/1290] 10.222.0.57 () {56 vars in 1117 bytes} [Fri Sep 16 07:45:41 2022] GET /identity/v3/services/placement => generated 90 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 07:45:41.954262 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1887c77-b1d6-4de7-bba8-8edae0219d61 None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:45:42.048628 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1887c77-b1d6-4de7-bba8-8edae0219d61 None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:45:42.080760 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3668a375-4f8c-4ac7-8a11-57e71f2db512 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:45:42.081359 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3668a375-4f8c-4ac7-8a11-57e71f2db512 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:45:42.081632 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3668a375-4f8c-4ac7-8a11-57e71f2db512 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:45:42.081931 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3668a375-4f8c-4ac7-8a11-57e71f2db512 None admin] PATH_INFO: `/v3/services` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:45:42.082542 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3668a375-4f8c-4ac7-8a11-57e71f2db512 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:45:42.082836 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3668a375-4f8c-4ac7-8a11-57e71f2db512 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:45:42.084190 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3668a375-4f8c-4ac7-8a11-57e71f2db512 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:45:42.088929 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 643/1291] 10.222.0.57 () {56 vars in 1116 bytes} [Fri Sep 16 07:45:41 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:45:42.095102 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9f52e9-209c-43d4-ac86-56d5113eb2b6 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:45:42.190791 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9f52e9-209c-43d4-ac86-56d5113eb2b6 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:45:42.223567 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7920d5e-ee92-445e-8fe3-1c0c9cc1ca04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:45:42.224185 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7920d5e-ee92-445e-8fe3-1c0c9cc1ca04 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:45:42.224463 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7920d5e-ee92-445e-8fe3-1c0c9cc1ca04 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:45:42.224736 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7920d5e-ee92-445e-8fe3-1c0c9cc1ca04 None admin] PATH_INFO: `/v3/services` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:45:42.225374 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7920d5e-ee92-445e-8fe3-1c0c9cc1ca04 None admin] RBAC: Adding query filter params (type=placement) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:45:42.225676 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7920d5e-ee92-445e-8fe3-1c0c9cc1ca04 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:45:42.227083 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7920d5e-ee92-445e-8fe3-1c0c9cc1ca04 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:45:42.232287 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 649/1292] 10.222.0.57 () {56 vars in 1116 bytes} [Fri Sep 16 07:45:42 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:45:44.356010 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07192110-eb99-4586-aec5-2e290e4f2588 None None] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:45:44.357124 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07192110-eb99-4586-aec5-2e290e4f2588 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:45:44.357124 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07192110-eb99-4586-aec5-2e290e4f2588 None None] PATH_INFO: `/` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:45:44.358606 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 644/1293] 10.222.0.57 () {54 vars in 927 bytes} [Fri Sep 16 07:45:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 07:45:44.363683 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f294a240-69bf-44a7-aeea-a0807fd3c8fc None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:45:44.364085 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f294a240-69bf-44a7-aeea-a0807fd3c8fc None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:45:44.364232 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f294a240-69bf-44a7-aeea-a0807fd3c8fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:45:44.382364 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-f294a240-69bf-44a7-aeea-a0807fd3c8fc None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:45:44.383537 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-f294a240-69bf-44a7-aeea-a0807fd3c8fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:45:44.413111 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:45:44.450889 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 650/1294] 10.222.0.57 () {58 vars in 1024 bytes} [Fri Sep 16 07:45:44 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 16 07:45:44.716496 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07192110-eb99-4586-aec5-2e290e4f2588 None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:45:44.748223 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:45:44.819092 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07192110-eb99-4586-aec5-2e290e4f2588 None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:45:44.851235 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20c7093-f4a6-43fa-b581-aadcf7050f17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:45:44.851825 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20c7093-f4a6-43fa-b581-aadcf7050f17 None admin] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:45:44.852101 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20c7093-f4a6-43fa-b581-aadcf7050f17 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:45:44.852387 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20c7093-f4a6-43fa-b581-aadcf7050f17 None admin] PATH_INFO: `/v3/services` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:45:44.853016 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20c7093-f4a6-43fa-b581-aadcf7050f17 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:45:44.854393 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20c7093-f4a6-43fa-b581-aadcf7050f17 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:45:44.868746 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 645/1295] 10.222.0.57 () {60 vars in 1141 bytes} [Fri Sep 16 07:45:44 2022] POST /identity/v3/services => generated 246 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 07:45:47.014894 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8cd6b1-f37f-48b4-9ac5-2829e90b3734 None None] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:45:47.015463 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8cd6b1-f37f-48b4-9ac5-2829e90b3734 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:45:47.015463 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8cd6b1-f37f-48b4-9ac5-2829e90b3734 None None] PATH_INFO: `/` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:45:47.016879 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 651/1296] 10.222.0.57 () {54 vars in 927 bytes} [Fri Sep 16 07:45:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 07:45:47.022046 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d557e2-da20-4c39-88f7-29827ed4fb35 None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:45:47.022443 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d557e2-da20-4c39-88f7-29827ed4fb35 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:45:47.022582 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d557e2-da20-4c39-88f7-29827ed4fb35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:45:47.040845 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-e3d557e2-da20-4c39-88f7-29827ed4fb35 None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:45:47.042040 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-e3d557e2-da20-4c39-88f7-29827ed4fb35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:45:47.112341 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 646/1297] 10.222.0.57 () {58 vars in 1024 bytes} [Fri Sep 16 07:45:47 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 16 07:45:47.382771 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8cd6b1-f37f-48b4-9ac5-2829e90b3734 None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:45:47.482201 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8cd6b1-f37f-48b4-9ac5-2829e90b3734 None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:45:47.515103 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7f9712-20c0-4a74-93e8-53a3ad7a932a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:45:47.515718 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7f9712-20c0-4a74-93e8-53a3ad7a932a None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:45:47.515995 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7f9712-20c0-4a74-93e8-53a3ad7a932a None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:45:47.516262 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7f9712-20c0-4a74-93e8-53a3ad7a932a None admin] PATH_INFO: `/v3/services/placement` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:45:47.516835 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7f9712-20c0-4a74-93e8-53a3ad7a932a None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:45:47.518220 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7f9712-20c0-4a74-93e8-53a3ad7a932a None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:45:47.526740 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application [None req-fb7f9712-20c0-4a74-93e8-53a3ad7a932a None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 16 07:45:47.526740 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 07:45:47.526740 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 16 07:45:47.526740 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 16 07:45:47.526740 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 16 07:45:47.526740 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 16 07:45:47.526740 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 16 07:45:47.526740 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 16 07:45:47.526740 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 16 07:45:47.526740 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Sep 16 07:45:47.526740 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 16 07:45:47.526740 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Sep 16 07:45:47.526740 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 07:45:47.526740 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 07:45:47.526740 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 07:45:47.526740 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 07:45:47.526740 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 07:45:47.527919 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 07:45:47.527919 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 07:45:47.527919 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 07:45:47.527919 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 07:45:47.527919 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 07:45:47.527919 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 07:45:47.527919 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 16 07:45:47.527919 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 16 07:45:47.527919 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 16 07:45:47.527919 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 16 07:45:47.527919 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 07:45:47.527919 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 07:45:47.527919 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 07:45:47.527919 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 07:45:47.527919 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 07:45:47.527919 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 07:45:47.529414 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 07:45:47.529414 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application with Lock( Sep 16 07:45:47.529414 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 07:45:47.529414 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._enter() Sep 16 07:45:47.529414 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 07:45:47.529414 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 07:45:47.529414 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 07:45:47.529414 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.creator() Sep 16 07:45:47.529414 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 07:45:47.529414 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application created_value = creator( Sep 16 07:45:47.529414 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 16 07:45:47.529414 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 16 07:45:47.529414 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 16 07:45:47.529414 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Sep 16 07:45:47.529414 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 652/1298] 10.222.0.57 () {56 vars in 1117 bytes} [Fri Sep 16 07:45:47 2022] GET /identity/v3/services/placement => generated 90 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 07:45:47.534304 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d557e2-da20-4c39-88f7-29827ed4fb35 None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:45:47.552716 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:45:47.634356 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d557e2-da20-4c39-88f7-29827ed4fb35 None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:45:47.666895 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae371f2-737b-4541-af46-bd5ff83aefa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:45:47.667489 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae371f2-737b-4541-af46-bd5ff83aefa7 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:45:47.667763 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae371f2-737b-4541-af46-bd5ff83aefa7 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:45:47.668029 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae371f2-737b-4541-af46-bd5ff83aefa7 None admin] PATH_INFO: `/v3/services` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:45:47.669298 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae371f2-737b-4541-af46-bd5ff83aefa7 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:45:47.669790 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae371f2-737b-4541-af46-bd5ff83aefa7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:45:47.671151 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae371f2-737b-4541-af46-bd5ff83aefa7 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:45:47.676028 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 647/1299] 10.222.0.57 () {56 vars in 1116 bytes} [Fri Sep 16 07:45:47 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:45:47.682037 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7f9712-20c0-4a74-93e8-53a3ad7a932a None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:45:47.712150 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:45:47.786190 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7f9712-20c0-4a74-93e8-53a3ad7a932a None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:45:47.823094 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6a4af8-50a5-45e5-8e80-349276c8e4ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:45:47.823694 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6a4af8-50a5-45e5-8e80-349276c8e4ab None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:45:47.823974 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6a4af8-50a5-45e5-8e80-349276c8e4ab None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:45:47.824246 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6a4af8-50a5-45e5-8e80-349276c8e4ab None admin] PATH_INFO: `/v3/endpoints` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:45:47.825451 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6a4af8-50a5-45e5-8e80-349276c8e4ab None admin] RBAC: Adding query filter params (interface=public, service_id=e73028da944d494ca9dc0a3b1f087d60, region_id=RegionOne) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:45:47.825790 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6a4af8-50a5-45e5-8e80-349276c8e4ab None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:45:47.827310 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6a4af8-50a5-45e5-8e80-349276c8e4ab None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:45:47.832171 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 653/1300] 10.222.0.57 () {56 vars in 1251 bytes} [Fri Sep 16 07:45:47 2022] GET /identity/v3/endpoints?service_id=e73028da944d494ca9dc0a3b1f087d60&interface=public®ion_id=RegionOne => generated 194 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:45:47.837844 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae371f2-737b-4541-af46-bd5ff83aefa7 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:45:47.915943 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:45:47.933303 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae371f2-737b-4541-af46-bd5ff83aefa7 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:45:47.966839 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebdb502-4fe6-40c7-a868-94b4f40744ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:45:47.967423 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebdb502-4fe6-40c7-a868-94b4f40744ed None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:45:47.967695 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebdb502-4fe6-40c7-a868-94b4f40744ed None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:45:47.967960 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebdb502-4fe6-40c7-a868-94b4f40744ed None admin] PATH_INFO: `/v3/services` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:45:47.968543 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebdb502-4fe6-40c7-a868-94b4f40744ed None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:45:47.969904 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebdb502-4fe6-40c7-a868-94b4f40744ed None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:45:47.976431 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 648/1301] 10.222.0.57 () {56 vars in 1087 bytes} [Fri Sep 16 07:45:47 2022] GET /identity/v3/services => generated 2191 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 07:45:50.096181 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe76318-f4b1-4d5f-b424-5cef1a1962df None None] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:45:50.096772 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe76318-f4b1-4d5f-b424-5cef1a1962df None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:45:50.096772 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe76318-f4b1-4d5f-b424-5cef1a1962df None None] PATH_INFO: `/` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:45:50.098093 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 654/1302] 10.222.0.57 () {54 vars in 927 bytes} [Fri Sep 16 07:45:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 07:45:50.103308 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7878fd81-7747-4cb7-862f-9d814fdb300f None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:45:50.103745 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7878fd81-7747-4cb7-862f-9d814fdb300f None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:45:50.103845 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7878fd81-7747-4cb7-862f-9d814fdb300f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:45:50.121578 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-7878fd81-7747-4cb7-862f-9d814fdb300f None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:45:50.123343 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-7878fd81-7747-4cb7-862f-9d814fdb300f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:45:50.188358 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 649/1303] 10.222.0.57 () {58 vars in 1024 bytes} [Fri Sep 16 07:45:50 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 16 07:45:50.462466 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe76318-f4b1-4d5f-b424-5cef1a1962df None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:45:50.553926 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:45:50.561137 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe76318-f4b1-4d5f-b424-5cef1a1962df None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:45:50.593297 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49dc55db-6323-4e47-9d77-5c3ca2eda5c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:45:50.593934 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dc55db-6323-4e47-9d77-5c3ca2eda5c5 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:45:50.594212 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dc55db-6323-4e47-9d77-5c3ca2eda5c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:45:50.594482 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dc55db-6323-4e47-9d77-5c3ca2eda5c5 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:45:50.595057 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49dc55db-6323-4e47-9d77-5c3ca2eda5c5 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:45:50.596407 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49dc55db-6323-4e47-9d77-5c3ca2eda5c5 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:45:50.604900 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application [None req-49dc55db-6323-4e47-9d77-5c3ca2eda5c5 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 16 07:45:50.604900 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 07:45:50.604900 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 16 07:45:50.604900 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 16 07:45:50.604900 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 16 07:45:50.604900 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 16 07:45:50.604900 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 16 07:45:50.604900 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 16 07:45:50.604900 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 16 07:45:50.604900 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Sep 16 07:45:50.604900 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 16 07:45:50.604900 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Sep 16 07:45:50.604900 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 07:45:50.604900 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 07:45:50.604900 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 07:45:50.604900 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 07:45:50.604900 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 07:45:50.606230 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 07:45:50.606230 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 07:45:50.606230 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 07:45:50.606230 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 07:45:50.606230 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 07:45:50.606230 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 07:45:50.606230 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 16 07:45:50.606230 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 16 07:45:50.606230 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 16 07:45:50.606230 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 16 07:45:50.606230 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 07:45:50.606230 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 07:45:50.606230 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 07:45:50.606230 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 07:45:50.606230 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 07:45:50.606230 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 07:45:50.607191 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 07:45:50.607191 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application with Lock( Sep 16 07:45:50.607191 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 07:45:50.607191 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._enter() Sep 16 07:45:50.607191 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 07:45:50.607191 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 07:45:50.607191 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 07:45:50.607191 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.creator() Sep 16 07:45:50.607191 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 07:45:50.607191 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application created_value = creator( Sep 16 07:45:50.607191 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 16 07:45:50.607191 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 16 07:45:50.607191 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 16 07:45:50.607191 dv-cinder-740146-20-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Sep 16 07:45:50.607191 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 655/1304] 10.222.0.57 () {56 vars in 1117 bytes} [Fri Sep 16 07:45:50 2022] GET /identity/v3/services/placement => generated 90 bytes in 144 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 07:45:50.611869 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7878fd81-7747-4cb7-862f-9d814fdb300f None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:45:50.685160 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:45:50.707693 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7878fd81-7747-4cb7-862f-9d814fdb300f None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:45:50.739609 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6704080a-e170-4821-a26d-52f1c035c011 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:45:50.740148 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6704080a-e170-4821-a26d-52f1c035c011 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:45:50.740424 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6704080a-e170-4821-a26d-52f1c035c011 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:45:50.740692 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6704080a-e170-4821-a26d-52f1c035c011 None admin] PATH_INFO: `/v3/services` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:45:50.741305 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6704080a-e170-4821-a26d-52f1c035c011 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:45:50.741607 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6704080a-e170-4821-a26d-52f1c035c011 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:45:50.743190 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6704080a-e170-4821-a26d-52f1c035c011 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:45:50.749965 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 650/1305] 10.222.0.57 () {56 vars in 1116 bytes} [Fri Sep 16 07:45:50 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:45:50.755840 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49dc55db-6323-4e47-9d77-5c3ca2eda5c5 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:45:50.858922 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49dc55db-6323-4e47-9d77-5c3ca2eda5c5 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:45:50.892269 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c09d3ee-4046-4089-809a-ceb3e1d5d399 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:45:50.892863 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c09d3ee-4046-4089-809a-ceb3e1d5d399 None admin] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:45:50.893138 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c09d3ee-4046-4089-809a-ceb3e1d5d399 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:45:50.893408 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c09d3ee-4046-4089-809a-ceb3e1d5d399 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:45:50.894099 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c09d3ee-4046-4089-809a-ceb3e1d5d399 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:45:50.895442 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c09d3ee-4046-4089-809a-ceb3e1d5d399 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:45:50.913692 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 656/1306] 10.222.0.57 () {60 vars in 1144 bytes} [Fri Sep 16 07:45:50 2022] POST /identity/v3/endpoints => generated 331 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 16 07:46:00.745994 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=30 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:46:00.909997 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:46:55.056242 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66d795a-642b-4747-8435-04aa26af8100 None None] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:46:55.056878 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66d795a-642b-4747-8435-04aa26af8100 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:46:55.056878 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66d795a-642b-4747-8435-04aa26af8100 None None] PATH_INFO: `/` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:46:55.063767 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8babe9e-29ef-4105-a139-b2a5b53f6f7f None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:46:55.064194 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8babe9e-29ef-4105-a139-b2a5b53f6f7f None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:46:55.064401 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8babe9e-29ef-4105-a139-b2a5b53f6f7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:46:55.068898 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 651/1307] 10.222.0.57 () {54 vars in 927 bytes} [Fri Sep 16 07:46:55 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 07:46:55.203223 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-a8babe9e-29ef-4105-a139-b2a5b53f6f7f None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:46:55.205069 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-a8babe9e-29ef-4105-a139-b2a5b53f6f7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:46:55.345758 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 657/1308] 10.222.0.57 () {58 vars in 1024 bytes} [Fri Sep 16 07:46:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 16 07:46:55.656809 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddc0e68-fac9-4889-b260-9adb7a6c959c None None] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:46:55.657493 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddc0e68-fac9-4889-b260-9adb7a6c959c None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:46:55.658022 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddc0e68-fac9-4889-b260-9adb7a6c959c None None] PATH_INFO: `/` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:46:55.659950 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 652/1309] 10.222.0.57 () {54 vars in 965 bytes} [Fri Sep 16 07:46:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 07:46:55.667964 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8699d1e-250e-41ce-86a3-52fad5c16e88 None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:46:55.668615 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8699d1e-250e-41ce-86a3-52fad5c16e88 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:46:55.669105 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8699d1e-250e-41ce-86a3-52fad5c16e88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:46:55.770401 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-f8699d1e-250e-41ce-86a3-52fad5c16e88 None None] MFA Rules not processed for user `1062e457207a41e4ba4f0a0c4bf36f1d`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:46:55.771615 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-f8699d1e-250e-41ce-86a3-52fad5c16e88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:46:55.795897 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:46:55.863306 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 658/1310] 10.222.0.57 () {58 vars in 1062 bytes} [Fri Sep 16 07:46:55 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 16 07:46:55.872714 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddc0e68-fac9-4889-b260-9adb7a6c959c None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:46:55.874857 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-dddc0e68-fac9-4889-b260-9adb7a6c959c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:46:55.995284 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddc0e68-fac9-4889-b260-9adb7a6c959c None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:46:56.086474 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6695601b-09c4-432a-82f9-86c943ca9626 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1062e457207a41e4ba4f0a0c4bf36f1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4735f453c0c24cc4a1c14e9ac84a0b46', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:46:56.087361 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6695601b-09c4-432a-82f9-86c943ca9626 service neutron] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:46:56.087651 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6695601b-09c4-432a-82f9-86c943ca9626 service neutron] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:46:56.088004 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6695601b-09c4-432a-82f9-86c943ca9626 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:46:56.089699 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-6695601b-09c4-432a-82f9-86c943ca9626 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:46:56.154905 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:46:56.220021 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6695601b-09c4-432a-82f9-86c943ca9626 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:46:56.221511 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6695601b-09c4-432a-82f9-86c943ca9626 service neutron] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:46:56.248203 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 653/1311] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Sep 16 07:46:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 07:46:58.888804 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663c8c84-1174-47f9-874e-39771aedfb18 None None] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:46:58.889385 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663c8c84-1174-47f9-874e-39771aedfb18 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:46:58.889385 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663c8c84-1174-47f9-874e-39771aedfb18 None None] PATH_INFO: `/` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:46:58.890728 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 659/1312] 10.222.0.57 () {54 vars in 927 bytes} [Fri Sep 16 07:46:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 16 07:46:58.895942 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1c4e3c-2c98-454b-ac1d-676e5c8e5d5b None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:46:58.896317 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1c4e3c-2c98-454b-ac1d-676e5c8e5d5b None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:46:58.896492 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1c4e3c-2c98-454b-ac1d-676e5c8e5d5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:46:58.967251 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-0e1c4e3c-2c98-454b-ac1d-676e5c8e5d5b None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:46:58.968460 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-0e1c4e3c-2c98-454b-ac1d-676e5c8e5d5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:46:59.063817 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 654/1313] 10.222.0.57 () {58 vars in 1024 bytes} [Fri Sep 16 07:46:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 07:46:59.359834 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be0cc14-4487-45b3-975c-63553a280468 None None] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:46:59.360120 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be0cc14-4487-45b3-975c-63553a280468 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:46:59.360393 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be0cc14-4487-45b3-975c-63553a280468 None None] PATH_INFO: `/` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:46:59.362078 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 660/1314] 10.222.0.57 () {54 vars in 965 bytes} [Fri Sep 16 07:46:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 07:46:59.367807 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebec3fa5-60dc-4ef7-8cfa-442f897dafa8 None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:46:59.368088 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebec3fa5-60dc-4ef7-8cfa-442f897dafa8 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:46:59.368346 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebec3fa5-60dc-4ef7-8cfa-442f897dafa8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:46:59.380178 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:46:59.443693 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-ebec3fa5-60dc-4ef7-8cfa-442f897dafa8 None None] MFA Rules not processed for user `1062e457207a41e4ba4f0a0c4bf36f1d`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:46:59.444905 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-ebec3fa5-60dc-4ef7-8cfa-442f897dafa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:46:59.520252 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 655/1315] 10.222.0.57 () {58 vars in 1062 bytes} [Fri Sep 16 07:46:59 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 07:46:59.530023 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be0cc14-4487-45b3-975c-63553a280468 None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:46:59.531583 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-9be0cc14-4487-45b3-975c-63553a280468 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:46:59.642651 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be0cc14-4487-45b3-975c-63553a280468 None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:46:59.714463 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:46:59.716839 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c580dc4-33bd-4271-b895-2a972a0bcc88 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1062e457207a41e4ba4f0a0c4bf36f1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4735f453c0c24cc4a1c14e9ac84a0b46', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:46:59.717618 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c580dc4-33bd-4271-b895-2a972a0bcc88 service neutron] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:46:59.718084 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c580dc4-33bd-4271-b895-2a972a0bcc88 service neutron] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:46:59.718544 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c580dc4-33bd-4271-b895-2a972a0bcc88 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:46:59.720136 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-7c580dc4-33bd-4271-b895-2a972a0bcc88 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:46:59.830303 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c580dc4-33bd-4271-b895-2a972a0bcc88 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:46:59.831733 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c580dc4-33bd-4271-b895-2a972a0bcc88 service neutron] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:46:59.850619 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 661/1316] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Sep 16 07:46:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 07:47:02.534338 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fec03d-8640-4ee9-8462-02805959fcd2 None None] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:47:02.534864 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fec03d-8640-4ee9-8462-02805959fcd2 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:47:02.534864 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fec03d-8640-4ee9-8462-02805959fcd2 None None] PATH_INFO: `/` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:47:02.536136 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 656/1317] 10.222.0.57 () {54 vars in 927 bytes} [Fri Sep 16 07:47:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 07:47:02.541987 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec16998d-0048-4b0c-97b5-c52dff4ab9d6 None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:47:02.542407 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec16998d-0048-4b0c-97b5-c52dff4ab9d6 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:47:02.542516 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec16998d-0048-4b0c-97b5-c52dff4ab9d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:47:02.607596 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-ec16998d-0048-4b0c-97b5-c52dff4ab9d6 None None] MFA Rules not processed for user `0b68433814c44561931bfd7051cd6b7d`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:47:02.608789 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-ec16998d-0048-4b0c-97b5-c52dff4ab9d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:47:02.660075 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:47:02.705564 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 662/1318] 10.222.0.57 () {58 vars in 1024 bytes} [Fri Sep 16 07:47:02 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 07:47:03.002374 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fec03d-8640-4ee9-8462-02805959fcd2 None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:47:03.003928 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-19fec03d-8640-4ee9-8462-02805959fcd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:47:03.106870 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fec03d-8640-4ee9-8462-02805959fcd2 None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:47:03.109666 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:47:03.182110 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009a4bf2-dd4b-48c4-9113-547dedeea430 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1062e457207a41e4ba4f0a0c4bf36f1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4735f453c0c24cc4a1c14e9ac84a0b46', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:47:03.182711 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009a4bf2-dd4b-48c4-9113-547dedeea430 service neutron] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:47:03.182979 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009a4bf2-dd4b-48c4-9113-547dedeea430 service neutron] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:47:03.183240 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009a4bf2-dd4b-48c4-9113-547dedeea430 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:47:03.184811 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-009a4bf2-dd4b-48c4-9113-547dedeea430 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:47:03.290559 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009a4bf2-dd4b-48c4-9113-547dedeea430 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:47:03.291905 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009a4bf2-dd4b-48c4-9113-547dedeea430 service neutron] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:47:03.309578 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 657/1319] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Sep 16 07:47:03 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 07:47:06.006689 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08ff8c0-46fa-446e-bf2e-57366e804cbf None None] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:47:06.007227 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08ff8c0-46fa-446e-bf2e-57366e804cbf None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:47:06.007227 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08ff8c0-46fa-446e-bf2e-57366e804cbf None None] PATH_INFO: `/` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:47:06.009182 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 663/1320] 10.222.0.57 () {54 vars in 927 bytes} [Fri Sep 16 07:47:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 07:47:06.014636 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d19e38-5490-417d-88dc-2b18c8bee392 None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:47:06.015017 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d19e38-5490-417d-88dc-2b18c8bee392 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:47:06.015196 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d19e38-5490-417d-88dc-2b18c8bee392 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:47:06.055821 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:47:06.081287 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-73d19e38-5490-417d-88dc-2b18c8bee392 None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:47:06.082556 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-73d19e38-5490-417d-88dc-2b18c8bee392 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:47:06.178395 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 658/1321] 10.222.0.57 () {58 vars in 1024 bytes} [Fri Sep 16 07:47:06 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 07:47:06.464684 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08ff8c0-46fa-446e-bf2e-57366e804cbf None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:47:06.466275 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-f08ff8c0-46fa-446e-bf2e-57366e804cbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:47:06.566056 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08ff8c0-46fa-446e-bf2e-57366e804cbf None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:47:06.638787 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcdff8c-5f2a-40d3-8f35-2727226c2dfd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1062e457207a41e4ba4f0a0c4bf36f1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4735f453c0c24cc4a1c14e9ac84a0b46', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:47:06.639377 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcdff8c-5f2a-40d3-8f35-2727226c2dfd service neutron] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:47:06.639648 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcdff8c-5f2a-40d3-8f35-2727226c2dfd service neutron] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:47:06.639914 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcdff8c-5f2a-40d3-8f35-2727226c2dfd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:47:06.641484 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-bbcdff8c-5f2a-40d3-8f35-2727226c2dfd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:47:06.648199 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:47:06.748776 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbcdff8c-5f2a-40d3-8f35-2727226c2dfd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:47:06.750633 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbcdff8c-5f2a-40d3-8f35-2727226c2dfd service neutron] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:47:06.770585 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 664/1322] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Sep 16 07:47:06 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 07:47:09.548290 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64bebd3-1e57-4dde-ad67-41780ee7abec None None] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:47:09.548791 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64bebd3-1e57-4dde-ad67-41780ee7abec None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:47:09.548791 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64bebd3-1e57-4dde-ad67-41780ee7abec None None] PATH_INFO: `/` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:47:09.550186 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 659/1323] 10.222.0.57 () {54 vars in 927 bytes} [Fri Sep 16 07:47:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 07:47:09.556215 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b033fc-a143-4724-a20b-b629f38808d0 None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:47:09.556617 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b033fc-a143-4724-a20b-b629f38808d0 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:47:09.556898 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b033fc-a143-4724-a20b-b629f38808d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:47:09.639358 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-30b033fc-a143-4724-a20b-b629f38808d0 None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:47:09.641062 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-30b033fc-a143-4724-a20b-b629f38808d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:47:09.708490 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:47:09.753736 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 665/1324] 10.222.0.57 () {58 vars in 1024 bytes} [Fri Sep 16 07:47:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 07:47:10.035946 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64bebd3-1e57-4dde-ad67-41780ee7abec None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:47:10.037428 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-a64bebd3-1e57-4dde-ad67-41780ee7abec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:47:10.149903 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64bebd3-1e57-4dde-ad67-41780ee7abec None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:47:10.163494 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:47:10.226011 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed83ec7-2411-42aa-ba71-a20621a41b70 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1062e457207a41e4ba4f0a0c4bf36f1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4735f453c0c24cc4a1c14e9ac84a0b46', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:47:10.227146 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed83ec7-2411-42aa-ba71-a20621a41b70 service neutron] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:47:10.227418 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed83ec7-2411-42aa-ba71-a20621a41b70 service neutron] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:47:10.227668 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed83ec7-2411-42aa-ba71-a20621a41b70 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:47:10.229245 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-2ed83ec7-2411-42aa-ba71-a20621a41b70 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:47:10.345925 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed83ec7-2411-42aa-ba71-a20621a41b70 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:47:10.347262 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed83ec7-2411-42aa-ba71-a20621a41b70 service neutron] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:47:10.365812 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 660/1325] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Sep 16 07:47:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 07:47:12.584245 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c7b84c-219f-4ed2-8b28-f926047b3554 None None] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:47:12.584792 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c7b84c-219f-4ed2-8b28-f926047b3554 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:47:12.584792 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c7b84c-219f-4ed2-8b28-f926047b3554 None None] PATH_INFO: `/` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:47:12.586535 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 666/1326] 10.222.0.57 () {54 vars in 927 bytes} [Fri Sep 16 07:47:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 07:47:12.591822 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013b12fd-cb99-4078-8eb9-4b054d7c8a33 None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:47:12.592227 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013b12fd-cb99-4078-8eb9-4b054d7c8a33 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:47:12.592367 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013b12fd-cb99-4078-8eb9-4b054d7c8a33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:47:12.641596 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:47:12.659882 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-013b12fd-cb99-4078-8eb9-4b054d7c8a33 None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:47:12.661103 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-013b12fd-cb99-4078-8eb9-4b054d7c8a33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:47:12.768001 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 661/1327] 10.222.0.57 () {58 vars in 1024 bytes} [Fri Sep 16 07:47:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 07:47:13.047695 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c7b84c-219f-4ed2-8b28-f926047b3554 None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:47:13.049273 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-78c7b84c-219f-4ed2-8b28-f926047b3554 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:47:13.158811 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c7b84c-219f-4ed2-8b28-f926047b3554 None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:47:13.231740 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c456c7-338f-4777-9a0c-b1963648b6e2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1062e457207a41e4ba4f0a0c4bf36f1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4735f453c0c24cc4a1c14e9ac84a0b46', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:47:13.232349 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c456c7-338f-4777-9a0c-b1963648b6e2 service neutron] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:47:13.232630 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c456c7-338f-4777-9a0c-b1963648b6e2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:47:13.232905 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c456c7-338f-4777-9a0c-b1963648b6e2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:47:13.234556 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-d5c456c7-338f-4777-9a0c-b1963648b6e2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:47:13.252390 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:47:13.345383 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c456c7-338f-4777-9a0c-b1963648b6e2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:47:13.346767 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c456c7-338f-4777-9a0c-b1963648b6e2 service neutron] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:47:13.365122 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 667/1328] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Sep 16 07:47:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 07:47:15.590688 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d86fbe-7454-43df-828c-d0dcdeaf11d7 None None] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:47:15.591238 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d86fbe-7454-43df-828c-d0dcdeaf11d7 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:47:15.591238 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d86fbe-7454-43df-828c-d0dcdeaf11d7 None None] PATH_INFO: `/` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:47:15.592576 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 662/1329] 10.222.0.57 () {54 vars in 927 bytes} [Fri Sep 16 07:47:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 07:47:15.598151 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df4e9df-4f28-4cc8-9be5-9f178d623659 None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:47:15.598582 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df4e9df-4f28-4cc8-9be5-9f178d623659 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:47:15.598703 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df4e9df-4f28-4cc8-9be5-9f178d623659 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:47:15.666006 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-6df4e9df-4f28-4cc8-9be5-9f178d623659 None None] MFA Rules not processed for user `0b68433814c44561931bfd7051cd6b7d`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:47:15.667149 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-6df4e9df-4f28-4cc8-9be5-9f178d623659 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:47:15.731204 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:47:15.765175 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 668/1330] 10.222.0.57 () {58 vars in 1024 bytes} [Fri Sep 16 07:47:15 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 07:47:16.052136 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d86fbe-7454-43df-828c-d0dcdeaf11d7 None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:47:16.053677 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-26d86fbe-7454-43df-828c-d0dcdeaf11d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:47:16.169242 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d86fbe-7454-43df-828c-d0dcdeaf11d7 None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:47:16.191851 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:47:16.249064 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d5f8a8-a25e-4585-b55a-5baa7026d00f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1062e457207a41e4ba4f0a0c4bf36f1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4735f453c0c24cc4a1c14e9ac84a0b46', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:47:16.249667 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d5f8a8-a25e-4585-b55a-5baa7026d00f service neutron] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:47:16.249971 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d5f8a8-a25e-4585-b55a-5baa7026d00f service neutron] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:47:16.250237 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d5f8a8-a25e-4585-b55a-5baa7026d00f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:47:16.251911 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-42d5f8a8-a25e-4585-b55a-5baa7026d00f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:47:16.361782 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d5f8a8-a25e-4585-b55a-5baa7026d00f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:47:16.363215 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d5f8a8-a25e-4585-b55a-5baa7026d00f service neutron] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:47:16.381487 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 663/1331] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Sep 16 07:47:16 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 07:47:18.958171 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d294f1-4f81-4ed3-b6bb-3f69590d90a2 None None] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:47:18.958675 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d294f1-4f81-4ed3-b6bb-3f69590d90a2 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:47:18.958675 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d294f1-4f81-4ed3-b6bb-3f69590d90a2 None None] PATH_INFO: `/` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:47:18.960167 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 669/1332] 10.222.0.57 () {54 vars in 927 bytes} [Fri Sep 16 07:47:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 07:47:18.965255 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fac1ad1-600d-4aee-a4cc-bae5d806ab9d None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:47:18.965677 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fac1ad1-600d-4aee-a4cc-bae5d806ab9d None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:47:18.965844 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fac1ad1-600d-4aee-a4cc-bae5d806ab9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:47:19.028322 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:47:19.030934 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-0fac1ad1-600d-4aee-a4cc-bae5d806ab9d None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:47:19.032750 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-0fac1ad1-600d-4aee-a4cc-bae5d806ab9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:47:19.127893 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 664/1333] 10.222.0.57 () {58 vars in 1024 bytes} [Fri Sep 16 07:47:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 07:47:19.407706 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d294f1-4f81-4ed3-b6bb-3f69590d90a2 None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:47:19.409281 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-e0d294f1-4f81-4ed3-b6bb-3f69590d90a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:47:19.511427 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d294f1-4f81-4ed3-b6bb-3f69590d90a2 None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:47:19.582877 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5167f1-0b0e-4334-8c4c-b74b8a2f234f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1062e457207a41e4ba4f0a0c4bf36f1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4735f453c0c24cc4a1c14e9ac84a0b46', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:47:19.583473 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5167f1-0b0e-4334-8c4c-b74b8a2f234f service neutron] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:47:19.583752 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5167f1-0b0e-4334-8c4c-b74b8a2f234f service neutron] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:47:19.584021 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5167f1-0b0e-4334-8c4c-b74b8a2f234f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:47:19.586161 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-2c5167f1-0b0e-4334-8c4c-b74b8a2f234f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:47:19.612804 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:47:19.693489 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5167f1-0b0e-4334-8c4c-b74b8a2f234f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:47:19.695669 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5167f1-0b0e-4334-8c4c-b74b8a2f234f service neutron] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:47:19.713787 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 670/1334] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Sep 16 07:47:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 07:47:21.952146 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ff77e7-defc-4faf-9ad3-4479a026000a None None] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:47:21.952746 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ff77e7-defc-4faf-9ad3-4479a026000a None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:47:21.952746 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ff77e7-defc-4faf-9ad3-4479a026000a None None] PATH_INFO: `/` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:47:21.954087 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 665/1335] 10.222.0.57 () {54 vars in 927 bytes} [Fri Sep 16 07:47:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 07:47:21.959176 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec994900-92c5-4783-b723-678c5ef6c257 None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:47:21.959620 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec994900-92c5-4783-b723-678c5ef6c257 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:47:21.959779 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec994900-92c5-4783-b723-678c5ef6c257 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:47:22.026629 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-ec994900-92c5-4783-b723-678c5ef6c257 None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:47:22.027929 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-ec994900-92c5-4783-b723-678c5ef6c257 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:47:22.106306 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:47:22.129315 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 671/1336] 10.222.0.57 () {58 vars in 1024 bytes} [Fri Sep 16 07:47:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 07:47:22.414268 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ff77e7-defc-4faf-9ad3-4479a026000a None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:47:22.415825 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-85ff77e7-defc-4faf-9ad3-4479a026000a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:47:22.519827 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ff77e7-defc-4faf-9ad3-4479a026000a None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:47:22.548612 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:47:22.592783 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a6f120-2e86-4586-89e0-099e25beb1a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1062e457207a41e4ba4f0a0c4bf36f1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4735f453c0c24cc4a1c14e9ac84a0b46', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:47:22.593381 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a6f120-2e86-4586-89e0-099e25beb1a7 service neutron] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:47:22.593656 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a6f120-2e86-4586-89e0-099e25beb1a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:47:22.593953 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a6f120-2e86-4586-89e0-099e25beb1a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:47:22.595534 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-e8a6f120-2e86-4586-89e0-099e25beb1a7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:47:22.706969 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a6f120-2e86-4586-89e0-099e25beb1a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:47:22.708382 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a6f120-2e86-4586-89e0-099e25beb1a7 service neutron] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:47:22.726835 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 666/1337] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Sep 16 07:47:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 07:47:25.338136 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc7f850-3175-4fa5-826d-48b8b434b2b7 None None] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:47:25.338685 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc7f850-3175-4fa5-826d-48b8b434b2b7 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:47:25.338685 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc7f850-3175-4fa5-826d-48b8b434b2b7 None None] PATH_INFO: `/` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:47:25.339996 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 672/1338] 10.222.0.57 () {54 vars in 927 bytes} [Fri Sep 16 07:47:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 07:47:25.345080 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb2ec7f-158f-455b-b6f2-fa8c5cd57e7f None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:47:25.345462 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb2ec7f-158f-455b-b6f2-fa8c5cd57e7f None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:47:25.345663 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb2ec7f-158f-455b-b6f2-fa8c5cd57e7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:47:25.410935 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-ccb2ec7f-158f-455b-b6f2-fa8c5cd57e7f None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:47:25.412099 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-ccb2ec7f-158f-455b-b6f2-fa8c5cd57e7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:47:25.420527 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:47:25.509679 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 667/1339] 10.222.0.57 () {58 vars in 1024 bytes} [Fri Sep 16 07:47:25 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 07:47:25.794353 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc7f850-3175-4fa5-826d-48b8b434b2b7 None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:47:25.795907 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-dcc7f850-3175-4fa5-826d-48b8b434b2b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:47:25.898204 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc7f850-3175-4fa5-826d-48b8b434b2b7 None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:47:25.971246 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa37e0b4-f159-41fc-974b-fa5ccad9100c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1062e457207a41e4ba4f0a0c4bf36f1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4735f453c0c24cc4a1c14e9ac84a0b46', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:47:25.971843 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa37e0b4-f159-41fc-974b-fa5ccad9100c service neutron] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:47:25.972115 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa37e0b4-f159-41fc-974b-fa5ccad9100c service neutron] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:47:25.972380 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa37e0b4-f159-41fc-974b-fa5ccad9100c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:47:25.973987 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-fa37e0b4-f159-41fc-974b-fa5ccad9100c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:47:26.009215 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:47:26.091145 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa37e0b4-f159-41fc-974b-fa5ccad9100c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:47:26.092485 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa37e0b4-f159-41fc-974b-fa5ccad9100c service neutron] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:47:26.111398 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 673/1340] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Sep 16 07:47:25 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 07:47:30.286068 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db718698-5dac-44fb-91cb-958e6e4f7b06 None None] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:47:30.286626 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db718698-5dac-44fb-91cb-958e6e4f7b06 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:47:30.286626 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db718698-5dac-44fb-91cb-958e6e4f7b06 None None] PATH_INFO: `/` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:47:30.288483 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 668/1341] 10.222.0.57 () {54 vars in 927 bytes} [Fri Sep 16 07:47:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 07:47:30.293705 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdce821a-f51c-44ac-a913-29b05eddb81e None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:47:30.294158 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdce821a-f51c-44ac-a913-29b05eddb81e None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:47:30.294453 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdce821a-f51c-44ac-a913-29b05eddb81e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:47:30.370193 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-bdce821a-f51c-44ac-a913-29b05eddb81e None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:47:30.371466 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-bdce821a-f51c-44ac-a913-29b05eddb81e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:47:30.464590 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:47:30.477178 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 674/1342] 10.222.0.57 () {58 vars in 1024 bytes} [Fri Sep 16 07:47:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 07:47:30.766452 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db718698-5dac-44fb-91cb-958e6e4f7b06 None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:47:30.768086 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-db718698-5dac-44fb-91cb-958e6e4f7b06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:47:30.872219 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db718698-5dac-44fb-91cb-958e6e4f7b06 None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:47:30.911416 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:47:30.950121 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b4a758-f4e9-4269-9291-765fff6d20a2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1062e457207a41e4ba4f0a0c4bf36f1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4735f453c0c24cc4a1c14e9ac84a0b46', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:47:30.950718 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b4a758-f4e9-4269-9291-765fff6d20a2 service neutron] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:47:30.950989 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b4a758-f4e9-4269-9291-765fff6d20a2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:47:30.951255 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b4a758-f4e9-4269-9291-765fff6d20a2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:47:30.952822 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-f0b4a758-f4e9-4269-9291-765fff6d20a2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:47:31.067513 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b4a758-f4e9-4269-9291-765fff6d20a2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:47:31.069087 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b4a758-f4e9-4269-9291-765fff6d20a2 service neutron] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:47:31.087922 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 669/1343] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Sep 16 07:47:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 07:47:33.886805 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631d9e9c-5949-40b4-b1c7-9fa9066a246c None None] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:47:33.887344 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631d9e9c-5949-40b4-b1c7-9fa9066a246c None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:47:33.887344 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631d9e9c-5949-40b4-b1c7-9fa9066a246c None None] PATH_INFO: `/` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:47:33.888690 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 675/1344] 10.222.0.57 () {54 vars in 927 bytes} [Fri Sep 16 07:47:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 07:47:33.894302 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8cd928-ea2b-4979-a24f-6872886ea6c8 None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:47:33.894770 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8cd928-ea2b-4979-a24f-6872886ea6c8 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:47:33.894868 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8cd928-ea2b-4979-a24f-6872886ea6c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:47:33.961574 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-8d8cd928-ea2b-4979-a24f-6872886ea6c8 None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:47:33.962798 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-8d8cd928-ea2b-4979-a24f-6872886ea6c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:47:33.981074 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:47:34.061266 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 670/1345] 10.222.0.57 () {58 vars in 1024 bytes} [Fri Sep 16 07:47:33 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 07:47:34.340241 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631d9e9c-5949-40b4-b1c7-9fa9066a246c None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:47:34.341826 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-631d9e9c-5949-40b4-b1c7-9fa9066a246c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:47:34.451055 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631d9e9c-5949-40b4-b1c7-9fa9066a246c None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:47:34.525892 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5421570-bffe-493b-bde0-cc5af721ee9a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1062e457207a41e4ba4f0a0c4bf36f1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4735f453c0c24cc4a1c14e9ac84a0b46', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:47:34.526416 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5421570-bffe-493b-bde0-cc5af721ee9a service neutron] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:47:34.526712 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5421570-bffe-493b-bde0-cc5af721ee9a service neutron] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:47:34.526972 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5421570-bffe-493b-bde0-cc5af721ee9a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:47:34.528587 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-f5421570-bffe-493b-bde0-cc5af721ee9a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:47:34.573714 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:47:34.658503 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5421570-bffe-493b-bde0-cc5af721ee9a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:47:34.659952 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5421570-bffe-493b-bde0-cc5af721ee9a service neutron] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:47:34.681790 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 676/1346] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Sep 16 07:47:34 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 07:47:38.824760 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b9bda7-0c1b-4f08-85e1-e64e522018a5 None None] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:47:38.825265 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b9bda7-0c1b-4f08-85e1-e64e522018a5 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:47:38.825361 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b9bda7-0c1b-4f08-85e1-e64e522018a5 None None] PATH_INFO: `/` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:47:38.826842 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 671/1347] 10.222.0.57 () {54 vars in 927 bytes} [Fri Sep 16 07:47:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 07:47:38.832458 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c770a49-48b9-4631-aa9a-48ae03d43d69 None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:47:38.832897 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c770a49-48b9-4631-aa9a-48ae03d43d69 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:47:38.833001 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c770a49-48b9-4631-aa9a-48ae03d43d69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:47:38.910036 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-8c770a49-48b9-4631-aa9a-48ae03d43d69 None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:47:38.911294 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-8c770a49-48b9-4631-aa9a-48ae03d43d69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:47:39.015133 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:47:39.020372 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 677/1348] 10.222.0.57 () {58 vars in 1024 bytes} [Fri Sep 16 07:47:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 07:47:39.298754 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b9bda7-0c1b-4f08-85e1-e64e522018a5 None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:47:39.300277 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-07b9bda7-0c1b-4f08-85e1-e64e522018a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:47:39.402874 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b9bda7-0c1b-4f08-85e1-e64e522018a5 None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:47:39.450135 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:47:39.476694 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9943ac-32bc-4b95-8f4b-8db1f6ee359c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1062e457207a41e4ba4f0a0c4bf36f1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4735f453c0c24cc4a1c14e9ac84a0b46', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:47:39.477290 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9943ac-32bc-4b95-8f4b-8db1f6ee359c service neutron] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:47:39.477565 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9943ac-32bc-4b95-8f4b-8db1f6ee359c service neutron] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:47:39.477868 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9943ac-32bc-4b95-8f4b-8db1f6ee359c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:47:39.479452 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-5f9943ac-32bc-4b95-8f4b-8db1f6ee359c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:47:39.588143 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9943ac-32bc-4b95-8f4b-8db1f6ee359c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:47:39.589493 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9943ac-32bc-4b95-8f4b-8db1f6ee359c service neutron] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:47:39.606835 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 672/1349] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Sep 16 07:47:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 07:47:44.600390 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690f6c7e-8d91-4c59-a864-1284060ccd7b None None] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:47:44.600897 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690f6c7e-8d91-4c59-a864-1284060ccd7b None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:47:44.600986 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690f6c7e-8d91-4c59-a864-1284060ccd7b None None] PATH_INFO: `/` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:47:44.602680 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 678/1350] 10.222.0.57 () {54 vars in 921 bytes} [Fri Sep 16 07:47:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 07:47:44.607687 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f6cb62-f8db-4d74-be37-df0facfa96ae None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:47:44.608104 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f6cb62-f8db-4d74-be37-df0facfa96ae None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:47:44.608198 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f6cb62-f8db-4d74-be37-df0facfa96ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:47:44.715747 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-c9f6cb62-f8db-4d74-be37-df0facfa96ae None None] MFA Rules not processed for user `c7d4ccdd6ef9400ba9e344df0964da1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:47:44.716972 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-c9f6cb62-f8db-4d74-be37-df0facfa96ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:47:44.770097 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:47:44.873185 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 673/1351] 10.222.0.57 () {58 vars in 1018 bytes} [Fri Sep 16 07:47:44 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 16 07:47:48.974491 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8220b543-c43a-4250-ad11-d027a0c7d006 None None] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:47:48.975611 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8220b543-c43a-4250-ad11-d027a0c7d006 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:47:48.975742 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8220b543-c43a-4250-ad11-d027a0c7d006 None None] PATH_INFO: `/` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:47:48.977533 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 679/1352] 10.222.0.57 () {54 vars in 921 bytes} [Fri Sep 16 07:47:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 07:47:48.983019 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5e9cbc-6223-4a6d-9c2b-0c4716ac1d29 None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:47:48.983482 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5e9cbc-6223-4a6d-9c2b-0c4716ac1d29 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:47:48.983804 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5e9cbc-6223-4a6d-9c2b-0c4716ac1d29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:47:49.063044 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-1b5e9cbc-6223-4a6d-9c2b-0c4716ac1d29 None None] MFA Rules not processed for user `c7d4ccdd6ef9400ba9e344df0964da1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:47:49.064274 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-1b5e9cbc-6223-4a6d-9c2b-0c4716ac1d29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:47:49.148053 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:47:49.186768 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 674/1353] 10.222.0.57 () {58 vars in 1018 bytes} [Fri Sep 16 07:47:48 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 07:47:50.592299 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc4e6bb-89cc-426b-9749-63724db1d0a5 None None] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:47:50.592842 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc4e6bb-89cc-426b-9749-63724db1d0a5 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:47:50.592955 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc4e6bb-89cc-426b-9749-63724db1d0a5 None None] PATH_INFO: `/` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:47:50.594420 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 680/1354] 10.222.0.57 () {54 vars in 921 bytes} [Fri Sep 16 07:47:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 07:47:50.599440 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710de0c4-182e-4546-b6f2-69919714c7cf None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:47:50.600399 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710de0c4-182e-4546-b6f2-69919714c7cf None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:47:50.600598 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710de0c4-182e-4546-b6f2-69919714c7cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:47:50.680174 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-710de0c4-182e-4546-b6f2-69919714c7cf None None] MFA Rules not processed for user `c7d4ccdd6ef9400ba9e344df0964da1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:47:50.681400 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-710de0c4-182e-4546-b6f2-69919714c7cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:47:50.789179 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 675/1355] 10.222.0.57 () {58 vars in 1018 bytes} [Fri Sep 16 07:47:50 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 16 07:47:54.459003 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917e8bd8-3751-4571-98fe-d90fcc385362 None None] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:47:54.460170 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917e8bd8-3751-4571-98fe-d90fcc385362 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:47:54.460170 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917e8bd8-3751-4571-98fe-d90fcc385362 None None] PATH_INFO: `/` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:47:54.461316 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 681/1356] 10.222.0.57 () {54 vars in 927 bytes} [Fri Sep 16 07:47:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 07:47:54.466733 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6605ef1a-3cbb-49b8-a262-e92a55ff8646 None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:47:54.467178 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6605ef1a-3cbb-49b8-a262-e92a55ff8646 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:47:54.467269 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6605ef1a-3cbb-49b8-a262-e92a55ff8646 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:47:54.506823 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:47:54.542693 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-6605ef1a-3cbb-49b8-a262-e92a55ff8646 None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:47:54.544180 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-6605ef1a-3cbb-49b8-a262-e92a55ff8646 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:47:54.658659 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 676/1357] 10.222.0.57 () {58 vars in 1024 bytes} [Fri Sep 16 07:47:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 07:47:54.960854 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5153a83b-d657-4f78-b752-a56971f0b949 None None] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:47:54.961507 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5153a83b-d657-4f78-b752-a56971f0b949 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:47:54.962022 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5153a83b-d657-4f78-b752-a56971f0b949 None None] PATH_INFO: `/` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:47:54.963943 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 682/1358] 10.222.0.57 () {54 vars in 962 bytes} [Fri Sep 16 07:47:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 07:47:54.972219 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01812920-8025-4e5c-b611-79cf79dead64 None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:47:54.972475 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01812920-8025-4e5c-b611-79cf79dead64 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:47:54.972745 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01812920-8025-4e5c-b611-79cf79dead64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:47:55.066582 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-01812920-8025-4e5c-b611-79cf79dead64 None None] MFA Rules not processed for user `9bec4d9b08514461a1bf63c6b88f53b2`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:47:55.067798 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-01812920-8025-4e5c-b611-79cf79dead64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:47:55.123277 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:47:55.210325 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 677/1359] 10.222.0.57 () {58 vars in 1059 bytes} [Fri Sep 16 07:47:54 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 07:47:55.218347 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5153a83b-d657-4f78-b752-a56971f0b949 None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:47:55.219949 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-5153a83b-d657-4f78-b752-a56971f0b949 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:47:55.381512 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5153a83b-d657-4f78-b752-a56971f0b949 None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:47:55.460850 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:47:55.504742 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21611842-0d62-43f9-8308-4eec8cca3415 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bec4d9b08514461a1bf63c6b88f53b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4735f453c0c24cc4a1c14e9ac84a0b46', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:47:55.505506 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21611842-0d62-43f9-8308-4eec8cca3415 service nova] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:47:55.505927 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21611842-0d62-43f9-8308-4eec8cca3415 service nova] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:47:55.506865 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21611842-0d62-43f9-8308-4eec8cca3415 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:47:55.508644 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-21611842-0d62-43f9-8308-4eec8cca3415 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:47:55.610547 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21611842-0d62-43f9-8308-4eec8cca3415 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:47:55.612278 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21611842-0d62-43f9-8308-4eec8cca3415 service nova] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:47:55.631732 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 683/1360] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Sep 16 07:47:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 16 07:47:58.040913 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871ac572-2b4f-4e69-8055-a73cef83e295 None None] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:47:58.041563 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871ac572-2b4f-4e69-8055-a73cef83e295 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:47:58.041563 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871ac572-2b4f-4e69-8055-a73cef83e295 None None] PATH_INFO: `/` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:47:58.048500 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f04c46-4f27-42d4-bde5-04ef9ef7e186 None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:47:58.048500 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f04c46-4f27-42d4-bde5-04ef9ef7e186 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:47:58.049288 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f04c46-4f27-42d4-bde5-04ef9ef7e186 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:47:58.053851 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 678/1361] 10.222.0.57 () {54 vars in 927 bytes} [Fri Sep 16 07:47:58 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 07:47:58.119659 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-23f04c46-4f27-42d4-bde5-04ef9ef7e186 None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:47:58.121458 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-23f04c46-4f27-42d4-bde5-04ef9ef7e186 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:47:58.166372 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:47:58.230279 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 684/1362] 10.222.0.57 () {58 vars in 1024 bytes} [Fri Sep 16 07:47:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 16 07:47:58.523038 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871ac572-2b4f-4e69-8055-a73cef83e295 None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:47:58.524566 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-871ac572-2b4f-4e69-8055-a73cef83e295 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:47:58.690107 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871ac572-2b4f-4e69-8055-a73cef83e295 None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:47:58.701683 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:47:58.819718 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5199570-4499-463a-8666-fc5dc1fddc7d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bec4d9b08514461a1bf63c6b88f53b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4735f453c0c24cc4a1c14e9ac84a0b46', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:47:58.820724 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5199570-4499-463a-8666-fc5dc1fddc7d service nova] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:47:58.820724 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5199570-4499-463a-8666-fc5dc1fddc7d service nova] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:47:58.820724 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5199570-4499-463a-8666-fc5dc1fddc7d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:47:58.822762 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-a5199570-4499-463a-8666-fc5dc1fddc7d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:47:58.917231 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5199570-4499-463a-8666-fc5dc1fddc7d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:47:58.918810 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5199570-4499-463a-8666-fc5dc1fddc7d service nova] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:47:58.937876 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 679/1363] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Sep 16 07:47:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 07:48:01.545570 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2e3987-3a5d-43c2-bde4-0b9e64e87bce None None] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:48:01.546162 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2e3987-3a5d-43c2-bde4-0b9e64e87bce None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:48:01.546162 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2e3987-3a5d-43c2-bde4-0b9e64e87bce None None] PATH_INFO: `/` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:48:01.547479 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 685/1364] 10.222.0.57 () {54 vars in 927 bytes} [Fri Sep 16 07:48:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 07:48:01.552826 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea2735f-b15c-4c30-b96a-55650d3fbd59 None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:48:01.553328 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea2735f-b15c-4c30-b96a-55650d3fbd59 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:48:01.553622 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea2735f-b15c-4c30-b96a-55650d3fbd59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:48:01.569851 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:48:01.625437 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-fea2735f-b15c-4c30-b96a-55650d3fbd59 None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:48:01.626695 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-fea2735f-b15c-4c30-b96a-55650d3fbd59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:48:01.733765 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 680/1365] 10.222.0.57 () {58 vars in 1024 bytes} [Fri Sep 16 07:48:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 07:48:02.023162 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c6849c-0871-46a4-bd23-0d9714e73e24 None None] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:48:02.023585 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c6849c-0871-46a4-bd23-0d9714e73e24 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:48:02.023963 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c6849c-0871-46a4-bd23-0d9714e73e24 None None] PATH_INFO: `/` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:48:02.025575 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 686/1366] 10.222.0.57 () {54 vars in 962 bytes} [Fri Sep 16 07:48:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 07:48:02.030977 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd61c22-96a4-4018-a477-3eb468c4baae None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:48:02.031262 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd61c22-96a4-4018-a477-3eb468c4baae None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:48:02.031528 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd61c22-96a4-4018-a477-3eb468c4baae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:48:02.125549 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-9dd61c22-96a4-4018-a477-3eb468c4baae None None] MFA Rules not processed for user `9bec4d9b08514461a1bf63c6b88f53b2`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:48:02.126899 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-9dd61c22-96a4-4018-a477-3eb468c4baae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:48:02.164709 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:48:02.253113 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 681/1367] 10.222.0.57 () {58 vars in 1059 bytes} [Fri Sep 16 07:48:02 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 07:48:02.261327 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c6849c-0871-46a4-bd23-0d9714e73e24 None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:48:02.262839 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-72c6849c-0871-46a4-bd23-0d9714e73e24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:48:02.420455 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c6849c-0871-46a4-bd23-0d9714e73e24 None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:48:02.442115 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:48:02.542486 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c75196c-92bb-44ee-9254-58e5c78d076b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bec4d9b08514461a1bf63c6b88f53b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4735f453c0c24cc4a1c14e9ac84a0b46', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:48:02.543016 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c75196c-92bb-44ee-9254-58e5c78d076b service nova] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:48:02.543276 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c75196c-92bb-44ee-9254-58e5c78d076b service nova] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:48:02.543541 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c75196c-92bb-44ee-9254-58e5c78d076b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:48:02.545139 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-1c75196c-92bb-44ee-9254-58e5c78d076b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:48:02.645288 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c75196c-92bb-44ee-9254-58e5c78d076b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:48:02.647105 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c75196c-92bb-44ee-9254-58e5c78d076b service nova] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:48:02.667648 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 687/1368] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Sep 16 07:48:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 16 07:48:02.815264 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2935009f-b7ca-45d8-af8a-a1927f078c8f None None] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:48:02.815804 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2935009f-b7ca-45d8-af8a-a1927f078c8f None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:48:02.815804 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2935009f-b7ca-45d8-af8a-a1927f078c8f None None] PATH_INFO: `/` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:48:02.817302 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 682/1369] 10.222.0.57 () {54 vars in 927 bytes} [Fri Sep 16 07:48:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 07:48:02.823222 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37098e6-b6aa-46eb-9ae8-6c2238668675 None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:48:02.823553 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37098e6-b6aa-46eb-9ae8-6c2238668675 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:48:02.823784 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37098e6-b6aa-46eb-9ae8-6c2238668675 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:48:02.862734 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:48:02.907689 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-f37098e6-b6aa-46eb-9ae8-6c2238668675 None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:48:02.909149 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-f37098e6-b6aa-46eb-9ae8-6c2238668675 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:48:03.018662 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 688/1370] 10.222.0.57 () {58 vars in 1024 bytes} [Fri Sep 16 07:48:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 07:48:03.355366 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8bcdaf-5c59-4f3b-aa92-d6a8970a98df None None] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:48:03.355366 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8bcdaf-5c59-4f3b-aa92-d6a8970a98df None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:48:03.355366 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8bcdaf-5c59-4f3b-aa92-d6a8970a98df None None] PATH_INFO: `/` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:48:03.357062 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 683/1371] 10.222.0.57 () {54 vars in 964 bytes} [Fri Sep 16 07:48:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 07:48:03.361575 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ec4470-1be6-4b53-9c1b-1bb73c2f2dfa None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:48:03.361905 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ec4470-1be6-4b53-9c1b-1bb73c2f2dfa None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:48:03.362179 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ec4470-1be6-4b53-9c1b-1bb73c2f2dfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:48:03.445930 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-d7ec4470-1be6-4b53-9c1b-1bb73c2f2dfa None None] MFA Rules not processed for user `6544bf6be4c24454a013ca110c43cef2`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:48:03.447383 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-d7ec4470-1be6-4b53-9c1b-1bb73c2f2dfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:48:03.497917 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:48:03.531760 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 689/1372] 10.222.0.57 () {58 vars in 1061 bytes} [Fri Sep 16 07:48:03 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 07:48:03.540173 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8bcdaf-5c59-4f3b-aa92-d6a8970a98df None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:48:03.541811 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-8a8bcdaf-5c59-4f3b-aa92-d6a8970a98df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:48:03.659832 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8bcdaf-5c59-4f3b-aa92-d6a8970a98df None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:48:03.705369 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:48:03.746231 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1540d510-edc9-4487-b8fe-ccda21033d96 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544bf6be4c24454a013ca110c43cef2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4735f453c0c24cc4a1c14e9ac84a0b46', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:48:03.747156 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1540d510-edc9-4487-b8fe-ccda21033d96 service cinder] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:48:03.747612 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1540d510-edc9-4487-b8fe-ccda21033d96 service cinder] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:48:03.747965 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1540d510-edc9-4487-b8fe-ccda21033d96 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:48:03.749662 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-1540d510-edc9-4487-b8fe-ccda21033d96 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:48:03.884577 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1540d510-edc9-4487-b8fe-ccda21033d96 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:48:03.887983 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1540d510-edc9-4487-b8fe-ccda21033d96 service cinder] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:48:03.914034 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 684/1373] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Sep 16 07:48:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 16 07:48:04.926566 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ede4f6a-43c1-4958-9a25-3d9131a0132e None None] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:48:04.927096 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ede4f6a-43c1-4958-9a25-3d9131a0132e None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:48:04.927096 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ede4f6a-43c1-4958-9a25-3d9131a0132e None None] PATH_INFO: `/` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:48:04.928374 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 690/1374] 10.222.0.57 () {54 vars in 927 bytes} [Fri Sep 16 07:48:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 07:48:04.933744 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78c9043-ef53-4ecf-a4e8-c79830e5b658 None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:48:04.934158 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78c9043-ef53-4ecf-a4e8-c79830e5b658 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:48:04.934365 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78c9043-ef53-4ecf-a4e8-c79830e5b658 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:48:04.999602 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-e78c9043-ef53-4ecf-a4e8-c79830e5b658 None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:48:05.000802 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-e78c9043-ef53-4ecf-a4e8-c79830e5b658 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:48:05.021167 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:48:05.098041 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 685/1375] 10.222.0.57 () {58 vars in 1024 bytes} [Fri Sep 16 07:48:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 07:48:05.391634 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ede4f6a-43c1-4958-9a25-3d9131a0132e None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:48:05.393189 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-7ede4f6a-43c1-4958-9a25-3d9131a0132e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:48:05.550830 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ede4f6a-43c1-4958-9a25-3d9131a0132e None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:48:05.607826 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:48:05.672962 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbaebaec-a9a2-483c-9b7c-c368ff5574e2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bec4d9b08514461a1bf63c6b88f53b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4735f453c0c24cc4a1c14e9ac84a0b46', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:48:05.673680 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbaebaec-a9a2-483c-9b7c-c368ff5574e2 service nova] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:48:05.674025 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbaebaec-a9a2-483c-9b7c-c368ff5574e2 service nova] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:48:05.674298 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbaebaec-a9a2-483c-9b7c-c368ff5574e2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:48:05.675906 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-fbaebaec-a9a2-483c-9b7c-c368ff5574e2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:48:05.770355 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbaebaec-a9a2-483c-9b7c-c368ff5574e2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:48:05.772114 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbaebaec-a9a2-483c-9b7c-c368ff5574e2 service nova] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:48:05.791411 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 691/1376] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Sep 16 07:48:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 07:48:08.040834 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04802b80-b074-4770-a973-d677fd7cb312 None None] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:48:08.041392 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04802b80-b074-4770-a973-d677fd7cb312 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:48:08.041683 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04802b80-b074-4770-a973-d677fd7cb312 None None] PATH_INFO: `/` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:48:08.043358 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 686/1377] 10.222.0.57 () {54 vars in 927 bytes} [Fri Sep 16 07:48:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 07:48:08.048671 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a114be-a88b-49bd-a29e-8aa8081c593b None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:48:08.049122 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a114be-a88b-49bd-a29e-8aa8081c593b None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:48:08.049342 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a114be-a88b-49bd-a29e-8aa8081c593b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:48:08.122471 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-88a114be-a88b-49bd-a29e-8aa8081c593b None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:48:08.123908 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-88a114be-a88b-49bd-a29e-8aa8081c593b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:48:08.132613 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:48:08.245860 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 692/1378] 10.222.0.57 () {58 vars in 1024 bytes} [Fri Sep 16 07:48:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 16 07:48:08.532514 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04802b80-b074-4770-a973-d677fd7cb312 None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:48:08.534057 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-04802b80-b074-4770-a973-d677fd7cb312 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:48:08.687966 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04802b80-b074-4770-a973-d677fd7cb312 None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:48:08.692011 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:48:08.810205 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7245b52a-0265-401c-9ec9-d8a048a89e55 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bec4d9b08514461a1bf63c6b88f53b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4735f453c0c24cc4a1c14e9ac84a0b46', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:48:08.810730 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7245b52a-0265-401c-9ec9-d8a048a89e55 service nova] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:48:08.811004 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7245b52a-0265-401c-9ec9-d8a048a89e55 service nova] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:48:08.811276 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7245b52a-0265-401c-9ec9-d8a048a89e55 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:48:08.812858 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-7245b52a-0265-401c-9ec9-d8a048a89e55 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:48:08.909899 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7245b52a-0265-401c-9ec9-d8a048a89e55 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:48:08.911484 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7245b52a-0265-401c-9ec9-d8a048a89e55 service nova] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:48:08.931529 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 687/1379] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Sep 16 07:48:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 16 07:48:11.137004 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468bbeef-ecac-423e-bec2-d83ff56f811f None None] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:48:11.137519 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468bbeef-ecac-423e-bec2-d83ff56f811f None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:48:11.137626 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468bbeef-ecac-423e-bec2-d83ff56f811f None None] PATH_INFO: `/` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:48:11.141064 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 693/1380] 10.222.0.57 () {54 vars in 927 bytes} [Fri Sep 16 07:48:11 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 07:48:11.143994 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97507491-1682-4f4b-89bd-31fcda7ea1eb None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:48:11.144401 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97507491-1682-4f4b-89bd-31fcda7ea1eb None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:48:11.144527 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97507491-1682-4f4b-89bd-31fcda7ea1eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:48:11.156662 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:48:11.215766 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-97507491-1682-4f4b-89bd-31fcda7ea1eb None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:48:11.216998 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-97507491-1682-4f4b-89bd-31fcda7ea1eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:48:11.322278 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 688/1381] 10.222.0.57 () {58 vars in 1024 bytes} [Fri Sep 16 07:48:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 07:48:11.615448 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468bbeef-ecac-423e-bec2-d83ff56f811f None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:48:11.617226 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-468bbeef-ecac-423e-bec2-d83ff56f811f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:48:11.757705 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:48:11.769535 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468bbeef-ecac-423e-bec2-d83ff56f811f None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:48:11.888961 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94297c97-2aee-40e1-8adc-1e0df33a8926 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bec4d9b08514461a1bf63c6b88f53b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4735f453c0c24cc4a1c14e9ac84a0b46', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:48:11.889484 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94297c97-2aee-40e1-8adc-1e0df33a8926 service nova] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:48:11.889922 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94297c97-2aee-40e1-8adc-1e0df33a8926 service nova] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:48:11.890206 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94297c97-2aee-40e1-8adc-1e0df33a8926 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:48:11.891852 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-94297c97-2aee-40e1-8adc-1e0df33a8926 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:48:11.984472 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94297c97-2aee-40e1-8adc-1e0df33a8926 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:48:11.986106 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94297c97-2aee-40e1-8adc-1e0df33a8926 service nova] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:48:11.996445 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:48:12.006042 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 694/1382] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Sep 16 07:48:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 07:48:14.342856 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0a2096-12f9-43fe-a9fe-e935fb557e0e None None] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:48:14.343630 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0a2096-12f9-43fe-a9fe-e935fb557e0e None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:48:14.343630 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0a2096-12f9-43fe-a9fe-e935fb557e0e None None] PATH_INFO: `/` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:48:14.344744 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 689/1383] 10.222.0.57 () {54 vars in 927 bytes} [Fri Sep 16 07:48:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 07:48:14.350473 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb253f1a-90b3-410e-adca-e77e9c3e33b3 None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:48:14.350975 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb253f1a-90b3-410e-adca-e77e9c3e33b3 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:48:14.351186 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb253f1a-90b3-410e-adca-e77e9c3e33b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:48:14.432574 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-bb253f1a-90b3-410e-adca-e77e9c3e33b3 None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:48:14.433711 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-bb253f1a-90b3-410e-adca-e77e9c3e33b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:48:14.545758 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 695/1384] 10.222.0.57 () {58 vars in 1024 bytes} [Fri Sep 16 07:48:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 16 07:48:14.841139 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0a2096-12f9-43fe-a9fe-e935fb557e0e None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:48:14.842937 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-bc0a2096-12f9-43fe-a9fe-e935fb557e0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:48:14.934877 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:48:15.005316 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0a2096-12f9-43fe-a9fe-e935fb557e0e None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:48:15.138802 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ffb4e4-42d4-4fe3-8e3e-36798f4f2e6c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bec4d9b08514461a1bf63c6b88f53b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4735f453c0c24cc4a1c14e9ac84a0b46', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:48:15.139373 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ffb4e4-42d4-4fe3-8e3e-36798f4f2e6c service nova] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:48:15.139643 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ffb4e4-42d4-4fe3-8e3e-36798f4f2e6c service nova] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:48:15.139906 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ffb4e4-42d4-4fe3-8e3e-36798f4f2e6c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:48:15.141490 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-82ffb4e4-42d4-4fe3-8e3e-36798f4f2e6c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:48:15.193759 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:48:15.234893 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ffb4e4-42d4-4fe3-8e3e-36798f4f2e6c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:48:15.236473 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ffb4e4-42d4-4fe3-8e3e-36798f4f2e6c service nova] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:48:15.254867 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 690/1385] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Sep 16 07:48:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 07:48:17.459705 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95a62a4-ecaa-459b-acbf-7c779d7f4958 None None] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:48:17.460236 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95a62a4-ecaa-459b-acbf-7c779d7f4958 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:48:17.460236 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95a62a4-ecaa-459b-acbf-7c779d7f4958 None None] PATH_INFO: `/` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:48:17.461561 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 696/1386] 10.222.0.57 () {54 vars in 927 bytes} [Fri Sep 16 07:48:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 07:48:17.466813 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31578313-d492-4caf-931d-f9505bea4206 None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:48:17.467216 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31578313-d492-4caf-931d-f9505bea4206 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:48:17.467453 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31578313-d492-4caf-931d-f9505bea4206 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:48:17.549192 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-31578313-d492-4caf-931d-f9505bea4206 None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:48:17.550432 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-31578313-d492-4caf-931d-f9505bea4206 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:48:17.648108 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 691/1387] 10.222.0.57 () {58 vars in 1024 bytes} [Fri Sep 16 07:48:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 07:48:17.938280 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95a62a4-ecaa-459b-acbf-7c779d7f4958 None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:48:17.939817 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-d95a62a4-ecaa-459b-acbf-7c779d7f4958 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:48:18.017424 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:48:18.090572 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95a62a4-ecaa-459b-acbf-7c779d7f4958 None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:48:18.203102 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06b4ef8-741c-4567-8bd2-0203c8472040 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bec4d9b08514461a1bf63c6b88f53b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4735f453c0c24cc4a1c14e9ac84a0b46', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:48:18.203620 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06b4ef8-741c-4567-8bd2-0203c8472040 service nova] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:48:18.203894 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06b4ef8-741c-4567-8bd2-0203c8472040 service nova] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:48:18.204166 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06b4ef8-741c-4567-8bd2-0203c8472040 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:48:18.205781 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-f06b4ef8-741c-4567-8bd2-0203c8472040 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:48:18.245010 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:48:18.297318 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06b4ef8-741c-4567-8bd2-0203c8472040 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:48:18.298949 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06b4ef8-741c-4567-8bd2-0203c8472040 service nova] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:48:18.317588 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 697/1388] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Sep 16 07:48:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 07:48:19.326848 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b17164-7bbb-45c7-8191-f57fc2a0851a None None] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:48:19.327485 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b17164-7bbb-45c7-8191-f57fc2a0851a None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:48:19.327485 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b17164-7bbb-45c7-8191-f57fc2a0851a None None] PATH_INFO: `/` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:48:19.328789 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 692/1389] 10.222.0.57 () {54 vars in 927 bytes} [Fri Sep 16 07:48:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 07:48:19.334139 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02dfe09-8750-4b3b-880c-a02f119c8887 None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:48:19.335169 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02dfe09-8750-4b3b-880c-a02f119c8887 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:48:19.335370 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02dfe09-8750-4b3b-880c-a02f119c8887 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:48:19.402083 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-f02dfe09-8750-4b3b-880c-a02f119c8887 None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:48:19.403235 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-f02dfe09-8750-4b3b-880c-a02f119c8887 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:48:19.501816 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 698/1390] 10.222.0.57 () {58 vars in 1024 bytes} [Fri Sep 16 07:48:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 07:48:19.801620 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942ed2af-75ee-4aa9-a9b1-c2543bc9b25b None None] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:48:19.802008 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942ed2af-75ee-4aa9-a9b1-c2543bc9b25b None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:48:19.802350 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942ed2af-75ee-4aa9-a9b1-c2543bc9b25b None None] PATH_INFO: `/` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:48:19.804647 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 693/1391] 10.222.0.57 () {54 vars in 962 bytes} [Fri Sep 16 07:48:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 07:48:19.810047 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786a163e-cf34-4af5-a521-9be91e3636b3 None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:48:19.810331 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786a163e-cf34-4af5-a521-9be91e3636b3 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:48:19.810600 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786a163e-cf34-4af5-a521-9be91e3636b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:48:19.826488 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:48:19.897248 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-786a163e-cf34-4af5-a521-9be91e3636b3 None None] MFA Rules not processed for user `ceecb2c2fe9842e3b228848e00fd11ed`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:48:19.898509 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-786a163e-cf34-4af5-a521-9be91e3636b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:48:19.981564 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 699/1392] 10.222.0.57 () {58 vars in 1059 bytes} [Fri Sep 16 07:48:19 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 07:48:19.991366 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942ed2af-75ee-4aa9-a9b1-c2543bc9b25b None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:48:19.992885 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-942ed2af-75ee-4aa9-a9b1-c2543bc9b25b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:48:20.025297 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:48:20.106068 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942ed2af-75ee-4aa9-a9b1-c2543bc9b25b None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:48:20.183451 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac001b2b-f37b-4d6c-bebf-4968a44d9568 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceecb2c2fe9842e3b228848e00fd11ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4735f453c0c24cc4a1c14e9ac84a0b46', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:48:20.184065 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac001b2b-f37b-4d6c-bebf-4968a44d9568 service glance] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:48:20.184344 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac001b2b-f37b-4d6c-bebf-4968a44d9568 service glance] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:48:20.184617 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac001b2b-f37b-4d6c-bebf-4968a44d9568 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:48:20.186242 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-ac001b2b-f37b-4d6c-bebf-4968a44d9568 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:48:20.267449 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:48:20.301357 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac001b2b-f37b-4d6c-bebf-4968a44d9568 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:48:20.302742 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac001b2b-f37b-4d6c-bebf-4968a44d9568 service glance] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:48:20.320721 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 694/1393] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Sep 16 07:48:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 07:48:20.526354 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c949523-017d-4be9-97bb-ea0b247c1711 None None] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:48:20.526909 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c949523-017d-4be9-97bb-ea0b247c1711 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:48:20.526909 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c949523-017d-4be9-97bb-ea0b247c1711 None None] PATH_INFO: `/` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:48:20.528295 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 700/1394] 10.222.0.57 () {54 vars in 927 bytes} [Fri Sep 16 07:48:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 07:48:20.534421 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1841942c-585e-4ee2-87b3-339fa9ecb4cc None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:48:20.534959 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1841942c-585e-4ee2-87b3-339fa9ecb4cc None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:48:20.535084 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1841942c-585e-4ee2-87b3-339fa9ecb4cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:48:20.608984 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-1841942c-585e-4ee2-87b3-339fa9ecb4cc None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:48:20.610245 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-1841942c-585e-4ee2-87b3-339fa9ecb4cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:48:20.712181 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 695/1395] 10.222.0.57 () {58 vars in 1024 bytes} [Fri Sep 16 07:48:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 07:48:21.007386 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c949523-017d-4be9-97bb-ea0b247c1711 None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:48:21.008928 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-4c949523-017d-4be9-97bb-ea0b247c1711 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:48:21.081794 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9fbf71-830d-4dee-883d-7127261cbead None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:48:21.081794 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9fbf71-830d-4dee-883d-7127261cbead None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:48:21.081794 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9fbf71-830d-4dee-883d-7127261cbead None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:48:21.117901 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:48:21.133913 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:48:21.156467 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-ad9fbf71-830d-4dee-883d-7127261cbead None None] MFA Rules not processed for user `56eb9bbabb65436bb095952159df184c`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:48:21.157671 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-ad9fbf71-830d-4dee-883d-7127261cbead None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:48:21.166118 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c949523-017d-4be9-97bb-ea0b247c1711 None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:48:21.246549 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 696/1396] 10.222.0.57 () {58 vars in 1009 bytes} [Fri Sep 16 07:48:21 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 16 07:48:21.281846 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353627a2-26ce-4e4c-a983-3bf690d1c6f4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bec4d9b08514461a1bf63c6b88f53b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4735f453c0c24cc4a1c14e9ac84a0b46', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:48:21.282458 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353627a2-26ce-4e4c-a983-3bf690d1c6f4 service nova] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:48:21.282738 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353627a2-26ce-4e4c-a983-3bf690d1c6f4 service nova] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:48:21.283011 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353627a2-26ce-4e4c-a983-3bf690d1c6f4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:48:21.284629 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-353627a2-26ce-4e4c-a983-3bf690d1c6f4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:48:21.290830 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c5d69c-575b-4356-9a81-ff20b9e2e5f2 None None] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:48:21.291117 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c5d69c-575b-4356-9a81-ff20b9e2e5f2 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:48:21.291413 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c5d69c-575b-4356-9a81-ff20b9e2e5f2 None None] PATH_INFO: `/` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:48:21.292760 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 697/1397] 10.222.0.57 () {54 vars in 943 bytes} [Fri Sep 16 07:48:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 16 07:48:21.299876 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f06fcd-6cf0-4649-a735-eab4bf6a1cc9 None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:48:21.300220 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f06fcd-6cf0-4649-a735-eab4bf6a1cc9 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:48:21.300558 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f06fcd-6cf0-4649-a735-eab4bf6a1cc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:48:21.358059 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:48:21.378485 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353627a2-26ce-4e4c-a983-3bf690d1c6f4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:48:21.379277 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-70f06fcd-6cf0-4649-a735-eab4bf6a1cc9 None None] MFA Rules not processed for user `38abb0283b41449d8183b88912f2574a`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:48:21.380066 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353627a2-26ce-4e4c-a983-3bf690d1c6f4 service nova] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:48:21.380590 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-70f06fcd-6cf0-4649-a735-eab4bf6a1cc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:48:21.398977 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 701/1398] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Sep 16 07:48:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 07:48:21.447120 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:48:21.498442 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 698/1399] 10.222.0.57 () {58 vars in 1040 bytes} [Fri Sep 16 07:48:21 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 16 07:48:21.509044 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353627a2-26ce-4e4c-a983-3bf690d1c6f4 service nova] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:48:21.510308 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-353627a2-26ce-4e4c-a983-3bf690d1c6f4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:48:21.611522 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353627a2-26ce-4e4c-a983-3bf690d1c6f4 service nova] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:48:21.720186 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:48:21.722305 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c6ed6c-c1dc-4d5e-b92a-d51fae892f74 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38abb0283b41449d8183b88912f2574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4735f453c0c24cc4a1c14e9ac84a0b46', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:48:21.723135 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c6ed6c-c1dc-4d5e-b92a-d51fae892f74 service swift] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:48:21.723579 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c6ed6c-c1dc-4d5e-b92a-d51fae892f74 service swift] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:48:21.724018 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c6ed6c-c1dc-4d5e-b92a-d51fae892f74 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:48:21.726298 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-f0c6ed6c-c1dc-4d5e-b92a-d51fae892f74 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:48:21.813180 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c6ed6c-c1dc-4d5e-b92a-d51fae892f74 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:48:21.817802 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c6ed6c-c1dc-4d5e-b92a-d51fae892f74 service swift] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:48:21.830567 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 702/1400] 10.222.0.57 () {60 vars in 1384 bytes} [Fri Sep 16 07:48:21 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 16 07:48:23.647243 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edea942-8039-43d9-a804-36678c5c04d9 None None] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:48:23.647941 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edea942-8039-43d9-a804-36678c5c04d9 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:48:23.647941 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edea942-8039-43d9-a804-36678c5c04d9 None None] PATH_INFO: `/` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:48:23.649112 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 699/1401] 10.222.0.57 () {54 vars in 927 bytes} [Fri Sep 16 07:48:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 07:48:23.654345 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cbef9e-b9cf-42e8-8353-bf4c6fc5d47f None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:48:23.655176 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cbef9e-b9cf-42e8-8353-bf4c6fc5d47f None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:48:23.655672 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cbef9e-b9cf-42e8-8353-bf4c6fc5d47f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:48:23.726715 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-68cbef9e-b9cf-42e8-8353-bf4c6fc5d47f None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:48:23.728291 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-68cbef9e-b9cf-42e8-8353-bf4c6fc5d47f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:48:23.833035 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:48:23.841957 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 703/1402] 10.222.0.57 () {58 vars in 1024 bytes} [Fri Sep 16 07:48:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 07:48:24.130856 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edea942-8039-43d9-a804-36678c5c04d9 None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:48:24.132935 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-3edea942-8039-43d9-a804-36678c5c04d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:48:24.302426 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edea942-8039-43d9-a804-36678c5c04d9 None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:48:24.347562 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:48:24.429133 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce150478-3d9c-47ad-96cd-579372ed1e18 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bec4d9b08514461a1bf63c6b88f53b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4735f453c0c24cc4a1c14e9ac84a0b46', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:48:24.429646 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce150478-3d9c-47ad-96cd-579372ed1e18 service nova] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:48:24.429945 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce150478-3d9c-47ad-96cd-579372ed1e18 service nova] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:48:24.430212 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce150478-3d9c-47ad-96cd-579372ed1e18 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:48:24.431835 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-ce150478-3d9c-47ad-96cd-579372ed1e18 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:48:24.534312 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce150478-3d9c-47ad-96cd-579372ed1e18 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:48:24.535978 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce150478-3d9c-47ad-96cd-579372ed1e18 service nova] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:48:24.556754 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 700/1403] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Sep 16 07:48:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 07:48:26.817929 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b670f1a1-85a4-4896-ae98-af07adc125c1 None None] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:48:26.817929 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b670f1a1-85a4-4896-ae98-af07adc125c1 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:48:26.817929 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b670f1a1-85a4-4896-ae98-af07adc125c1 None None] PATH_INFO: `/` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:48:26.817929 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 704/1404] 10.222.0.57 () {54 vars in 927 bytes} [Fri Sep 16 07:48:26 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 07:48:26.820257 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6489ab-2fea-4513-9229-365cfe7d7ff8 None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:48:26.820658 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6489ab-2fea-4513-9229-365cfe7d7ff8 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:48:26.820792 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6489ab-2fea-4513-9229-365cfe7d7ff8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:48:26.911880 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:48:26.925750 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-6f6489ab-2fea-4513-9229-365cfe7d7ff8 None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:48:26.930991 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-6f6489ab-2fea-4513-9229-365cfe7d7ff8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:48:27.069794 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 701/1405] 10.222.0.57 () {58 vars in 1024 bytes} [Fri Sep 16 07:48:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 07:48:27.354536 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b670f1a1-85a4-4896-ae98-af07adc125c1 None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:48:27.356130 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-b670f1a1-85a4-4896-ae98-af07adc125c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:48:27.524912 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b670f1a1-85a4-4896-ae98-af07adc125c1 None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:48:27.600816 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:48:27.653265 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20e9a7d-0911-485b-adfb-2fec531e07b5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bec4d9b08514461a1bf63c6b88f53b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4735f453c0c24cc4a1c14e9ac84a0b46', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:48:27.653922 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20e9a7d-0911-485b-adfb-2fec531e07b5 service nova] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:48:27.654198 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20e9a7d-0911-485b-adfb-2fec531e07b5 service nova] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:48:27.654465 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20e9a7d-0911-485b-adfb-2fec531e07b5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:48:27.656084 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-c20e9a7d-0911-485b-adfb-2fec531e07b5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:48:27.756786 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20e9a7d-0911-485b-adfb-2fec531e07b5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:48:27.758541 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20e9a7d-0911-485b-adfb-2fec531e07b5 service nova] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:48:27.782872 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 705/1406] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Sep 16 07:48:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 427 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 07:48:30.071072 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1102e7-94c3-4604-9e71-182470e18b31 None None] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:48:30.072284 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1102e7-94c3-4604-9e71-182470e18b31 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:48:30.072644 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1102e7-94c3-4604-9e71-182470e18b31 None None] PATH_INFO: `/` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:48:30.074611 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 702/1407] 10.222.0.57 () {54 vars in 927 bytes} [Fri Sep 16 07:48:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 07:48:30.083018 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6384c492-6c72-479b-82e0-23b0dfa46977 None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:48:30.083018 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6384c492-6c72-479b-82e0-23b0dfa46977 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:48:30.083018 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6384c492-6c72-479b-82e0-23b0dfa46977 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:48:30.154375 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-6384c492-6c72-479b-82e0-23b0dfa46977 None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:48:30.155897 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-6384c492-6c72-479b-82e0-23b0dfa46977 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:48:30.189927 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:48:30.266753 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 706/1408] 10.222.0.57 () {58 vars in 1024 bytes} [Fri Sep 16 07:48:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 07:48:30.567965 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1102e7-94c3-4604-9e71-182470e18b31 None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:48:30.569579 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-6d1102e7-94c3-4604-9e71-182470e18b31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:48:30.710252 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:48:30.741907 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1102e7-94c3-4604-9e71-182470e18b31 None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:48:30.868668 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8ce063-b934-41fd-a031-9048dfafa5de service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bec4d9b08514461a1bf63c6b88f53b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4735f453c0c24cc4a1c14e9ac84a0b46', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:48:30.869474 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8ce063-b934-41fd-a031-9048dfafa5de service nova] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:48:30.869804 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8ce063-b934-41fd-a031-9048dfafa5de service nova] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:48:30.870340 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8ce063-b934-41fd-a031-9048dfafa5de service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:48:30.871947 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-fb8ce063-b934-41fd-a031-9048dfafa5de service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:48:30.970357 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:48:30.976900 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8ce063-b934-41fd-a031-9048dfafa5de service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:48:30.978908 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8ce063-b934-41fd-a031-9048dfafa5de service nova] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:48:30.998714 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 703/1409] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Sep 16 07:48:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 434 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 07:48:40.265037 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=30 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:48:40.996300 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=7 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:48:44.571043 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065d0c1b-517b-4b05-bf3e-5d22e89ca149 None None] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:48:44.571583 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065d0c1b-517b-4b05-bf3e-5d22e89ca149 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:48:44.571583 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065d0c1b-517b-4b05-bf3e-5d22e89ca149 None None] PATH_INFO: `/` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:48:44.572903 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 707/1410] 10.222.0.57 () {54 vars in 918 bytes} [Fri Sep 16 07:48:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 07:48:44.578172 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e147844e-11be-4c55-80c1-718bc475a1fb None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:48:44.578590 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e147844e-11be-4c55-80c1-718bc475a1fb None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:48:44.578705 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e147844e-11be-4c55-80c1-718bc475a1fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:48:44.654524 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-e147844e-11be-4c55-80c1-718bc475a1fb None None] MFA Rules not processed for user `c7d4ccdd6ef9400ba9e344df0964da1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:48:44.655755 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-e147844e-11be-4c55-80c1-718bc475a1fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:48:44.763709 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 704/1411] 10.222.0.57 () {58 vars in 1015 bytes} [Fri Sep 16 07:48:44 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 07:48:44.779237 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71045101-3284-4519-803b-e451c00281b9 None None] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:48:44.779530 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71045101-3284-4519-803b-e451c00281b9 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:48:44.779812 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71045101-3284-4519-803b-e451c00281b9 None None] PATH_INFO: `/` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:48:44.781125 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 708/1412] 10.222.0.57 () {54 vars in 918 bytes} [Fri Sep 16 07:48:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 16 07:48:44.785904 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8cd327-ee2e-4a23-b99a-dbfc70d12b39 None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:48:44.786194 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8cd327-ee2e-4a23-b99a-dbfc70d12b39 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:48:44.786491 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8cd327-ee2e-4a23-b99a-dbfc70d12b39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:48:44.859141 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:48:44.861996 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-5a8cd327-ee2e-4a23-b99a-dbfc70d12b39 None None] MFA Rules not processed for user `9bec4d9b08514461a1bf63c6b88f53b2`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:48:44.863822 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-5a8cd327-ee2e-4a23-b99a-dbfc70d12b39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:48:44.977355 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 705/1413] 10.222.0.57 () {58 vars in 1015 bytes} [Fri Sep 16 07:48:44 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 07:48:47.555820 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fedfc3-4c1a-4e9c-8aa3-d2eeee76eca4 None None] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:48:47.556323 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fedfc3-4c1a-4e9c-8aa3-d2eeee76eca4 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:48:47.556323 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fedfc3-4c1a-4e9c-8aa3-d2eeee76eca4 None None] PATH_INFO: `/` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:48:47.557597 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 709/1414] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 16 07:48:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 07:48:47.563065 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eda08f4-e37e-475c-8287-169846953e29 None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:48:47.563491 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eda08f4-e37e-475c-8287-169846953e29 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:48:47.563620 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eda08f4-e37e-475c-8287-169846953e29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:48:47.630314 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-1eda08f4-e37e-475c-8287-169846953e29 None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:48:47.631535 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-1eda08f4-e37e-475c-8287-169846953e29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:48:47.687874 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:48:47.731181 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 706/1415] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 16 07:48:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 07:48:48.023339 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fedfc3-4c1a-4e9c-8aa3-d2eeee76eca4 None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:48:48.025013 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-05fedfc3-4c1a-4e9c-8aa3-d2eeee76eca4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:48:48.172671 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fedfc3-4c1a-4e9c-8aa3-d2eeee76eca4 None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:48:48.247381 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:48:48.287529 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb93506-0dbe-45d9-8c56-4fc53d055aa1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bec4d9b08514461a1bf63c6b88f53b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4735f453c0c24cc4a1c14e9ac84a0b46', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:48:48.288059 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb93506-0dbe-45d9-8c56-4fc53d055aa1 service nova] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:48:48.288333 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb93506-0dbe-45d9-8c56-4fc53d055aa1 service nova] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:48:48.288631 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb93506-0dbe-45d9-8c56-4fc53d055aa1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:48:48.290241 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-4eb93506-0dbe-45d9-8c56-4fc53d055aa1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:48:48.376960 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb93506-0dbe-45d9-8c56-4fc53d055aa1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:48:48.378804 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb93506-0dbe-45d9-8c56-4fc53d055aa1 service nova] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:48:48.402010 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 710/1416] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Sep 16 07:48:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 16 07:48:49.528442 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ea9cac-9180-4555-b6ca-73e03660caf5 None None] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:48:49.528975 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ea9cac-9180-4555-b6ca-73e03660caf5 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:48:49.528975 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ea9cac-9180-4555-b6ca-73e03660caf5 None None] PATH_INFO: `/` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:48:49.530316 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 707/1417] 127.0.0.1 () {54 vars in 901 bytes} [Fri Sep 16 07:48:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 07:48:49.536322 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5d57b8-be16-43d1-9c49-31bf376c2b1f None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:48:49.536738 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5d57b8-be16-43d1-9c49-31bf376c2b1f None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:48:49.536880 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5d57b8-be16-43d1-9c49-31bf376c2b1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:48:49.612714 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-3f5d57b8-be16-43d1-9c49-31bf376c2b1f None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:48:49.613960 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-3f5d57b8-be16-43d1-9c49-31bf376c2b1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:48:49.640682 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:48:49.710127 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 711/1418] 127.0.0.1 () {58 vars in 998 bytes} [Fri Sep 16 07:48:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 07:48:49.859558 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ea9cac-9180-4555-b6ca-73e03660caf5 None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:48:49.861064 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-20ea9cac-9180-4555-b6ca-73e03660caf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:48:50.005290 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ea9cac-9180-4555-b6ca-73e03660caf5 None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:48:50.046130 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:48:50.119810 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af11e8c-181f-4f58-8fc4-70eb09a506cc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bec4d9b08514461a1bf63c6b88f53b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4735f453c0c24cc4a1c14e9ac84a0b46', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:48:50.120356 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af11e8c-181f-4f58-8fc4-70eb09a506cc service nova] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:48:50.120892 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af11e8c-181f-4f58-8fc4-70eb09a506cc service nova] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:48:50.121161 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af11e8c-181f-4f58-8fc4-70eb09a506cc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:48:50.122794 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-4af11e8c-181f-4f58-8fc4-70eb09a506cc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:48:50.212077 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af11e8c-181f-4f58-8fc4-70eb09a506cc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:48:50.213652 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af11e8c-181f-4f58-8fc4-70eb09a506cc service nova] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:48:50.231497 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 708/1419] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Sep 16 07:48:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 07:48:51.365445 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f4b0f7-3add-4dcd-8a92-6ecce88ff539 None None] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:48:51.366012 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f4b0f7-3add-4dcd-8a92-6ecce88ff539 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:48:51.366012 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f4b0f7-3add-4dcd-8a92-6ecce88ff539 None None] PATH_INFO: `/` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:48:51.367451 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 712/1420] 127.0.0.1 () {54 vars in 901 bytes} [Fri Sep 16 07:48:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 07:48:51.373801 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53eb1f61-20b5-4211-87e7-c56b8c9d846f None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:48:51.374265 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53eb1f61-20b5-4211-87e7-c56b8c9d846f None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:48:51.374372 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53eb1f61-20b5-4211-87e7-c56b8c9d846f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:48:51.427884 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:48:51.450744 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-53eb1f61-20b5-4211-87e7-c56b8c9d846f None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:48:51.451949 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-53eb1f61-20b5-4211-87e7-c56b8c9d846f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:48:51.548482 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 709/1421] 127.0.0.1 () {58 vars in 998 bytes} [Fri Sep 16 07:48:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 07:48:51.701504 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f4b0f7-3add-4dcd-8a92-6ecce88ff539 None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:48:51.703006 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-e3f4b0f7-3add-4dcd-8a92-6ecce88ff539 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:48:51.847056 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f4b0f7-3add-4dcd-8a92-6ecce88ff539 None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:48:51.859138 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:48:51.960547 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0d7d58-ef89-40f9-acef-dd2b01a0d850 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bec4d9b08514461a1bf63c6b88f53b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4735f453c0c24cc4a1c14e9ac84a0b46', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:48:51.961097 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0d7d58-ef89-40f9-acef-dd2b01a0d850 service nova] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:48:51.961372 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0d7d58-ef89-40f9-acef-dd2b01a0d850 service nova] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:48:51.961639 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0d7d58-ef89-40f9-acef-dd2b01a0d850 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:48:51.963270 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-8e0d7d58-ef89-40f9-acef-dd2b01a0d850 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:48:52.052039 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0d7d58-ef89-40f9-acef-dd2b01a0d850 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:48:52.053625 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0d7d58-ef89-40f9-acef-dd2b01a0d850 service nova] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:48:52.071909 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 713/1422] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Sep 16 07:48:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 07:48:53.215191 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f49f15b-5ecc-4857-8862-929207f90e16 None None] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:48:53.215767 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f49f15b-5ecc-4857-8862-929207f90e16 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:48:53.215982 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f49f15b-5ecc-4857-8862-929207f90e16 None None] PATH_INFO: `/` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:48:53.218052 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 710/1423] 127.0.0.1 () {54 vars in 901 bytes} [Fri Sep 16 07:48:53 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 07:48:53.224448 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b36103-5c4d-4c14-bcc7-f9fc0f0f3524 None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:48:53.224896 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b36103-5c4d-4c14-bcc7-f9fc0f0f3524 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:48:53.225026 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b36103-5c4d-4c14-bcc7-f9fc0f0f3524 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:48:53.247240 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:48:53.304321 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-89b36103-5c4d-4c14-bcc7-f9fc0f0f3524 None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:48:53.305533 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-89b36103-5c4d-4c14-bcc7-f9fc0f0f3524 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:48:53.401060 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 714/1424] 127.0.0.1 () {58 vars in 998 bytes} [Fri Sep 16 07:48:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 07:48:53.551329 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f49f15b-5ecc-4857-8862-929207f90e16 None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:48:53.552868 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-7f49f15b-5ecc-4857-8862-929207f90e16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:48:53.663940 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:48:53.699513 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f49f15b-5ecc-4857-8862-929207f90e16 None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:48:53.812687 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040bf9bc-1285-4866-a2e9-89af00645d27 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bec4d9b08514461a1bf63c6b88f53b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4735f453c0c24cc4a1c14e9ac84a0b46', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:48:53.813293 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040bf9bc-1285-4866-a2e9-89af00645d27 service nova] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:48:53.813569 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040bf9bc-1285-4866-a2e9-89af00645d27 service nova] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:48:53.813883 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040bf9bc-1285-4866-a2e9-89af00645d27 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:48:53.815482 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-040bf9bc-1285-4866-a2e9-89af00645d27 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:48:53.891805 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:48:53.906189 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040bf9bc-1285-4866-a2e9-89af00645d27 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:48:53.907764 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040bf9bc-1285-4866-a2e9-89af00645d27 service nova] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:48:53.925912 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 711/1425] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Sep 16 07:48:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 07:48:55.042904 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4e628f-8d04-4b86-9b3e-f905b24ab45f None None] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:48:55.043444 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4e628f-8d04-4b86-9b3e-f905b24ab45f None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:48:55.043444 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4e628f-8d04-4b86-9b3e-f905b24ab45f None None] PATH_INFO: `/` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:48:55.044720 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 715/1426] 127.0.0.1 () {54 vars in 901 bytes} [Fri Sep 16 07:48:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 07:48:55.051182 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a05c468-7930-4911-adcf-57d3efcb1b6a None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:48:55.051619 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a05c468-7930-4911-adcf-57d3efcb1b6a None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:48:55.051724 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a05c468-7930-4911-adcf-57d3efcb1b6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:48:55.130303 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-9a05c468-7930-4911-adcf-57d3efcb1b6a None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:48:55.131533 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-9a05c468-7930-4911-adcf-57d3efcb1b6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:48:55.228214 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 712/1427] 127.0.0.1 () {58 vars in 998 bytes} [Fri Sep 16 07:48:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 07:48:55.381134 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4e628f-8d04-4b86-9b3e-f905b24ab45f None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:48:55.383304 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-eb4e628f-8d04-4b86-9b3e-f905b24ab45f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:48:55.466904 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:48:55.529178 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4e628f-8d04-4b86-9b3e-f905b24ab45f None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:48:55.639026 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5031e34b-b557-47ec-90f2-21132d0f95c8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bec4d9b08514461a1bf63c6b88f53b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4735f453c0c24cc4a1c14e9ac84a0b46', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:48:55.639555 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5031e34b-b557-47ec-90f2-21132d0f95c8 service nova] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:48:55.639834 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5031e34b-b557-47ec-90f2-21132d0f95c8 service nova] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:48:55.640107 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5031e34b-b557-47ec-90f2-21132d0f95c8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:48:55.641707 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-5031e34b-b557-47ec-90f2-21132d0f95c8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:48:55.689939 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:48:55.731375 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5031e34b-b557-47ec-90f2-21132d0f95c8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:48:55.732960 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5031e34b-b557-47ec-90f2-21132d0f95c8 service nova] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:48:55.750600 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 716/1428] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Sep 16 07:48:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 07:48:56.821143 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2936f0-8b22-4e0a-b172-32d75352981f None None] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:48:56.821714 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2936f0-8b22-4e0a-b172-32d75352981f None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:48:56.821714 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2936f0-8b22-4e0a-b172-32d75352981f None None] PATH_INFO: `/` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:48:56.823051 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 713/1429] 127.0.0.1 () {54 vars in 901 bytes} [Fri Sep 16 07:48:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 07:48:56.829401 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fc652b-5c89-418b-ab69-3385d2875918 None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:48:56.829848 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fc652b-5c89-418b-ab69-3385d2875918 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:48:56.829989 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fc652b-5c89-418b-ab69-3385d2875918 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:48:56.909572 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-14fc652b-5c89-418b-ab69-3385d2875918 None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:48:56.910813 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-14fc652b-5c89-418b-ab69-3385d2875918 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:48:57.024395 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 717/1430] 127.0.0.1 () {58 vars in 998 bytes} [Fri Sep 16 07:48:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 16 07:48:57.175757 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2936f0-8b22-4e0a-b172-32d75352981f None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:48:57.177279 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-7c2936f0-8b22-4e0a-b172-32d75352981f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:48:57.227671 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:48:57.328852 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2936f0-8b22-4e0a-b172-32d75352981f None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:48:57.442623 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b795012-bd43-4ec8-8dd2-117363a00434 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bec4d9b08514461a1bf63c6b88f53b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4735f453c0c24cc4a1c14e9ac84a0b46', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:48:57.443227 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b795012-bd43-4ec8-8dd2-117363a00434 service nova] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:48:57.443505 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b795012-bd43-4ec8-8dd2-117363a00434 service nova] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:48:57.443774 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b795012-bd43-4ec8-8dd2-117363a00434 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:48:57.445409 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-0b795012-bd43-4ec8-8dd2-117363a00434 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:48:57.452297 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:48:57.534789 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b795012-bd43-4ec8-8dd2-117363a00434 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:48:57.536382 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b795012-bd43-4ec8-8dd2-117363a00434 service nova] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:48:57.555201 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 714/1431] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Sep 16 07:48:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 07:48:58.598666 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a06bbc-0639-4c99-8eb3-380e87dd8d98 None None] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:48:58.599220 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a06bbc-0639-4c99-8eb3-380e87dd8d98 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:48:58.599220 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a06bbc-0639-4c99-8eb3-380e87dd8d98 None None] PATH_INFO: `/` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:48:58.600470 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 718/1432] 127.0.0.1 () {54 vars in 901 bytes} [Fri Sep 16 07:48:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 07:48:58.606861 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42526f20-422e-40dc-bff8-2f2a78ec98d4 None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:48:58.607286 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42526f20-422e-40dc-bff8-2f2a78ec98d4 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:48:58.607437 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42526f20-422e-40dc-bff8-2f2a78ec98d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:48:58.687577 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-42526f20-422e-40dc-bff8-2f2a78ec98d4 None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:48:58.688816 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-42526f20-422e-40dc-bff8-2f2a78ec98d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:48:58.755740 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:48:58.784878 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 715/1433] 127.0.0.1 () {58 vars in 998 bytes} [Fri Sep 16 07:48:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 16 07:48:58.936408 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a06bbc-0639-4c99-8eb3-380e87dd8d98 None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:48:58.938037 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-a7a06bbc-0639-4c99-8eb3-380e87dd8d98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:48:58.955384 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:48:59.084477 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a06bbc-0639-4c99-8eb3-380e87dd8d98 None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:48:59.173395 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:48:59.198703 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae7637d-3d06-40bb-9ef9-2f3e9851dad3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bec4d9b08514461a1bf63c6b88f53b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4735f453c0c24cc4a1c14e9ac84a0b46', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:48:59.199239 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae7637d-3d06-40bb-9ef9-2f3e9851dad3 service nova] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:48:59.199512 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae7637d-3d06-40bb-9ef9-2f3e9851dad3 service nova] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:48:59.199776 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae7637d-3d06-40bb-9ef9-2f3e9851dad3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:48:59.201366 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-cae7637d-3d06-40bb-9ef9-2f3e9851dad3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:48:59.324243 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae7637d-3d06-40bb-9ef9-2f3e9851dad3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:48:59.325874 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae7637d-3d06-40bb-9ef9-2f3e9851dad3 service nova] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:48:59.343933 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 719/1434] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Sep 16 07:48:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 07:49:00.472912 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ee9f84-cfb3-4c2d-93f8-2ce140cbdb89 None None] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:49:00.473469 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ee9f84-cfb3-4c2d-93f8-2ce140cbdb89 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:49:00.473469 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ee9f84-cfb3-4c2d-93f8-2ce140cbdb89 None None] PATH_INFO: `/` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:49:00.474728 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 716/1435] 127.0.0.1 () {54 vars in 901 bytes} [Fri Sep 16 07:49:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 07:49:00.481497 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a17c26-40f9-4818-8f37-6f2fac97b21c None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:49:00.482003 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a17c26-40f9-4818-8f37-6f2fac97b21c None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:49:00.482098 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a17c26-40f9-4818-8f37-6f2fac97b21c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:49:00.576755 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-a1a17c26-40f9-4818-8f37-6f2fac97b21c None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:49:00.578016 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-a1a17c26-40f9-4818-8f37-6f2fac97b21c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:49:00.622415 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:49:00.682312 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 720/1436] 127.0.0.1 () {58 vars in 998 bytes} [Fri Sep 16 07:49:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 07:49:00.842542 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ee9f84-cfb3-4c2d-93f8-2ce140cbdb89 None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:49:00.843988 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-f5ee9f84-cfb3-4c2d-93f8-2ce140cbdb89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:49:00.989585 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ee9f84-cfb3-4c2d-93f8-2ce140cbdb89 None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:49:01.051859 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:49:01.114088 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9769f698-e63e-4e8f-a26e-05c419ef33ba service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bec4d9b08514461a1bf63c6b88f53b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4735f453c0c24cc4a1c14e9ac84a0b46', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:49:01.114701 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9769f698-e63e-4e8f-a26e-05c419ef33ba service nova] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:49:01.114980 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9769f698-e63e-4e8f-a26e-05c419ef33ba service nova] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:49:01.115250 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9769f698-e63e-4e8f-a26e-05c419ef33ba service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:49:01.117506 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-9769f698-e63e-4e8f-a26e-05c419ef33ba service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:49:01.207959 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9769f698-e63e-4e8f-a26e-05c419ef33ba service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:49:01.209551 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9769f698-e63e-4e8f-a26e-05c419ef33ba service nova] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:49:01.227850 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 717/1437] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Sep 16 07:49:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 07:49:02.280839 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55c5618-db2f-46ab-9ae4-89e2e9f22a6a None None] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:49:02.281411 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55c5618-db2f-46ab-9ae4-89e2e9f22a6a None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:49:02.281411 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55c5618-db2f-46ab-9ae4-89e2e9f22a6a None None] PATH_INFO: `/` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:49:02.282779 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 721/1438] 127.0.0.1 () {54 vars in 901 bytes} [Fri Sep 16 07:49:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 07:49:02.289138 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca8c8a1-27c6-4bb8-a3c4-2d11c5044bf9 None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:49:02.289604 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca8c8a1-27c6-4bb8-a3c4-2d11c5044bf9 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:49:02.289702 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca8c8a1-27c6-4bb8-a3c4-2d11c5044bf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:49:02.365345 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-dca8c8a1-27c6-4bb8-a3c4-2d11c5044bf9 None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:49:02.367217 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-dca8c8a1-27c6-4bb8-a3c4-2d11c5044bf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:49:02.369677 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:49:02.465378 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 718/1439] 127.0.0.1 () {58 vars in 998 bytes} [Fri Sep 16 07:49:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 07:49:02.620445 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55c5618-db2f-46ab-9ae4-89e2e9f22a6a None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:49:02.622174 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-d55c5618-db2f-46ab-9ae4-89e2e9f22a6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:49:02.766980 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55c5618-db2f-46ab-9ae4-89e2e9f22a6a None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:49:02.796232 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:49:02.883902 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01707aa8-76bf-465d-a3f8-403ef39fe8e8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bec4d9b08514461a1bf63c6b88f53b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4735f453c0c24cc4a1c14e9ac84a0b46', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:49:02.884422 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01707aa8-76bf-465d-a3f8-403ef39fe8e8 service nova] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:49:02.884696 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01707aa8-76bf-465d-a3f8-403ef39fe8e8 service nova] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:49:02.884963 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01707aa8-76bf-465d-a3f8-403ef39fe8e8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:49:02.886594 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-01707aa8-76bf-465d-a3f8-403ef39fe8e8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:49:02.974825 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01707aa8-76bf-465d-a3f8-403ef39fe8e8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:49:02.976444 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01707aa8-76bf-465d-a3f8-403ef39fe8e8 service nova] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:49:02.994725 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 722/1440] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Sep 16 07:49:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 07:49:05.066792 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766c5004-cebf-4a76-9c6a-36d809470471 None None] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:49:05.067325 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766c5004-cebf-4a76-9c6a-36d809470471 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:49:05.067325 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766c5004-cebf-4a76-9c6a-36d809470471 None None] PATH_INFO: `/` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:49:05.068611 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 719/1441] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 16 07:49:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 07:49:05.074003 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fdf390-91a4-43af-8ae1-db7abdabfadd None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:49:05.074429 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fdf390-91a4-43af-8ae1-db7abdabfadd None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:49:05.074551 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fdf390-91a4-43af-8ae1-db7abdabfadd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:49:05.115918 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:49:05.141443 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-c0fdf390-91a4-43af-8ae1-db7abdabfadd None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:49:05.142691 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-c0fdf390-91a4-43af-8ae1-db7abdabfadd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:49:05.239303 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 723/1442] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 16 07:49:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 07:49:05.521192 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766c5004-cebf-4a76-9c6a-36d809470471 None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:49:05.523023 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-766c5004-cebf-4a76-9c6a-36d809470471 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:49:05.625825 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766c5004-cebf-4a76-9c6a-36d809470471 None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:49:05.656763 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:49:05.698714 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f67f3b-6f92-47ab-9391-d22886eed373 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1062e457207a41e4ba4f0a0c4bf36f1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4735f453c0c24cc4a1c14e9ac84a0b46', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:49:05.699313 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f67f3b-6f92-47ab-9391-d22886eed373 service neutron] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:49:05.699586 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f67f3b-6f92-47ab-9391-d22886eed373 service neutron] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:49:05.699884 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f67f3b-6f92-47ab-9391-d22886eed373 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:49:05.701486 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-c0f67f3b-6f92-47ab-9391-d22886eed373 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:49:05.808530 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f67f3b-6f92-47ab-9391-d22886eed373 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:49:05.809912 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f67f3b-6f92-47ab-9391-d22886eed373 service neutron] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:49:05.827357 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 720/1443] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Sep 16 07:49:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 07:49:08.134328 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e387dc3-9d5b-404c-8762-2560d9f8628e None None] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:49:08.134799 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e387dc3-9d5b-404c-8762-2560d9f8628e None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:49:08.134917 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e387dc3-9d5b-404c-8762-2560d9f8628e None None] PATH_INFO: `/` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:49:08.136197 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 724/1444] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 16 07:49:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 07:49:08.141394 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2984a6-7a52-4207-b288-401af8e53c5d None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:49:08.141845 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2984a6-7a52-4207-b288-401af8e53c5d None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:49:08.141997 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2984a6-7a52-4207-b288-401af8e53c5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:49:08.209801 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-eb2984a6-7a52-4207-b288-401af8e53c5d None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:49:08.211753 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-eb2984a6-7a52-4207-b288-401af8e53c5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:49:08.224724 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:49:08.311152 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 721/1445] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 16 07:49:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 16 07:49:08.613453 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e387dc3-9d5b-404c-8762-2560d9f8628e None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:49:08.615107 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-4e387dc3-9d5b-404c-8762-2560d9f8628e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:49:08.724269 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e387dc3-9d5b-404c-8762-2560d9f8628e None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:49:08.746927 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:49:08.815570 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605231d8-70ab-413b-a863-7e9abd76d522 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1062e457207a41e4ba4f0a0c4bf36f1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4735f453c0c24cc4a1c14e9ac84a0b46', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:49:08.816170 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605231d8-70ab-413b-a863-7e9abd76d522 service neutron] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:49:08.816443 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605231d8-70ab-413b-a863-7e9abd76d522 service neutron] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:49:08.816706 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605231d8-70ab-413b-a863-7e9abd76d522 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:49:08.818326 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-605231d8-70ab-413b-a863-7e9abd76d522 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:49:08.925602 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605231d8-70ab-413b-a863-7e9abd76d522 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:49:08.926965 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605231d8-70ab-413b-a863-7e9abd76d522 service neutron] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:49:08.945524 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 725/1446] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Sep 16 07:49:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 07:49:11.406133 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0101c926-8b59-4220-af71-4b19f33d6862 None None] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:49:11.406687 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0101c926-8b59-4220-af71-4b19f33d6862 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:49:11.406687 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0101c926-8b59-4220-af71-4b19f33d6862 None None] PATH_INFO: `/` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:49:11.407942 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 722/1447] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 16 07:49:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 07:49:11.413864 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5193dcf7-f02f-43c2-bd71-772c82988318 None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:49:11.414287 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5193dcf7-f02f-43c2-bd71-772c82988318 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:49:11.414420 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5193dcf7-f02f-43c2-bd71-772c82988318 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:49:11.462702 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:49:11.480655 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-5193dcf7-f02f-43c2-bd71-772c82988318 None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:49:11.481891 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-5193dcf7-f02f-43c2-bd71-772c82988318 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:49:11.577856 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 726/1448] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 16 07:49:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 07:49:11.861177 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0101c926-8b59-4220-af71-4b19f33d6862 None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:49:11.862794 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-0101c926-8b59-4220-af71-4b19f33d6862 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:49:11.966854 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0101c926-8b59-4220-af71-4b19f33d6862 None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:49:12.006522 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:49:12.040609 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f56ffc-55a6-4ccd-b948-6e7114681762 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1062e457207a41e4ba4f0a0c4bf36f1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4735f453c0c24cc4a1c14e9ac84a0b46', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:49:12.041207 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f56ffc-55a6-4ccd-b948-6e7114681762 service neutron] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:49:12.041480 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f56ffc-55a6-4ccd-b948-6e7114681762 service neutron] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:49:12.041768 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f56ffc-55a6-4ccd-b948-6e7114681762 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:49:12.043338 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-24f56ffc-55a6-4ccd-b948-6e7114681762 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:49:12.152299 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f56ffc-55a6-4ccd-b948-6e7114681762 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:49:12.153746 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f56ffc-55a6-4ccd-b948-6e7114681762 service neutron] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:49:12.171782 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 723/1449] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Sep 16 07:49:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 07:49:14.467237 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a07248-e67a-44a1-8d18-e6d35d4256e8 None None] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:49:14.467771 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a07248-e67a-44a1-8d18-e6d35d4256e8 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:49:14.467771 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a07248-e67a-44a1-8d18-e6d35d4256e8 None None] PATH_INFO: `/` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:49:14.469032 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 727/1450] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 16 07:49:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 07:49:14.474421 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3044b7c1-0a1c-450f-9d05-544641e24e04 None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:49:14.474868 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3044b7c1-0a1c-450f-9d05-544641e24e04 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:49:14.474964 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3044b7c1-0a1c-450f-9d05-544641e24e04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:49:14.541339 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-3044b7c1-0a1c-450f-9d05-544641e24e04 None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:49:14.542574 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-3044b7c1-0a1c-450f-9d05-544641e24e04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:49:14.562959 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:49:14.755394 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 724/1451] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 16 07:49:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 16 07:49:15.036345 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a07248-e67a-44a1-8d18-e6d35d4256e8 None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:49:15.037918 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-91a07248-e67a-44a1-8d18-e6d35d4256e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:49:15.144579 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a07248-e67a-44a1-8d18-e6d35d4256e8 None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:49:15.164587 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:49:15.218042 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7087ad9c-51ce-4823-a4a3-42e164272f6a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1062e457207a41e4ba4f0a0c4bf36f1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4735f453c0c24cc4a1c14e9ac84a0b46', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:49:15.218642 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7087ad9c-51ce-4823-a4a3-42e164272f6a service neutron] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:49:15.218916 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7087ad9c-51ce-4823-a4a3-42e164272f6a service neutron] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:49:15.219212 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7087ad9c-51ce-4823-a4a3-42e164272f6a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:49:15.220828 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-7087ad9c-51ce-4823-a4a3-42e164272f6a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:49:15.328320 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7087ad9c-51ce-4823-a4a3-42e164272f6a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:49:15.329649 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7087ad9c-51ce-4823-a4a3-42e164272f6a service neutron] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:49:15.347360 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 728/1452] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Sep 16 07:49:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 07:49:17.554744 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dd5f83-1ea9-4e8d-9860-59a490ef17c9 None None] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:49:17.555272 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dd5f83-1ea9-4e8d-9860-59a490ef17c9 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:49:17.555272 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dd5f83-1ea9-4e8d-9860-59a490ef17c9 None None] PATH_INFO: `/` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:49:17.556586 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 725/1453] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 16 07:49:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 07:49:17.561937 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51347a5-4969-46f1-940d-170f3139a70e None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:49:17.562363 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51347a5-4969-46f1-940d-170f3139a70e None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:49:17.562473 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51347a5-4969-46f1-940d-170f3139a70e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:49:17.624912 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:49:17.627780 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-a51347a5-4969-46f1-940d-170f3139a70e None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:49:17.629695 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-a51347a5-4969-46f1-940d-170f3139a70e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:49:17.727617 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 729/1454] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 16 07:49:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 07:49:18.010475 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7dd5f83-1ea9-4e8d-9860-59a490ef17c9 None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:49:18.012021 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-b7dd5f83-1ea9-4e8d-9860-59a490ef17c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:49:18.116233 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7dd5f83-1ea9-4e8d-9860-59a490ef17c9 None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:49:18.167547 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:49:18.192604 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c7f43e-f3d5-4cc6-92d0-84b775d5f257 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1062e457207a41e4ba4f0a0c4bf36f1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4735f453c0c24cc4a1c14e9ac84a0b46', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:49:18.193235 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c7f43e-f3d5-4cc6-92d0-84b775d5f257 service neutron] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:49:18.193504 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c7f43e-f3d5-4cc6-92d0-84b775d5f257 service neutron] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:49:18.193797 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c7f43e-f3d5-4cc6-92d0-84b775d5f257 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:49:18.195866 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-c2c7f43e-f3d5-4cc6-92d0-84b775d5f257 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:49:18.302268 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c7f43e-f3d5-4cc6-92d0-84b775d5f257 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:49:18.303611 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c7f43e-f3d5-4cc6-92d0-84b775d5f257 service neutron] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:49:18.321468 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 726/1455] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Sep 16 07:49:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 07:49:20.562300 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b37a68d-b9ce-42ca-ae17-9c26033eff63 None None] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:49:20.562828 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b37a68d-b9ce-42ca-ae17-9c26033eff63 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:49:20.562828 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b37a68d-b9ce-42ca-ae17-9c26033eff63 None None] PATH_INFO: `/` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:49:20.564087 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 730/1456] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 16 07:49:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 07:49:20.569926 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dfe38e-7e55-4600-b5a5-4db21fbd0f10 None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:49:20.570374 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dfe38e-7e55-4600-b5a5-4db21fbd0f10 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:49:20.570555 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dfe38e-7e55-4600-b5a5-4db21fbd0f10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:49:20.635472 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-a4dfe38e-7e55-4600-b5a5-4db21fbd0f10 None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:49:20.636678 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-a4dfe38e-7e55-4600-b5a5-4db21fbd0f10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:49:20.666360 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:49:20.733002 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 727/1457] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 16 07:49:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 07:49:21.018477 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b37a68d-b9ce-42ca-ae17-9c26033eff63 None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:49:21.020021 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-3b37a68d-b9ce-42ca-ae17-9c26033eff63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:49:21.124133 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b37a68d-b9ce-42ca-ae17-9c26033eff63 None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:49:21.152865 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:49:21.199345 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f190cc4-e8b2-417c-a5bf-1f5d62889bcf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1062e457207a41e4ba4f0a0c4bf36f1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4735f453c0c24cc4a1c14e9ac84a0b46', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:49:21.199958 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f190cc4-e8b2-417c-a5bf-1f5d62889bcf service neutron] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:49:21.200267 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f190cc4-e8b2-417c-a5bf-1f5d62889bcf service neutron] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:49:21.200540 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f190cc4-e8b2-417c-a5bf-1f5d62889bcf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:49:21.202176 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-8f190cc4-e8b2-417c-a5bf-1f5d62889bcf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:49:21.311006 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f190cc4-e8b2-417c-a5bf-1f5d62889bcf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:49:21.312354 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f190cc4-e8b2-417c-a5bf-1f5d62889bcf service neutron] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:49:21.330602 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 731/1458] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Sep 16 07:49:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 07:49:23.534760 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3b8c16-8762-4c70-9757-29f491fa2dd0 None None] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:49:23.535266 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3b8c16-8762-4c70-9757-29f491fa2dd0 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:49:23.535266 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3b8c16-8762-4c70-9757-29f491fa2dd0 None None] PATH_INFO: `/` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:49:23.536612 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 728/1459] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 16 07:49:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 07:49:23.542549 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866bd64f-9b00-4e46-98bb-adfc1571978d None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:49:23.542935 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866bd64f-9b00-4e46-98bb-adfc1571978d None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:49:23.543107 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866bd64f-9b00-4e46-98bb-adfc1571978d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:49:23.607869 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-866bd64f-9b00-4e46-98bb-adfc1571978d None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:49:23.609072 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-866bd64f-9b00-4e46-98bb-adfc1571978d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:49:23.617964 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:49:23.705306 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 732/1460] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 16 07:49:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 07:49:23.993513 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3b8c16-8762-4c70-9757-29f491fa2dd0 None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:49:23.995080 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-7f3b8c16-8762-4c70-9757-29f491fa2dd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:49:24.096381 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3b8c16-8762-4c70-9757-29f491fa2dd0 None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:49:24.169096 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:49:24.187073 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536eafbd-2570-4641-b71d-e76d807cf341 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1062e457207a41e4ba4f0a0c4bf36f1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4735f453c0c24cc4a1c14e9ac84a0b46', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:49:24.187669 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536eafbd-2570-4641-b71d-e76d807cf341 service neutron] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:49:24.187940 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536eafbd-2570-4641-b71d-e76d807cf341 service neutron] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:49:24.188213 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536eafbd-2570-4641-b71d-e76d807cf341 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:49:24.189814 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-536eafbd-2570-4641-b71d-e76d807cf341 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:49:24.298219 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536eafbd-2570-4641-b71d-e76d807cf341 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:49:24.299646 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536eafbd-2570-4641-b71d-e76d807cf341 service neutron] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:49:24.317149 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 729/1461] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Sep 16 07:49:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 07:49:26.519076 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d807af1f-ed32-4dab-a03a-fcbf625a3cbd None None] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:49:26.519617 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d807af1f-ed32-4dab-a03a-fcbf625a3cbd None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:49:26.519617 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d807af1f-ed32-4dab-a03a-fcbf625a3cbd None None] PATH_INFO: `/` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:49:26.520869 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 733/1462] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 16 07:49:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 07:49:26.526734 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3b93d4-74be-4564-9357-a26b180b0c59 None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:49:26.527135 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3b93d4-74be-4564-9357-a26b180b0c59 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:49:26.527286 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3b93d4-74be-4564-9357-a26b180b0c59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:49:26.593076 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-7f3b93d4-74be-4564-9357-a26b180b0c59 None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:49:26.594309 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-7f3b93d4-74be-4564-9357-a26b180b0c59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:49:26.631615 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:49:26.689510 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 730/1463] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 16 07:49:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 07:49:26.970995 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d807af1f-ed32-4dab-a03a-fcbf625a3cbd None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:49:26.972557 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-d807af1f-ed32-4dab-a03a-fcbf625a3cbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:49:27.077675 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d807af1f-ed32-4dab-a03a-fcbf625a3cbd None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:49:27.115625 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:49:27.152790 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077ca886-c28c-42f9-aeb1-70797f9c05f7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1062e457207a41e4ba4f0a0c4bf36f1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4735f453c0c24cc4a1c14e9ac84a0b46', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:49:27.153311 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077ca886-c28c-42f9-aeb1-70797f9c05f7 service neutron] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:49:27.153587 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077ca886-c28c-42f9-aeb1-70797f9c05f7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:49:27.153884 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077ca886-c28c-42f9-aeb1-70797f9c05f7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:49:27.155747 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-077ca886-c28c-42f9-aeb1-70797f9c05f7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:49:27.263518 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077ca886-c28c-42f9-aeb1-70797f9c05f7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:49:27.264938 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077ca886-c28c-42f9-aeb1-70797f9c05f7 service neutron] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:49:27.282364 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 734/1464] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Sep 16 07:49:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 07:49:29.430598 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef3506e-2ad4-4cd2-b646-45e9910d8ba9 None None] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:49:29.431116 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef3506e-2ad4-4cd2-b646-45e9910d8ba9 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:49:29.431116 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef3506e-2ad4-4cd2-b646-45e9910d8ba9 None None] PATH_INFO: `/` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:49:29.432397 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 731/1465] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 16 07:49:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 07:49:29.437701 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cf3dca-4e91-497f-81a9-1564c5fa0849 None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:49:29.438118 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cf3dca-4e91-497f-81a9-1564c5fa0849 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:49:29.438288 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cf3dca-4e91-497f-81a9-1564c5fa0849 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:49:29.504385 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-33cf3dca-4e91-497f-81a9-1564c5fa0849 None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:49:29.505597 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-33cf3dca-4e91-497f-81a9-1564c5fa0849 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:49:29.525137 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:49:29.604121 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 735/1466] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 16 07:49:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 07:49:29.891732 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef3506e-2ad4-4cd2-b646-45e9910d8ba9 None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:49:29.893265 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-4ef3506e-2ad4-4cd2-b646-45e9910d8ba9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:49:29.999155 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef3506e-2ad4-4cd2-b646-45e9910d8ba9 None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:49:30.063308 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:49:30.070291 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99d3f37-f89d-4234-b105-31ba040b9a44 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1062e457207a41e4ba4f0a0c4bf36f1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4735f453c0c24cc4a1c14e9ac84a0b46', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:49:30.070890 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99d3f37-f89d-4234-b105-31ba040b9a44 service neutron] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:49:30.071161 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99d3f37-f89d-4234-b105-31ba040b9a44 service neutron] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:49:30.071448 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99d3f37-f89d-4234-b105-31ba040b9a44 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:49:30.073025 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-b99d3f37-f89d-4234-b105-31ba040b9a44 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:49:30.182581 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99d3f37-f89d-4234-b105-31ba040b9a44 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:49:30.183922 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99d3f37-f89d-4234-b105-31ba040b9a44 service neutron] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:49:30.202033 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 732/1467] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Sep 16 07:49:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 07:49:32.377537 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225ff37a-81a7-4109-bd11-979718881007 None None] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:49:32.378101 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225ff37a-81a7-4109-bd11-979718881007 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:49:32.378101 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225ff37a-81a7-4109-bd11-979718881007 None None] PATH_INFO: `/` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:49:32.379743 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 736/1468] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 16 07:49:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 07:49:32.385273 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f452d47c-15db-4319-9d01-f5af04a2db47 None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:49:32.385699 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f452d47c-15db-4319-9d01-f5af04a2db47 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:49:32.385842 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f452d47c-15db-4319-9d01-f5af04a2db47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:49:32.451373 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-f452d47c-15db-4319-9d01-f5af04a2db47 None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:49:32.452578 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-f452d47c-15db-4319-9d01-f5af04a2db47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:49:32.501784 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:49:32.549821 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 733/1469] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 16 07:49:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 07:49:32.842429 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225ff37a-81a7-4109-bd11-979718881007 None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:49:32.844009 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-225ff37a-81a7-4109-bd11-979718881007 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:49:32.947440 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225ff37a-81a7-4109-bd11-979718881007 None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:49:32.997302 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:49:33.024003 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfc26df-c265-407c-8a7a-cdb392d0c6c3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1062e457207a41e4ba4f0a0c4bf36f1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4735f453c0c24cc4a1c14e9ac84a0b46', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:49:33.024599 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfc26df-c265-407c-8a7a-cdb392d0c6c3 service neutron] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:49:33.024877 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfc26df-c265-407c-8a7a-cdb392d0c6c3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:49:33.025146 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfc26df-c265-407c-8a7a-cdb392d0c6c3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:49:33.026785 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-cbfc26df-c265-407c-8a7a-cdb392d0c6c3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:49:33.134556 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfc26df-c265-407c-8a7a-cdb392d0c6c3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:49:33.135987 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfc26df-c265-407c-8a7a-cdb392d0c6c3 service neutron] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:49:33.154688 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 737/1470] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Sep 16 07:49:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 07:49:42.548386 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=22 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:49:43.152410 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=66 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:49:53.093908 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81f5a9a-54cc-4b83-87fd-a863a83c60ff None None] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:49:53.094426 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81f5a9a-54cc-4b83-87fd-a863a83c60ff None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:49:53.094426 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81f5a9a-54cc-4b83-87fd-a863a83c60ff None None] PATH_INFO: `/` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:49:53.095709 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 734/1471] 10.222.0.57 () {54 vars in 927 bytes} [Fri Sep 16 07:49:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 07:49:53.101060 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65073db8-cd75-439f-b9f3-83b5985efef8 None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:49:53.101527 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65073db8-cd75-439f-b9f3-83b5985efef8 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:49:53.101636 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65073db8-cd75-439f-b9f3-83b5985efef8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:49:53.167325 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-65073db8-cd75-439f-b9f3-83b5985efef8 None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:49:53.168523 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-65073db8-cd75-439f-b9f3-83b5985efef8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:49:53.262999 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 738/1472] 10.222.0.57 () {58 vars in 1024 bytes} [Fri Sep 16 07:49:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 07:49:53.565192 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fd602a-6f59-4c1e-816d-c6a0aed10faf None None] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:49:53.565477 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fd602a-6f59-4c1e-816d-c6a0aed10faf None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:49:53.565784 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fd602a-6f59-4c1e-816d-c6a0aed10faf None None] PATH_INFO: `/` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:49:53.567145 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 735/1473] 10.222.0.57 () {54 vars in 962 bytes} [Fri Sep 16 07:49:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 07:49:53.572603 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14de18a5-bfcb-4185-8bed-aa142eda2ed2 None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:49:53.572913 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14de18a5-bfcb-4185-8bed-aa142eda2ed2 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:49:53.573185 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14de18a5-bfcb-4185-8bed-aa142eda2ed2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:49:53.648007 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-14de18a5-bfcb-4185-8bed-aa142eda2ed2 None None] MFA Rules not processed for user `ceecb2c2fe9842e3b228848e00fd11ed`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:49:53.649206 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-14de18a5-bfcb-4185-8bed-aa142eda2ed2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:49:53.669453 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:49:53.725471 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 739/1474] 10.222.0.57 () {58 vars in 1059 bytes} [Fri Sep 16 07:49:53 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 07:49:53.733214 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fd602a-6f59-4c1e-816d-c6a0aed10faf None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:49:53.734766 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-d9fd602a-6f59-4c1e-816d-c6a0aed10faf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:49:53.841290 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fd602a-6f59-4c1e-816d-c6a0aed10faf None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:49:53.914262 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdca4b8d-c681-4a25-be18-5d8241edee9b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceecb2c2fe9842e3b228848e00fd11ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4735f453c0c24cc4a1c14e9ac84a0b46', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:49:53.914861 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdca4b8d-c681-4a25-be18-5d8241edee9b service glance] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:49:53.915136 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdca4b8d-c681-4a25-be18-5d8241edee9b service glance] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:49:53.915401 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdca4b8d-c681-4a25-be18-5d8241edee9b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:49:53.916982 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-cdca4b8d-c681-4a25-be18-5d8241edee9b service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:49:53.976397 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:49:54.030658 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdca4b8d-c681-4a25-be18-5d8241edee9b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:49:54.032090 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdca4b8d-c681-4a25-be18-5d8241edee9b service glance] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:49:54.050066 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 736/1475] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Sep 16 07:49:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 07:49:56.337092 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb9fa71-13eb-4da5-b9ac-6dd0eee82a99 None None] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:49:56.337691 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb9fa71-13eb-4da5-b9ac-6dd0eee82a99 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:49:56.337691 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb9fa71-13eb-4da5-b9ac-6dd0eee82a99 None None] PATH_INFO: `/` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:49:56.339019 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 740/1476] 10.222.0.57 () {54 vars in 927 bytes} [Fri Sep 16 07:49:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 07:49:56.344614 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3379ae0-aff4-4c4a-ba72-63acb4401be2 None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:49:56.345041 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3379ae0-aff4-4c4a-ba72-63acb4401be2 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:49:56.345148 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3379ae0-aff4-4c4a-ba72-63acb4401be2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:49:56.410727 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-f3379ae0-aff4-4c4a-ba72-63acb4401be2 None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:49:56.411849 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-f3379ae0-aff4-4c4a-ba72-63acb4401be2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:49:56.506962 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 737/1477] 10.222.0.57 () {58 vars in 1024 bytes} [Fri Sep 16 07:49:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 07:49:56.795799 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb9fa71-13eb-4da5-b9ac-6dd0eee82a99 None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:49:56.797344 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-bcb9fa71-13eb-4da5-b9ac-6dd0eee82a99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:49:56.930124 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb9fa71-13eb-4da5-b9ac-6dd0eee82a99 None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:49:56.980292 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:49:57.024492 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a70593-e7c7-42f3-a203-232899226190 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:49:57.025092 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a70593-e7c7-42f3-a203-232899226190 admin admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:49:57.025368 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a70593-e7c7-42f3-a203-232899226190 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:49:57.025635 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a70593-e7c7-42f3-a203-232899226190 admin admin] PATH_INFO: `/v3/projects` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:49:57.026289 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a70593-e7c7-42f3-a203-232899226190 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:49:57.028055 dv-cinder-740146-20-smb devstack@keystone.service[81430]: WARNING py.warnings [None req-51a70593-e7c7-42f3-a203-232899226190 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 16 07:49:57.028055 dv-cinder-740146-20-smb devstack@keystone.service[81430]: warnings.warn(msg) Sep 16 07:49:57.028055 dv-cinder-740146-20-smb devstack@keystone.service[81430]: Sep 16 07:49:57.029179 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a70593-e7c7-42f3-a203-232899226190 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:49:57.047665 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 741/1478] 10.222.0.57 () {56 vars in 1108 bytes} [Fri Sep 16 07:49:56 2022] GET /identity/v3/projects => generated 2553 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 07:49:59.216527 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fba9b41-8cfc-40dd-9f7e-ebe11fdcac15 None None] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:49:59.217084 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fba9b41-8cfc-40dd-9f7e-ebe11fdcac15 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:49:59.217084 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fba9b41-8cfc-40dd-9f7e-ebe11fdcac15 None None] PATH_INFO: `/` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:49:59.218446 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 738/1479] 10.222.0.57 () {54 vars in 927 bytes} [Fri Sep 16 07:49:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 07:49:59.223770 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b1f304-577c-4b81-ad4a-d227439d286d None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:49:59.224211 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b1f304-577c-4b81-ad4a-d227439d286d None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:49:59.224315 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b1f304-577c-4b81-ad4a-d227439d286d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:49:59.290791 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-a3b1f304-577c-4b81-ad4a-d227439d286d None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:49:59.291988 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-a3b1f304-577c-4b81-ad4a-d227439d286d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:49:59.386431 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 742/1480] 10.222.0.57 () {58 vars in 1024 bytes} [Fri Sep 16 07:49:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 16 07:49:59.677291 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fba9b41-8cfc-40dd-9f7e-ebe11fdcac15 None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:49:59.679356 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-3fba9b41-8cfc-40dd-9f7e-ebe11fdcac15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:49:59.689062 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:49:59.829524 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fba9b41-8cfc-40dd-9f7e-ebe11fdcac15 None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:49:59.907829 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:49:59.940542 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e748a89a-2fd5-4c08-84a4-c4ff095b5cbe service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bec4d9b08514461a1bf63c6b88f53b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4735f453c0c24cc4a1c14e9ac84a0b46', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:49:59.941067 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e748a89a-2fd5-4c08-84a4-c4ff095b5cbe service nova] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:49:59.941342 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e748a89a-2fd5-4c08-84a4-c4ff095b5cbe service nova] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:49:59.941609 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e748a89a-2fd5-4c08-84a4-c4ff095b5cbe service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:49:59.943223 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-e748a89a-2fd5-4c08-84a4-c4ff095b5cbe service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:50:00.031766 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e748a89a-2fd5-4c08-84a4-c4ff095b5cbe service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:50:00.033354 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e748a89a-2fd5-4c08-84a4-c4ff095b5cbe service nova] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:50:00.050799 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 739/1481] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Sep 16 07:49:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 07:50:02.431636 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f839bba2-bc3c-45d0-afcc-ea69de32fe0d None None] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:50:02.432163 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f839bba2-bc3c-45d0-afcc-ea69de32fe0d None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:50:02.432163 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f839bba2-bc3c-45d0-afcc-ea69de32fe0d None None] PATH_INFO: `/` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:50:02.433460 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 743/1482] 10.222.0.57 () {54 vars in 927 bytes} [Fri Sep 16 07:50:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 07:50:02.439040 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ce0d97-b53f-4bee-b9aa-523f33139a26 None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:50:02.440170 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ce0d97-b53f-4bee-b9aa-523f33139a26 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:50:02.440623 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ce0d97-b53f-4bee-b9aa-523f33139a26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:50:02.517503 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-b1ce0d97-b53f-4bee-b9aa-523f33139a26 None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:50:02.518802 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-b1ce0d97-b53f-4bee-b9aa-523f33139a26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:50:02.573135 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:50:02.630153 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 740/1483] 10.222.0.57 () {58 vars in 1024 bytes} [Fri Sep 16 07:50:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 07:50:02.941459 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f839bba2-bc3c-45d0-afcc-ea69de32fe0d None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:50:02.943068 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-f839bba2-bc3c-45d0-afcc-ea69de32fe0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:50:02.967625 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:50:03.050114 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f839bba2-bc3c-45d0-afcc-ea69de32fe0d None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:50:03.128012 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0e1a9a-1802-47ee-b08e-cbc29475ea06 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1062e457207a41e4ba4f0a0c4bf36f1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4735f453c0c24cc4a1c14e9ac84a0b46', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:50:03.128625 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0e1a9a-1802-47ee-b08e-cbc29475ea06 service neutron] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:50:03.128903 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0e1a9a-1802-47ee-b08e-cbc29475ea06 service neutron] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:50:03.129172 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0e1a9a-1802-47ee-b08e-cbc29475ea06 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:50:03.131845 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-3a0e1a9a-1802-47ee-b08e-cbc29475ea06 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:50:03.206090 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:50:03.242093 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0e1a9a-1802-47ee-b08e-cbc29475ea06 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:50:03.243453 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0e1a9a-1802-47ee-b08e-cbc29475ea06 service neutron] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:50:03.261408 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 744/1484] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Sep 16 07:50:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 07:50:05.483085 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85ef44e-e469-4807-b0f4-29eac56d232c None None] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:50:05.483601 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85ef44e-e469-4807-b0f4-29eac56d232c None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:50:05.483601 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85ef44e-e469-4807-b0f4-29eac56d232c None None] PATH_INFO: `/` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:50:05.484890 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 741/1485] 10.222.0.57 () {54 vars in 927 bytes} [Fri Sep 16 07:50:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 07:50:05.490236 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34821968-d71a-4cb8-9bcb-0c0d29fb9d2c None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:50:05.490714 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34821968-d71a-4cb8-9bcb-0c0d29fb9d2c None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:50:05.491057 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34821968-d71a-4cb8-9bcb-0c0d29fb9d2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:50:05.556949 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-34821968-d71a-4cb8-9bcb-0c0d29fb9d2c None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:50:05.558265 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-34821968-d71a-4cb8-9bcb-0c0d29fb9d2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:50:05.668794 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 745/1486] 10.222.0.57 () {58 vars in 1024 bytes} [Fri Sep 16 07:50:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 07:50:05.955184 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85ef44e-e469-4807-b0f4-29eac56d232c None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:50:05.956716 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-e85ef44e-e469-4807-b0f4-29eac56d232c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:50:06.059959 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85ef44e-e469-4807-b0f4-29eac56d232c None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:50:06.131794 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:50:06.133413 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06433d1d-9408-4cc4-879e-ccbaaff1d2cc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1062e457207a41e4ba4f0a0c4bf36f1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4735f453c0c24cc4a1c14e9ac84a0b46', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:50:06.134200 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06433d1d-9408-4cc4-879e-ccbaaff1d2cc service neutron] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:50:06.134695 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06433d1d-9408-4cc4-879e-ccbaaff1d2cc service neutron] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:50:06.135137 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06433d1d-9408-4cc4-879e-ccbaaff1d2cc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:50:06.136948 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-06433d1d-9408-4cc4-879e-ccbaaff1d2cc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:50:06.248149 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06433d1d-9408-4cc4-879e-ccbaaff1d2cc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:50:06.249506 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06433d1d-9408-4cc4-879e-ccbaaff1d2cc service neutron] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:50:06.268209 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 742/1487] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Sep 16 07:50:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 07:50:08.541781 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea8498d-c688-4bb1-a2f5-404367790fbe None None] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:50:08.542375 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea8498d-c688-4bb1-a2f5-404367790fbe None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:50:08.542375 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea8498d-c688-4bb1-a2f5-404367790fbe None None] PATH_INFO: `/` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:50:08.543687 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 746/1488] 10.222.0.57 () {54 vars in 927 bytes} [Fri Sep 16 07:50:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 07:50:08.549035 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6f302f-89b1-4d3c-8a6b-8de61dbd271f None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:50:08.549464 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6f302f-89b1-4d3c-8a6b-8de61dbd271f None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:50:08.549571 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6f302f-89b1-4d3c-8a6b-8de61dbd271f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:50:08.614575 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-fb6f302f-89b1-4d3c-8a6b-8de61dbd271f None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:50:08.616548 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-fb6f302f-89b1-4d3c-8a6b-8de61dbd271f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:50:08.668557 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:50:08.711746 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 743/1489] 10.222.0.57 () {58 vars in 1024 bytes} [Fri Sep 16 07:50:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 07:50:09.004839 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea8498d-c688-4bb1-a2f5-404367790fbe None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:50:09.007092 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-eea8498d-c688-4bb1-a2f5-404367790fbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:50:09.043353 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:50:09.119014 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea8498d-c688-4bb1-a2f5-404367790fbe None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:50:09.196014 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e5915c-153c-40e8-9445-510bb51237e3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1062e457207a41e4ba4f0a0c4bf36f1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4735f453c0c24cc4a1c14e9ac84a0b46', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:50:09.196618 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e5915c-153c-40e8-9445-510bb51237e3 service neutron] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:50:09.196900 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e5915c-153c-40e8-9445-510bb51237e3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:50:09.197172 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e5915c-153c-40e8-9445-510bb51237e3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:50:09.198826 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-a6e5915c-153c-40e8-9445-510bb51237e3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:50:09.277051 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:50:09.306725 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e5915c-153c-40e8-9445-510bb51237e3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:50:09.308148 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e5915c-153c-40e8-9445-510bb51237e3 service neutron] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:50:09.326553 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 747/1490] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Sep 16 07:50:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 07:50:11.683365 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00380059-3490-4060-9251-be980d5c781a None None] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:50:11.683925 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00380059-3490-4060-9251-be980d5c781a None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:50:11.683925 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00380059-3490-4060-9251-be980d5c781a None None] PATH_INFO: `/` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:50:11.685272 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 744/1491] 10.222.0.57 () {54 vars in 927 bytes} [Fri Sep 16 07:50:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 07:50:11.690674 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b787f4dd-315b-4c1c-bbda-bc4918edc603 None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:50:11.691092 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b787f4dd-315b-4c1c-bbda-bc4918edc603 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:50:11.691225 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b787f4dd-315b-4c1c-bbda-bc4918edc603 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:50:11.757886 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-b787f4dd-315b-4c1c-bbda-bc4918edc603 None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:50:11.759101 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-b787f4dd-315b-4c1c-bbda-bc4918edc603 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:50:11.854427 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 748/1492] 10.222.0.57 () {58 vars in 1024 bytes} [Fri Sep 16 07:50:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 07:50:12.148581 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00380059-3490-4060-9251-be980d5c781a None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:50:12.150136 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-00380059-3490-4060-9251-be980d5c781a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:50:12.252051 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00380059-3490-4060-9251-be980d5c781a None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:50:12.324738 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9d3984-4d89-428e-88c6-b8ab49b4e388 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1062e457207a41e4ba4f0a0c4bf36f1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4735f453c0c24cc4a1c14e9ac84a0b46', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:50:12.325326 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9d3984-4d89-428e-88c6-b8ab49b4e388 service neutron] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:50:12.325598 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9d3984-4d89-428e-88c6-b8ab49b4e388 service neutron] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:50:12.325890 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9d3984-4d89-428e-88c6-b8ab49b4e388 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:50:12.327460 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-2c9d3984-4d89-428e-88c6-b8ab49b4e388 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:50:12.336326 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:50:12.434946 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9d3984-4d89-428e-88c6-b8ab49b4e388 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:50:12.436305 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9d3984-4d89-428e-88c6-b8ab49b4e388 service neutron] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:50:12.454440 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 745/1493] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Sep 16 07:50:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 16 07:50:21.852898 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=82 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:50:22.452280 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=50 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:51:32.359391 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc8eddf-c95f-4270-ba4a-a18f8f33cba0 None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:51:32.359965 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc8eddf-c95f-4270-ba4a-a18f8f33cba0 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:51:32.359965 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc8eddf-c95f-4270-ba4a-a18f8f33cba0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:51:32.435710 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-6fc8eddf-c95f-4270-ba4a-a18f8f33cba0 None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:51:32.436927 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-6fc8eddf-c95f-4270-ba4a-a18f8f33cba0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:51:32.536064 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 749/1494] 10.222.0.57 () {58 vars in 958 bytes} [Fri Sep 16 07:51:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 07:51:32.544030 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917197fa-495b-40fc-b106-bf8de3c50faf None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:51:32.544539 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917197fa-495b-40fc-b106-bf8de3c50faf None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:51:32.544655 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917197fa-495b-40fc-b106-bf8de3c50faf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:51:32.618691 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-917197fa-495b-40fc-b106-bf8de3c50faf None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:51:32.619851 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-917197fa-495b-40fc-b106-bf8de3c50faf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:51:32.715747 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 746/1495] 10.222.0.57 () {58 vars in 958 bytes} [Fri Sep 16 07:51:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 07:51:32.720355 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc8eddf-c95f-4270-ba4a-a18f8f33cba0 None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:51:32.721559 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-6fc8eddf-c95f-4270-ba4a-a18f8f33cba0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:51:32.733805 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc8eddf-c95f-4270-ba4a-a18f8f33cba0 None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:51:32.912786 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:51:32.946995 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed57a0c-c9b5-4925-a792-329517c1f107 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:51:32.948093 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed57a0c-c9b5-4925-a792-329517c1f107 admin admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:51:32.949824 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed57a0c-c9b5-4925-a792-329517c1f107 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:51:32.949824 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed57a0c-c9b5-4925-a792-329517c1f107 admin admin] PATH_INFO: `/v3/domains` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:51:32.949824 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed57a0c-c9b5-4925-a792-329517c1f107 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:51:32.949824 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed57a0c-c9b5-4925-a792-329517c1f107 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:51:32.951333 dv-cinder-740146-20-smb devstack@keystone.service[81430]: WARNING py.warnings [None req-aed57a0c-c9b5-4925-a792-329517c1f107 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 16 07:51:32.951333 dv-cinder-740146-20-smb devstack@keystone.service[81430]: warnings.warn(msg) Sep 16 07:51:32.951333 dv-cinder-740146-20-smb devstack@keystone.service[81430]: Sep 16 07:51:32.952208 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed57a0c-c9b5-4925-a792-329517c1f107 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:51:32.963859 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 750/1496] 10.222.0.57 () {58 vars in 1153 bytes} [Fri Sep 16 07:51:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:51:32.972816 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917197fa-495b-40fc-b106-bf8de3c50faf None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:51:32.981943 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917197fa-495b-40fc-b106-bf8de3c50faf None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:51:33.042009 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:51:33.075631 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337c8008-0fe2-4453-a2d2-b44c6ba6e61c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:51:33.076228 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337c8008-0fe2-4453-a2d2-b44c6ba6e61c admin admin] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:51:33.076499 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337c8008-0fe2-4453-a2d2-b44c6ba6e61c admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:51:33.076765 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337c8008-0fe2-4453-a2d2-b44c6ba6e61c admin admin] PATH_INFO: `/v3/projects` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:51:33.077382 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337c8008-0fe2-4453-a2d2-b44c6ba6e61c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:51:33.079123 dv-cinder-740146-20-smb devstack@keystone.service[81431]: WARNING py.warnings [None req-337c8008-0fe2-4453-a2d2-b44c6ba6e61c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 16 07:51:33.079123 dv-cinder-740146-20-smb devstack@keystone.service[81431]: warnings.warn(msg) Sep 16 07:51:33.079123 dv-cinder-740146-20-smb devstack@keystone.service[81431]: Sep 16 07:51:33.080295 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337c8008-0fe2-4453-a2d2-b44c6ba6e61c admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:51:33.137143 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 747/1497] 10.222.0.57 () {60 vars in 1153 bytes} [Fri Sep 16 07:51:32 2022] POST /identity/v3/projects => generated 377 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 07:51:33.141425 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed57a0c-c9b5-4925-a792-329517c1f107 admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:51:33.142972 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-aed57a0c-c9b5-4925-a792-329517c1f107 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:51:33.177158 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed57a0c-c9b5-4925-a792-329517c1f107 admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:51:33.270992 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079d53e1-3d4f-4c2f-a6f0-0d9b631d781e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:51:33.271627 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079d53e1-3d4f-4c2f-a6f0-0d9b631d781e admin admin] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:51:33.271909 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079d53e1-3d4f-4c2f-a6f0-0d9b631d781e admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:51:33.272183 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079d53e1-3d4f-4c2f-a6f0-0d9b631d781e admin admin] PATH_INFO: `/v3/users` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:51:33.272816 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079d53e1-3d4f-4c2f-a6f0-0d9b631d781e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:51:33.273855 dv-cinder-740146-20-smb devstack@keystone.service[81430]: WARNING py.warnings [None req-079d53e1-3d4f-4c2f-a6f0-0d9b631d781e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 16 07:51:33.273855 dv-cinder-740146-20-smb devstack@keystone.service[81430]: warnings.warn(msg) Sep 16 07:51:33.273855 dv-cinder-740146-20-smb devstack@keystone.service[81430]: Sep 16 07:51:33.275052 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079d53e1-3d4f-4c2f-a6f0-0d9b631d781e admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:51:33.318505 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 751/1498] 10.222.0.57 () {60 vars in 1144 bytes} [Fri Sep 16 07:51:33 2022] POST /identity/v3/users => generated 289 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 07:51:33.322678 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337c8008-0fe2-4453-a2d2-b44c6ba6e61c admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:51:33.324213 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-337c8008-0fe2-4453-a2d2-b44c6ba6e61c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:51:33.386715 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337c8008-0fe2-4453-a2d2-b44c6ba6e61c admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:51:33.468808 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:51:33.480257 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d082704b-a4a3-4ae0-883c-6f55f7cf36ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:51:33.480855 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d082704b-a4a3-4ae0-883c-6f55f7cf36ce admin admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:51:33.481125 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d082704b-a4a3-4ae0-883c-6f55f7cf36ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:51:33.481389 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d082704b-a4a3-4ae0-883c-6f55f7cf36ce admin admin] PATH_INFO: `/v3/roles` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:51:33.482049 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d082704b-a4a3-4ae0-883c-6f55f7cf36ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:51:33.483054 dv-cinder-740146-20-smb devstack@keystone.service[81431]: WARNING py.warnings [None req-d082704b-a4a3-4ae0-883c-6f55f7cf36ce admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 16 07:51:33.483054 dv-cinder-740146-20-smb devstack@keystone.service[81431]: warnings.warn(msg) Sep 16 07:51:33.483054 dv-cinder-740146-20-smb devstack@keystone.service[81431]: Sep 16 07:51:33.483951 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d082704b-a4a3-4ae0-883c-6f55f7cf36ce admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:51:33.497049 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 748/1499] 10.222.0.57 () {58 vars in 1122 bytes} [Fri Sep 16 07:51:33 2022] GET /identity/v3/roles => generated 1420 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 07:51:33.501040 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079d53e1-3d4f-4c2f-a6f0-0d9b631d781e admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:51:33.502577 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-079d53e1-3d4f-4c2f-a6f0-0d9b631d781e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:51:33.513792 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079d53e1-3d4f-4c2f-a6f0-0d9b631d781e admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:51:33.539554 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:51:33.621128 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76745e1e-5b80-4bd6-a7a3-4e03cf319be7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:51:33.621756 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76745e1e-5b80-4bd6-a7a3-4e03cf319be7 admin admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:51:33.622297 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76745e1e-5b80-4bd6-a7a3-4e03cf319be7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:51:33.622569 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76745e1e-5b80-4bd6-a7a3-4e03cf319be7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:51:33.623207 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76745e1e-5b80-4bd6-a7a3-4e03cf319be7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:51:33.624222 dv-cinder-740146-20-smb devstack@keystone.service[81430]: WARNING py.warnings [None req-76745e1e-5b80-4bd6-a7a3-4e03cf319be7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 16 07:51:33.624222 dv-cinder-740146-20-smb devstack@keystone.service[81430]: warnings.warn(msg) Sep 16 07:51:33.624222 dv-cinder-740146-20-smb devstack@keystone.service[81430]: Sep 16 07:51:33.625100 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76745e1e-5b80-4bd6-a7a3-4e03cf319be7 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:51:33.638207 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 752/1500] 10.222.0.57 () {58 vars in 1122 bytes} [Fri Sep 16 07:51:33 2022] GET /identity/v3/roles => generated 1420 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 07:51:33.642431 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d082704b-a4a3-4ae0-883c-6f55f7cf36ce admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:51:33.644506 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-d082704b-a4a3-4ae0-883c-6f55f7cf36ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:51:33.678739 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d082704b-a4a3-4ae0-883c-6f55f7cf36ce admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:51:33.772144 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1839ede-e5ff-4ba6-a0a3-c4c63a1926f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:51:33.772765 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1839ede-e5ff-4ba6-a0a3-c4c63a1926f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:51:33.773045 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1839ede-e5ff-4ba6-a0a3-c4c63a1926f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:51:33.773317 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1839ede-e5ff-4ba6-a0a3-c4c63a1926f7 admin admin] PATH_INFO: `/v3/projects/9cbe7fdac79e478e9f854f0b6c97eb23/users/066a3fbab43b40ec92e6ab77448a91d8/roles/4818d38cf2564825b312e66c9eb24762` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:51:33.795945 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1839ede-e5ff-4ba6-a0a3-c4c63a1926f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9cbe7fdac79e478e9f854f0b6c97eb23, user_id=066a3fbab43b40ec92e6ab77448a91d8, role_id=4818d38cf2564825b312e66c9eb24762)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:51:33.796975 dv-cinder-740146-20-smb devstack@keystone.service[81431]: WARNING py.warnings [None req-b1839ede-e5ff-4ba6-a0a3-c4c63a1926f7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 16 07:51:33.796975 dv-cinder-740146-20-smb devstack@keystone.service[81431]: warnings.warn(msg) Sep 16 07:51:33.796975 dv-cinder-740146-20-smb devstack@keystone.service[81431]: Sep 16 07:51:33.798938 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1839ede-e5ff-4ba6-a0a3-c4c63a1926f7 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:51:33.823542 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 749/1501] 10.222.0.57 () {60 vars in 1483 bytes} [Fri Sep 16 07:51:33 2022] PUT /identity/v3/projects/9cbe7fdac79e478e9f854f0b6c97eb23/users/066a3fbab43b40ec92e6ab77448a91d8/roles/4818d38cf2564825b312e66c9eb24762 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 07:51:33.836376 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20c1e4d-b91a-4a51-889d-427d9badff05 None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:51:33.836660 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20c1e4d-b91a-4a51-889d-427d9badff05 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:51:33.836938 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20c1e4d-b91a-4a51-889d-427d9badff05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:51:33.898191 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-b20c1e4d-b91a-4a51-889d-427d9badff05 None None] MFA Rules not processed for user `066a3fbab43b40ec92e6ab77448a91d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:51:33.899422 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-b20c1e4d-b91a-4a51-889d-427d9badff05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:51:33.992004 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 753/1502] 10.222.0.57 () {58 vars in 958 bytes} [Fri Sep 16 07:51:33 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 07:51:34.006155 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8d54c7-a8d6-4075-be04-c70d189e67c8 None None] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:51:34.006444 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8d54c7-a8d6-4075-be04-c70d189e67c8 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:51:34.006717 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8d54c7-a8d6-4075-be04-c70d189e67c8 None None] PATH_INFO: `/` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:51:34.008078 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 750/1503] 10.222.0.57 () {54 vars in 964 bytes} [Fri Sep 16 07:51:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 07:51:34.012698 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683700c4-cc2a-4e3b-905e-1b1964947ab0 None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:51:34.012981 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683700c4-cc2a-4e3b-905e-1b1964947ab0 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:51:34.013255 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683700c4-cc2a-4e3b-905e-1b1964947ab0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:51:34.044349 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:51:34.088635 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-683700c4-cc2a-4e3b-905e-1b1964947ab0 None None] MFA Rules not processed for user `6544bf6be4c24454a013ca110c43cef2`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:51:34.089892 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-683700c4-cc2a-4e3b-905e-1b1964947ab0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:51:34.164982 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 754/1504] 10.222.0.57 () {58 vars in 1061 bytes} [Fri Sep 16 07:51:34 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 07:51:34.172701 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8d54c7-a8d6-4075-be04-c70d189e67c8 None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:51:34.174240 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-3c8d54c7-a8d6-4075-be04-c70d189e67c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:51:34.223662 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:51:34.283320 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8d54c7-a8d6-4075-be04-c70d189e67c8 None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:51:34.358561 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be123d86-7890-4c92-a69d-3a3dccb2e660 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544bf6be4c24454a013ca110c43cef2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4735f453c0c24cc4a1c14e9ac84a0b46', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:51:34.359162 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be123d86-7890-4c92-a69d-3a3dccb2e660 service cinder] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:51:34.359438 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be123d86-7890-4c92-a69d-3a3dccb2e660 service cinder] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:51:34.359704 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be123d86-7890-4c92-a69d-3a3dccb2e660 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:51:34.361296 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-be123d86-7890-4c92-a69d-3a3dccb2e660 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:51:34.462203 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be123d86-7890-4c92-a69d-3a3dccb2e660 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:51:34.463639 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be123d86-7890-4c92-a69d-3a3dccb2e660 service cinder] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:51:34.467107 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:51:34.483059 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 751/1505] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Sep 16 07:51:34 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 07:51:34.530139 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a85cbb0-5958-4387-a8ff-39646cbc1baf None None] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:51:34.530537 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a85cbb0-5958-4387-a8ff-39646cbc1baf None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:51:34.530693 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a85cbb0-5958-4387-a8ff-39646cbc1baf None None] PATH_INFO: `/` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:51:34.531923 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 755/1506] 10.222.0.57 () {52 vars in 830 bytes} [Fri Sep 16 07:51:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 07:51:34.536209 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be123d86-7890-4c92-a69d-3a3dccb2e660 service cinder] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:51:34.537496 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-be123d86-7890-4c92-a69d-3a3dccb2e660 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:51:34.634630 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be123d86-7890-4c92-a69d-3a3dccb2e660 service cinder] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:51:34.728066 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85403c5b-ed53-480a-84f9-90e311343b43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:51:34.728066 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85403c5b-ed53-480a-84f9-90e311343b43 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:51:34.728623 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85403c5b-ed53-480a-84f9-90e311343b43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:51:34.728623 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85403c5b-ed53-480a-84f9-90e311343b43 admin admin] PATH_INFO: `/v3/users/066a3fbab43b40ec92e6ab77448a91d8` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:51:34.745633 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85403c5b-ed53-480a-84f9-90e311343b43 admin admin] RBAC: Authorizing `identity:delete_user(user_id=066a3fbab43b40ec92e6ab77448a91d8)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:51:34.746715 dv-cinder-740146-20-smb devstack@keystone.service[81431]: WARNING py.warnings [None req-85403c5b-ed53-480a-84f9-90e311343b43 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 16 07:51:34.746715 dv-cinder-740146-20-smb devstack@keystone.service[81431]: warnings.warn(msg) Sep 16 07:51:34.746715 dv-cinder-740146-20-smb devstack@keystone.service[81431]: Sep 16 07:51:34.748323 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85403c5b-ed53-480a-84f9-90e311343b43 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:51:34.758650 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:51:34.814890 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-85403c5b-ed53-480a-84f9-90e311343b43 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '066a3fbab43b40ec92e6ab77448a91d8'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:51:34.838466 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-85403c5b-ed53-480a-84f9-90e311343b43 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '066a3fbab43b40ec92e6ab77448a91d8'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:51:34.838924 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-85403c5b-ed53-480a-84f9-90e311343b43 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '066a3fbab43b40ec92e6ab77448a91d8'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:51:34.849332 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-85403c5b-ed53-480a-84f9-90e311343b43 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '066a3fbab43b40ec92e6ab77448a91d8'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:51:34.862834 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-85403c5b-ed53-480a-84f9-90e311343b43 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '066a3fbab43b40ec92e6ab77448a91d8'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:51:34.869168 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 752/1507] 10.222.0.57 () {58 vars in 1224 bytes} [Fri Sep 16 07:51:34 2022] DELETE /identity/v3/users/066a3fbab43b40ec92e6ab77448a91d8 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 07:51:34.873815 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d79481-5f29-4c5b-bad2-7cbdb017a8d3 None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:51:34.874108 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d79481-5f29-4c5b-bad2-7cbdb017a8d3 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:51:34.874384 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d79481-5f29-4c5b-bad2-7cbdb017a8d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:51:34.930855 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-52d79481-5f29-4c5b-bad2-7cbdb017a8d3 None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:51:34.931994 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-52d79481-5f29-4c5b-bad2-7cbdb017a8d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:51:35.007237 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:51:35.020728 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 756/1508] 10.222.0.57 () {58 vars in 958 bytes} [Fri Sep 16 07:51:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 07:51:35.030258 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85403c5b-ed53-480a-84f9-90e311343b43 admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:51:35.031467 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-85403c5b-ed53-480a-84f9-90e311343b43 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:51:35.131366 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85403c5b-ed53-480a-84f9-90e311343b43 admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:51:35.185626 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:51:35.208337 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0764c2ba-bc23-4c9f-a0a5-e6acf8aec771 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1062e457207a41e4ba4f0a0c4bf36f1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4735f453c0c24cc4a1c14e9ac84a0b46', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:51:35.208949 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0764c2ba-bc23-4c9f-a0a5-e6acf8aec771 service neutron] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:51:35.209225 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0764c2ba-bc23-4c9f-a0a5-e6acf8aec771 service neutron] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:51:35.209493 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0764c2ba-bc23-4c9f-a0a5-e6acf8aec771 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:51:35.211168 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-0764c2ba-bc23-4c9f-a0a5-e6acf8aec771 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:51:35.319645 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0764c2ba-bc23-4c9f-a0a5-e6acf8aec771 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:51:35.321083 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0764c2ba-bc23-4c9f-a0a5-e6acf8aec771 service neutron] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:51:35.339867 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 753/1509] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Sep 16 07:51:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 07:51:35.662454 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d79481-5f29-4c5b-bad2-7cbdb017a8d3 None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:51:35.663535 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-52d79481-5f29-4c5b-bad2-7cbdb017a8d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:51:35.675118 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d79481-5f29-4c5b-bad2-7cbdb017a8d3 None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:51:35.788893 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9575421-d8e9-48ea-85bf-8d52624618e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:51:35.789527 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9575421-d8e9-48ea-85bf-8d52624618e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:51:35.789837 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9575421-d8e9-48ea-85bf-8d52624618e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:51:35.790105 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9575421-d8e9-48ea-85bf-8d52624618e1 admin admin] PATH_INFO: `/v3/projects/9cbe7fdac79e478e9f854f0b6c97eb23` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:51:35.800841 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9575421-d8e9-48ea-85bf-8d52624618e1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9cbe7fdac79e478e9f854f0b6c97eb23)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:51:35.801894 dv-cinder-740146-20-smb devstack@keystone.service[81430]: WARNING py.warnings [None req-b9575421-d8e9-48ea-85bf-8d52624618e1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 16 07:51:35.801894 dv-cinder-740146-20-smb devstack@keystone.service[81430]: warnings.warn(msg) Sep 16 07:51:35.801894 dv-cinder-740146-20-smb devstack@keystone.service[81430]: Sep 16 07:51:35.803079 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9575421-d8e9-48ea-85bf-8d52624618e1 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:51:35.863514 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-b9575421-d8e9-48ea-85bf-8d52624618e1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9cbe7fdac79e478e9f854f0b6c97eb23', 'request_id': 'req-b9575421-d8e9-48ea-85bf-8d52624618e1'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:51:35.874095 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-b9575421-d8e9-48ea-85bf-8d52624618e1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9cbe7fdac79e478e9f854f0b6c97eb23', 'request_id': 'req-b9575421-d8e9-48ea-85bf-8d52624618e1'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:51:35.881851 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-b9575421-d8e9-48ea-85bf-8d52624618e1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9cbe7fdac79e478e9f854f0b6c97eb23', 'request_id': 'req-b9575421-d8e9-48ea-85bf-8d52624618e1'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:51:35.912883 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-b9575421-d8e9-48ea-85bf-8d52624618e1 admin admin] The token cache is being invalidate because project 9cbe7fdac79e478e9f854f0b6c97eb23 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81430) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 07:51:35.913169 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-b9575421-d8e9-48ea-85bf-8d52624618e1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:51:35.913603 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-b9575421-d8e9-48ea-85bf-8d52624618e1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:51:35.915039 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 757/1510] 10.222.0.57 () {58 vars in 1233 bytes} [Fri Sep 16 07:51:35 2022] DELETE /identity/v3/projects/9cbe7fdac79e478e9f854f0b6c97eb23 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 07:51:45.337620 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=62 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:51:45.910805 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:53:07.803298 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2589482-ed1f-4c2c-adb1-605184518286 None None] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:53:07.803918 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2589482-ed1f-4c2c-adb1-605184518286 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:53:07.803918 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2589482-ed1f-4c2c-adb1-605184518286 None None] PATH_INFO: `/` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:53:07.805195 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 754/1511] 127.0.0.1 () {54 vars in 901 bytes} [Fri Sep 16 07:53:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 07:53:07.810198 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cadf1e0-4ce1-401a-97b9-ea37432afd30 None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:53:07.810671 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cadf1e0-4ce1-401a-97b9-ea37432afd30 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:53:07.810772 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cadf1e0-4ce1-401a-97b9-ea37432afd30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:53:07.890514 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-1cadf1e0-4ce1-401a-97b9-ea37432afd30 None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:53:07.891717 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-1cadf1e0-4ce1-401a-97b9-ea37432afd30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:53:08.006815 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 758/1512] 127.0.0.1 () {58 vars in 998 bytes} [Fri Sep 16 07:53:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 07:53:08.161872 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2589482-ed1f-4c2c-adb1-605184518286 None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:53:08.163969 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-a2589482-ed1f-4c2c-adb1-605184518286 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:53:08.284234 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2589482-ed1f-4c2c-adb1-605184518286 None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:53:08.290671 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eddffe6-29b3-4c1d-865c-52a26ee8ed88 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bec4d9b08514461a1bf63c6b88f53b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4735f453c0c24cc4a1c14e9ac84a0b46', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:53:08.291280 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eddffe6-29b3-4c1d-865c-52a26ee8ed88 service nova] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:53:08.291562 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eddffe6-29b3-4c1d-865c-52a26ee8ed88 service nova] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:53:08.291837 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eddffe6-29b3-4c1d-865c-52a26ee8ed88 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:53:08.299910 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eddffe6-29b3-4c1d-865c-52a26ee8ed88 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:53:08.302288 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eddffe6-29b3-4c1d-865c-52a26ee8ed88 service nova] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:53:08.311781 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 755/1513] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Sep 16 07:53:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 07:53:09.394642 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9917db-d85d-4541-a3f2-7a72f48387d1 None None] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:53:09.395171 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9917db-d85d-4541-a3f2-7a72f48387d1 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:53:09.395270 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9917db-d85d-4541-a3f2-7a72f48387d1 None None] PATH_INFO: `/` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:53:09.396531 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 759/1514] 127.0.0.1 () {54 vars in 901 bytes} [Fri Sep 16 07:53:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 07:53:09.402658 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c857dd-4dca-4b1f-afe6-1555b6e17116 None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:53:09.403116 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c857dd-4dca-4b1f-afe6-1555b6e17116 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:53:09.403229 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c857dd-4dca-4b1f-afe6-1555b6e17116 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:53:09.422467 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-08c857dd-4dca-4b1f-afe6-1555b6e17116 None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:53:09.423649 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-08c857dd-4dca-4b1f-afe6-1555b6e17116 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:53:09.431811 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 756/1515] 127.0.0.1 () {58 vars in 998 bytes} [Fri Sep 16 07:53:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 16 07:53:09.587973 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9917db-d85d-4541-a3f2-7a72f48387d1 None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:53:09.603347 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9917db-d85d-4541-a3f2-7a72f48387d1 None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:53:09.608815 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df3ed0c-cace-46b3-a0db-e5ef38899d95 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bec4d9b08514461a1bf63c6b88f53b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4735f453c0c24cc4a1c14e9ac84a0b46', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:53:09.609421 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df3ed0c-cace-46b3-a0db-e5ef38899d95 service nova] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:53:09.609700 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df3ed0c-cace-46b3-a0db-e5ef38899d95 service nova] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:53:09.610005 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df3ed0c-cace-46b3-a0db-e5ef38899d95 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:53:09.619079 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df3ed0c-cace-46b3-a0db-e5ef38899d95 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:53:09.620754 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df3ed0c-cace-46b3-a0db-e5ef38899d95 service nova] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:53:09.630984 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 760/1516] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Sep 16 07:53:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 07:53:09.990243 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47413806-a128-4c5c-a1e1-e064705c6646 None None] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:53:09.990457 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47413806-a128-4c5c-a1e1-e064705c6646 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:53:09.990702 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47413806-a128-4c5c-a1e1-e064705c6646 None None] PATH_INFO: `/v3` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:53:09.991990 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 757/1517] 10.222.0.33 () {54 vars in 925 bytes} [Fri Sep 16 07:53:09 2022] GET /identity/v3 => generated 255 bytes in 4 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:53:09.998040 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd33bd5c-1ffc-453d-a865-54bf79724907 None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:53:09.998333 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd33bd5c-1ffc-453d-a865-54bf79724907 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:53:09.998647 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd33bd5c-1ffc-453d-a865-54bf79724907 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:53:10.058535 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-bd33bd5c-1ffc-453d-a865-54bf79724907 None None] MFA Rules not processed for user `c7d4ccdd6ef9400ba9e344df0964da1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:53:10.059728 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-bd33bd5c-1ffc-453d-a865-54bf79724907 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:53:10.076710 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:53:10.133156 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 761/1518] 10.222.0.33 () {58 vars in 1015 bytes} [Fri Sep 16 07:53:09 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 07:53:13.661951 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97d60be-35fb-4a4e-b317-ab769ac24e08 None None] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:53:13.662395 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97d60be-35fb-4a4e-b317-ab769ac24e08 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:53:13.662494 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97d60be-35fb-4a4e-b317-ab769ac24e08 None None] PATH_INFO: `/` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:53:13.663817 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 758/1519] 10.222.0.57 () {54 vars in 961 bytes} [Fri Sep 16 07:53:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 07:53:13.669491 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b101f02-18e4-4125-a10b-ff5c7dd7376a None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:53:13.669957 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b101f02-18e4-4125-a10b-ff5c7dd7376a None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:53:13.670076 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b101f02-18e4-4125-a10b-ff5c7dd7376a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:53:13.692700 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-5b101f02-18e4-4125-a10b-ff5c7dd7376a None None] MFA Rules not processed for user `c7d4ccdd6ef9400ba9e344df0964da1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:53:13.693931 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-5b101f02-18e4-4125-a10b-ff5c7dd7376a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:53:13.702373 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 762/1520] 10.222.0.57 () {58 vars in 1058 bytes} [Fri Sep 16 07:53:13 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 07:53:13.710618 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97d60be-35fb-4a4e-b317-ab769ac24e08 None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:53:13.724467 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97d60be-35fb-4a4e-b317-ab769ac24e08 None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:53:13.729464 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186ee880-92e0-4ccd-ae13-d80292d73b6e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7d4ccdd6ef9400ba9e344df0964da1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4735f453c0c24cc4a1c14e9ac84a0b46', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:53:13.730088 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186ee880-92e0-4ccd-ae13-d80292d73b6e service placement] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:53:13.730366 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186ee880-92e0-4ccd-ae13-d80292d73b6e service placement] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:53:13.730635 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186ee880-92e0-4ccd-ae13-d80292d73b6e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:53:13.739159 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186ee880-92e0-4ccd-ae13-d80292d73b6e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:53:13.740765 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186ee880-92e0-4ccd-ae13-d80292d73b6e service placement] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:53:13.751045 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 759/1521] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Sep 16 07:53:13 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 07:53:21.116399 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb0e470-d472-480b-8292-0862c40a6a4d None None] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:53:21.116940 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb0e470-d472-480b-8292-0862c40a6a4d None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:53:21.116940 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb0e470-d472-480b-8292-0862c40a6a4d None None] PATH_INFO: `/` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:53:21.118308 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 763/1522] 127.0.0.1 () {54 vars in 901 bytes} [Fri Sep 16 07:53:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 07:53:21.124953 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e66bf7-8923-48d8-b62c-3ad1942826a3 None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:53:21.125408 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e66bf7-8923-48d8-b62c-3ad1942826a3 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:53:21.125523 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e66bf7-8923-48d8-b62c-3ad1942826a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:53:21.144897 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-e4e66bf7-8923-48d8-b62c-3ad1942826a3 None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:53:21.146932 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-e4e66bf7-8923-48d8-b62c-3ad1942826a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:53:21.154727 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 760/1523] 127.0.0.1 () {58 vars in 998 bytes} [Fri Sep 16 07:53:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 07:53:21.310087 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb0e470-d472-480b-8292-0862c40a6a4d None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:53:21.324195 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb0e470-d472-480b-8292-0862c40a6a4d None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:53:21.329464 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a70f769-9dce-435b-979d-14255d664055 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bec4d9b08514461a1bf63c6b88f53b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4735f453c0c24cc4a1c14e9ac84a0b46', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:53:21.330104 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a70f769-9dce-435b-979d-14255d664055 service nova] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:53:21.330384 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a70f769-9dce-435b-979d-14255d664055 service nova] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:53:21.330654 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a70f769-9dce-435b-979d-14255d664055 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:53:21.339012 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a70f769-9dce-435b-979d-14255d664055 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:53:21.340579 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a70f769-9dce-435b-979d-14255d664055 service nova] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:53:21.350557 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 764/1524] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Sep 16 07:53:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 07:53:22.416458 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bb43f4-5503-440d-8f5e-d47d42ea677b None None] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:53:22.416999 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bb43f4-5503-440d-8f5e-d47d42ea677b None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:53:22.416999 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bb43f4-5503-440d-8f5e-d47d42ea677b None None] PATH_INFO: `/` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:53:22.418295 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 761/1525] 127.0.0.1 () {54 vars in 901 bytes} [Fri Sep 16 07:53:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 07:53:22.424271 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a282173-fdef-4f7b-979f-904d271aae4c None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:53:22.424657 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a282173-fdef-4f7b-979f-904d271aae4c None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:53:22.424831 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a282173-fdef-4f7b-979f-904d271aae4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:53:22.444833 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-2a282173-fdef-4f7b-979f-904d271aae4c None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:53:22.446067 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-2a282173-fdef-4f7b-979f-904d271aae4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:53:22.454191 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 765/1526] 127.0.0.1 () {58 vars in 998 bytes} [Fri Sep 16 07:53:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 07:53:22.605797 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bb43f4-5503-440d-8f5e-d47d42ea677b None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:53:22.620201 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bb43f4-5503-440d-8f5e-d47d42ea677b None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:53:22.625963 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c243c5-cf8f-442d-b456-7dfc384afff8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bec4d9b08514461a1bf63c6b88f53b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4735f453c0c24cc4a1c14e9ac84a0b46', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:53:22.626553 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c243c5-cf8f-442d-b456-7dfc384afff8 service nova] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:53:22.626833 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c243c5-cf8f-442d-b456-7dfc384afff8 service nova] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:53:22.627104 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c243c5-cf8f-442d-b456-7dfc384afff8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:53:22.636094 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c243c5-cf8f-442d-b456-7dfc384afff8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:53:22.637683 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c243c5-cf8f-442d-b456-7dfc384afff8 service nova] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:53:22.647918 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 762/1527] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Sep 16 07:53:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 07:53:26.673191 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc5e1e6-6474-4075-997d-33ee1ae3d863 None None] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:53:26.673807 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc5e1e6-6474-4075-997d-33ee1ae3d863 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:53:26.673807 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc5e1e6-6474-4075-997d-33ee1ae3d863 None None] PATH_INFO: `/` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:53:26.675075 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 766/1528] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 16 07:53:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 07:53:26.680260 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91080199-3f6d-4f49-9eb5-c1e6e7949f24 None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:53:26.680687 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91080199-3f6d-4f49-9eb5-c1e6e7949f24 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:53:26.680824 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91080199-3f6d-4f49-9eb5-c1e6e7949f24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:53:26.700240 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-91080199-3f6d-4f49-9eb5-c1e6e7949f24 None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:53:26.701428 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-91080199-3f6d-4f49-9eb5-c1e6e7949f24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:53:26.709812 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 763/1529] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 16 07:53:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 07:53:27.006243 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc5e1e6-6474-4075-997d-33ee1ae3d863 None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:53:27.007996 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-7dc5e1e6-6474-4075-997d-33ee1ae3d863 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:53:27.085058 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc5e1e6-6474-4075-997d-33ee1ae3d863 None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:53:27.088592 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b263c0b-1fb2-4339-bb36-51dfd7f6b695 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1062e457207a41e4ba4f0a0c4bf36f1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4735f453c0c24cc4a1c14e9ac84a0b46', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:53:27.089192 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b263c0b-1fb2-4339-bb36-51dfd7f6b695 service neutron] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:53:27.089475 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b263c0b-1fb2-4339-bb36-51dfd7f6b695 service neutron] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:53:27.089772 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b263c0b-1fb2-4339-bb36-51dfd7f6b695 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:53:27.098538 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b263c0b-1fb2-4339-bb36-51dfd7f6b695 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:53:27.100080 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b263c0b-1fb2-4339-bb36-51dfd7f6b695 service neutron] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:53:27.109432 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 767/1530] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Sep 16 07:53:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 07:53:29.258715 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545f13bc-d33e-4b6c-bd35-672264197d1d None None] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:53:29.259173 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545f13bc-d33e-4b6c-bd35-672264197d1d None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:53:29.259461 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545f13bc-d33e-4b6c-bd35-672264197d1d None None] PATH_INFO: `/` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:53:29.260607 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 764/1531] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 16 07:53:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 07:53:29.266161 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4d6bab-7a0f-414a-a839-7ffbb5ac1d71 None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:53:29.266652 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4d6bab-7a0f-414a-a839-7ffbb5ac1d71 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:53:29.266774 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4d6bab-7a0f-414a-a839-7ffbb5ac1d71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:53:29.286786 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-0e4d6bab-7a0f-414a-a839-7ffbb5ac1d71 None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:53:29.288662 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-0e4d6bab-7a0f-414a-a839-7ffbb5ac1d71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:53:29.296755 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 768/1532] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 16 07:53:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 07:53:29.594759 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545f13bc-d33e-4b6c-bd35-672264197d1d None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:53:29.596470 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-545f13bc-d33e-4b6c-bd35-672264197d1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:53:29.610016 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545f13bc-d33e-4b6c-bd35-672264197d1d None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:53:29.613528 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d97336-5911-450c-8c80-3049cd18dd4a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1062e457207a41e4ba4f0a0c4bf36f1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4735f453c0c24cc4a1c14e9ac84a0b46', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:53:29.614186 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d97336-5911-450c-8c80-3049cd18dd4a service neutron] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:53:29.614466 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d97336-5911-450c-8c80-3049cd18dd4a service neutron] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:53:29.614805 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d97336-5911-450c-8c80-3049cd18dd4a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:53:29.625437 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d97336-5911-450c-8c80-3049cd18dd4a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:53:29.626940 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d97336-5911-450c-8c80-3049cd18dd4a service neutron] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:53:29.637102 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 765/1533] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Sep 16 07:53:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 07:53:33.261791 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b39949-d2e2-48ab-a8db-d6240bfc1d29 None None] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:53:33.262416 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b39949-d2e2-48ab-a8db-d6240bfc1d29 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:53:33.262416 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b39949-d2e2-48ab-a8db-d6240bfc1d29 None None] PATH_INFO: `/` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:53:33.263686 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 769/1534] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 16 07:53:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 07:53:33.268846 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9906d0d7-dd1b-49de-892b-bd2eedb4b029 None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:53:33.269250 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9906d0d7-dd1b-49de-892b-bd2eedb4b029 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:53:33.269399 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9906d0d7-dd1b-49de-892b-bd2eedb4b029 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:53:33.289660 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-9906d0d7-dd1b-49de-892b-bd2eedb4b029 None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:53:33.290885 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-9906d0d7-dd1b-49de-892b-bd2eedb4b029 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:53:33.298976 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 766/1535] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 16 07:53:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 07:53:33.602212 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b39949-d2e2-48ab-a8db-d6240bfc1d29 None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:53:33.603886 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-d7b39949-d2e2-48ab-a8db-d6240bfc1d29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:53:33.668802 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:53:33.682806 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b39949-d2e2-48ab-a8db-d6240bfc1d29 None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:53:33.686405 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d13c5bb-802b-44a3-9be8-dc59ff472415 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544bf6be4c24454a013ca110c43cef2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4735f453c0c24cc4a1c14e9ac84a0b46', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:53:33.687012 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d13c5bb-802b-44a3-9be8-dc59ff472415 service cinder] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:53:33.687294 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d13c5bb-802b-44a3-9be8-dc59ff472415 service cinder] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:53:33.687568 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d13c5bb-802b-44a3-9be8-dc59ff472415 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:53:33.697203 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d13c5bb-802b-44a3-9be8-dc59ff472415 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:53:33.698656 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d13c5bb-802b-44a3-9be8-dc59ff472415 service cinder] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:53:33.707998 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 770/1536] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Sep 16 07:53:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 07:53:35.845562 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67568b93-4d0f-457e-ac40-bd61e956c6f3 None None] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:53:35.846163 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67568b93-4d0f-457e-ac40-bd61e956c6f3 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:53:35.846272 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67568b93-4d0f-457e-ac40-bd61e956c6f3 None None] PATH_INFO: `/` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:53:35.847554 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 767/1537] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 16 07:53:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 07:53:35.853440 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b8eab3-e28b-4a3b-a62f-13e973ceef4d None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:53:35.853891 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b8eab3-e28b-4a3b-a62f-13e973ceef4d None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:53:35.854020 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b8eab3-e28b-4a3b-a62f-13e973ceef4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:53:35.874442 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-89b8eab3-e28b-4a3b-a62f-13e973ceef4d None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:53:35.875643 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-89b8eab3-e28b-4a3b-a62f-13e973ceef4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:53:35.883838 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 771/1538] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 16 07:53:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 07:53:36.185423 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67568b93-4d0f-457e-ac40-bd61e956c6f3 None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:53:36.187116 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-67568b93-4d0f-457e-ac40-bd61e956c6f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:53:36.194791 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=84 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:53:36.201354 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67568b93-4d0f-457e-ac40-bd61e956c6f3 None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:53:36.205745 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8113ae-d6ea-4bd8-a976-fd8386536235 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544bf6be4c24454a013ca110c43cef2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4735f453c0c24cc4a1c14e9ac84a0b46', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:53:36.206359 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8113ae-d6ea-4bd8-a976-fd8386536235 service cinder] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:53:36.206640 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8113ae-d6ea-4bd8-a976-fd8386536235 service cinder] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:53:36.206914 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8113ae-d6ea-4bd8-a976-fd8386536235 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:53:36.217549 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8113ae-d6ea-4bd8-a976-fd8386536235 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:53:36.219342 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8113ae-d6ea-4bd8-a976-fd8386536235 service cinder] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:53:36.230933 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 768/1539] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Sep 16 07:53:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 07:53:45.869235 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=11 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:53:46.226268 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=5 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:55:03.048988 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2af231-2a8e-4c19-80ff-336fcce6e902 None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:03.049680 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2af231-2a8e-4c19-80ff-336fcce6e902 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:03.049680 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2af231-2a8e-4c19-80ff-336fcce6e902 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:03.072121 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-ba2af231-2a8e-4c19-80ff-336fcce6e902 None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:55:03.073318 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-ba2af231-2a8e-4c19-80ff-336fcce6e902 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:55:03.087769 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 772/1540] 10.222.0.57 () {58 vars in 958 bytes} [Fri Sep 16 07:55:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 07:55:03.096656 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d511931-7d07-40da-9df0-63baf269f5c4 None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:03.097211 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d511931-7d07-40da-9df0-63baf269f5c4 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:03.097211 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d511931-7d07-40da-9df0-63baf269f5c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:03.126921 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-5d511931-7d07-40da-9df0-63baf269f5c4 None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:55:03.128075 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-5d511931-7d07-40da-9df0-63baf269f5c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:55:03.140875 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 769/1541] 10.222.0.57 () {58 vars in 958 bytes} [Fri Sep 16 07:55:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 16 07:55:03.145649 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2af231-2a8e-4c19-80ff-336fcce6e902 None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:55:03.159336 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2af231-2a8e-4c19-80ff-336fcce6e902 None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:55:03.163483 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe4ad4b-6320-405a-8222-3ae5b1f0ca2b None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:03.163765 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe4ad4b-6320-405a-8222-3ae5b1f0ca2b None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:03.164033 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe4ad4b-6320-405a-8222-3ae5b1f0ca2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:03.170934 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5535f612-bc01-4ce8-9c51-d7070eceb39e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:55:03.171568 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5535f612-bc01-4ce8-9c51-d7070eceb39e admin admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:03.171847 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5535f612-bc01-4ce8-9c51-d7070eceb39e admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:03.172116 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5535f612-bc01-4ce8-9c51-d7070eceb39e admin admin] PATH_INFO: `/v3/domains` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:03.172782 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5535f612-bc01-4ce8-9c51-d7070eceb39e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:55:03.173082 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5535f612-bc01-4ce8-9c51-d7070eceb39e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:55:03.176309 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5535f612-bc01-4ce8-9c51-d7070eceb39e admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:55:03.211478 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 773/1542] 10.222.0.57 () {58 vars in 1153 bytes} [Fri Sep 16 07:55:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 07:55:03.212732 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-bfe4ad4b-6320-405a-8222-3ae5b1f0ca2b None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:55:03.213981 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-bfe4ad4b-6320-405a-8222-3ae5b1f0ca2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:55:03.228449 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 770/1543] 10.222.0.57 () {58 vars in 958 bytes} [Fri Sep 16 07:55:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 16 07:55:03.231338 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5535f612-bc01-4ce8-9c51-d7070eceb39e admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:55:03.238803 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c3b8b6-1ce6-4aa0-a5da-d2cdf8b277e1 None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:03.239295 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c3b8b6-1ce6-4aa0-a5da-d2cdf8b277e1 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:03.239646 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c3b8b6-1ce6-4aa0-a5da-d2cdf8b277e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:03.250844 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5535f612-bc01-4ce8-9c51-d7070eceb39e admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:55:03.258197 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1b7fd6-7aba-4502-ae49-9f0b84dc7aa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:55:03.258814 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1b7fd6-7aba-4502-ae49-9f0b84dc7aa2 admin admin] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:03.259093 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1b7fd6-7aba-4502-ae49-9f0b84dc7aa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:03.259363 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1b7fd6-7aba-4502-ae49-9f0b84dc7aa2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:03.260009 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1b7fd6-7aba-4502-ae49-9f0b84dc7aa2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:55:03.261032 dv-cinder-740146-20-smb devstack@keystone.service[81430]: WARNING py.warnings [None req-af1b7fd6-7aba-4502-ae49-9f0b84dc7aa2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 16 07:55:03.261032 dv-cinder-740146-20-smb devstack@keystone.service[81430]: warnings.warn(msg) Sep 16 07:55:03.261032 dv-cinder-740146-20-smb devstack@keystone.service[81430]: Sep 16 07:55:03.263617 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1b7fd6-7aba-4502-ae49-9f0b84dc7aa2 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:55:03.287810 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-c7c3b8b6-1ce6-4aa0-a5da-d2cdf8b277e1 None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:55:03.289012 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-c7c3b8b6-1ce6-4aa0-a5da-d2cdf8b277e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:55:03.310060 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 771/1544] 10.222.0.57 () {58 vars in 958 bytes} [Fri Sep 16 07:55:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 07:55:03.311334 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1985328d-80f5-49dc-aa46-970bb750fe1c None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:03.311618 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1985328d-80f5-49dc-aa46-970bb750fe1c None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:03.311891 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1985328d-80f5-49dc-aa46-970bb750fe1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:03.355866 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 774/1545] 10.222.0.57 () {60 vars in 1153 bytes} [Fri Sep 16 07:55:03 2022] POST /identity/v3/projects => generated 393 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 07:55:03.356744 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1b7fd6-7aba-4502-ae49-9f0b84dc7aa2 admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:55:03.372396 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-1985328d-80f5-49dc-aa46-970bb750fe1c None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:55:03.373655 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-1985328d-80f5-49dc-aa46-970bb750fe1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:55:03.463701 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 772/1546] 10.222.0.57 () {58 vars in 958 bytes} [Fri Sep 16 07:55:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 07:55:03.464912 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4942a2-8ab5-46a9-a085-340fd99518f5 None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:03.465196 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4942a2-8ab5-46a9-a085-340fd99518f5 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:03.465468 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4942a2-8ab5-46a9-a085-340fd99518f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:03.477623 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1b7fd6-7aba-4502-ae49-9f0b84dc7aa2 admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:55:03.484711 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188dd4ca-c6ca-47d9-8eab-73f213dcaee5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:55:03.485322 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188dd4ca-c6ca-47d9-8eab-73f213dcaee5 admin admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:03.485599 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188dd4ca-c6ca-47d9-8eab-73f213dcaee5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:03.485949 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188dd4ca-c6ca-47d9-8eab-73f213dcaee5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:03.486928 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188dd4ca-c6ca-47d9-8eab-73f213dcaee5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:55:03.487388 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188dd4ca-c6ca-47d9-8eab-73f213dcaee5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:55:03.490594 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188dd4ca-c6ca-47d9-8eab-73f213dcaee5 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:55:03.496042 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-aa4942a2-8ab5-46a9-a085-340fd99518f5 None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:55:03.497250 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-aa4942a2-8ab5-46a9-a085-340fd99518f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:55:03.505254 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 775/1547] 10.222.0.57 () {58 vars in 1153 bytes} [Fri Sep 16 07:55:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:55:03.506604 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a43d27-3ee8-4e80-a611-8891667bbc27 None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:03.506895 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a43d27-3ee8-4e80-a611-8891667bbc27 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:03.507167 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a43d27-3ee8-4e80-a611-8891667bbc27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:03.519300 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 773/1548] 10.222.0.57 () {58 vars in 958 bytes} [Fri Sep 16 07:55:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 07:55:03.519300 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4942a2-8ab5-46a9-a085-340fd99518f5 None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:55:03.529614 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-94a43d27-3ee8-4e80-a611-8891667bbc27 None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:55:03.530115 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4942a2-8ab5-46a9-a085-340fd99518f5 None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:55:03.530836 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-94a43d27-3ee8-4e80-a611-8891667bbc27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:55:03.535656 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0a47b1-b9bb-4bf4-8330-411566add0ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:55:03.536307 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0a47b1-b9bb-4bf4-8330-411566add0ab admin admin] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:03.536701 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0a47b1-b9bb-4bf4-8330-411566add0ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:03.537061 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0a47b1-b9bb-4bf4-8330-411566add0ab admin admin] PATH_INFO: `/v3/users` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:03.537932 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0a47b1-b9bb-4bf4-8330-411566add0ab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:55:03.538939 dv-cinder-740146-20-smb devstack@keystone.service[81431]: WARNING py.warnings [None req-6e0a47b1-b9bb-4bf4-8330-411566add0ab admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 16 07:55:03.538939 dv-cinder-740146-20-smb devstack@keystone.service[81431]: warnings.warn(msg) Sep 16 07:55:03.538939 dv-cinder-740146-20-smb devstack@keystone.service[81431]: Sep 16 07:55:03.543897 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 776/1549] 10.222.0.57 () {58 vars in 958 bytes} [Fri Sep 16 07:55:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 07:55:03.544067 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0a47b1-b9bb-4bf4-8330-411566add0ab admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:55:03.544181 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5d049f-7840-4537-bd3d-529f3087da4b None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:03.544181 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5d049f-7840-4537-bd3d-529f3087da4b None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:03.544181 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5d049f-7840-4537-bd3d-529f3087da4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:03.564287 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 774/1550] 10.222.0.57 () {60 vars in 1144 bytes} [Fri Sep 16 07:55:03 2022] POST /identity/v3/users => generated 297 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 07:55:03.565516 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f08d189-baf0-4840-b0c3-88e37e4dcb79 None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:03.565663 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-3d5d049f-7840-4537-bd3d-529f3087da4b None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:55:03.565875 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f08d189-baf0-4840-b0c3-88e37e4dcb79 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:03.566099 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f08d189-baf0-4840-b0c3-88e37e4dcb79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:03.567407 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-3d5d049f-7840-4537-bd3d-529f3087da4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:55:03.575525 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 777/1551] 10.222.0.57 () {58 vars in 958 bytes} [Fri Sep 16 07:55:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 07:55:03.576825 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2684d181-5047-41a4-843a-62f152b64829 None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:03.577117 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2684d181-5047-41a4-843a-62f152b64829 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:03.577396 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2684d181-5047-41a4-843a-62f152b64829 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:03.587464 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-6f08d189-baf0-4840-b0c3-88e37e4dcb79 None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:55:03.588713 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-6f08d189-baf0-4840-b0c3-88e37e4dcb79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:55:03.596409 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 775/1552] 10.222.0.57 () {58 vars in 958 bytes} [Fri Sep 16 07:55:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 07:55:03.596843 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-2684d181-5047-41a4-843a-62f152b64829 None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:55:03.597160 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f08d189-baf0-4840-b0c3-88e37e4dcb79 None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:55:03.598060 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-2684d181-5047-41a4-843a-62f152b64829 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:55:03.606320 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 778/1553] 10.222.0.57 () {58 vars in 958 bytes} [Fri Sep 16 07:55:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 07:55:03.606619 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f08d189-baf0-4840-b0c3-88e37e4dcb79 None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:55:03.607557 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ef8f73-96f7-4780-afec-b3032cacf248 None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:03.607794 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ef8f73-96f7-4780-afec-b3032cacf248 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:03.608074 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ef8f73-96f7-4780-afec-b3032cacf248 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:03.611101 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22f3779-c059-495d-bf1e-7007623900b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:55:03.611693 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22f3779-c059-495d-bf1e-7007623900b5 admin admin] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:03.612022 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22f3779-c059-495d-bf1e-7007623900b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:03.612296 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22f3779-c059-495d-bf1e-7007623900b5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:03.612911 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22f3779-c059-495d-bf1e-7007623900b5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:55:03.614865 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22f3779-c059-495d-bf1e-7007623900b5 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:55:03.629484 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-a7ef8f73-96f7-4780-afec-b3032cacf248 None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:55:03.630735 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-a7ef8f73-96f7-4780-afec-b3032cacf248 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:55:03.639030 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 779/1554] 10.222.0.57 () {58 vars in 958 bytes} [Fri Sep 16 07:55:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 07:55:03.640056 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1d6a6f-bb2c-49ab-a209-69809c3d9b80 None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:03.640337 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1d6a6f-bb2c-49ab-a209-69809c3d9b80 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:03.640602 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1d6a6f-bb2c-49ab-a209-69809c3d9b80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:03.646985 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 776/1555] 10.222.0.57 () {60 vars in 1153 bytes} [Fri Sep 16 07:55:03 2022] POST /identity/v3/projects => generated 389 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 07:55:03.648335 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc15c29b-c83a-46f2-9253-315bea78354f None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:03.648933 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc15c29b-c83a-46f2-9253-315bea78354f None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:03.649204 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc15c29b-c83a-46f2-9253-315bea78354f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:03.660408 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-ac1d6a6f-bb2c-49ab-a209-69809c3d9b80 None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:55:03.661582 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-ac1d6a6f-bb2c-49ab-a209-69809c3d9b80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:55:03.669087 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-cc15c29b-c83a-46f2-9253-315bea78354f None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:55:03.670273 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-cc15c29b-c83a-46f2-9253-315bea78354f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:55:03.725815 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 780/1556] 10.222.0.57 () {58 vars in 958 bytes} [Fri Sep 16 07:55:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 07:55:03.725815 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1d6a6f-bb2c-49ab-a209-69809c3d9b80 None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:55:03.733604 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 777/1557] 10.222.0.57 () {58 vars in 958 bytes} [Fri Sep 16 07:55:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 07:55:03.733847 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1d6a6f-bb2c-49ab-a209-69809c3d9b80 None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:55:03.734889 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9c2407-7dd0-468a-bbcf-39dd3469c24b None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:03.735265 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9c2407-7dd0-468a-bbcf-39dd3469c24b None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:03.735527 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9c2407-7dd0-468a-bbcf-39dd3469c24b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:03.741184 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc897b9-778b-40bb-8c5f-f31adba55a87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:55:03.741822 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc897b9-778b-40bb-8c5f-f31adba55a87 admin admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:03.742115 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc897b9-778b-40bb-8c5f-f31adba55a87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:03.742370 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc897b9-778b-40bb-8c5f-f31adba55a87 admin admin] PATH_INFO: `/v3/roles` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:03.743032 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc897b9-778b-40bb-8c5f-f31adba55a87 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:55:03.744873 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc897b9-778b-40bb-8c5f-f31adba55a87 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:55:03.755643 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-1b9c2407-7dd0-468a-bbcf-39dd3469c24b None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:55:03.755800 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 781/1558] 10.222.0.57 () {58 vars in 1122 bytes} [Fri Sep 16 07:55:03 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 07:55:03.756515 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc897b9-778b-40bb-8c5f-f31adba55a87 admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:55:03.756871 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-1b9c2407-7dd0-468a-bbcf-39dd3469c24b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:55:03.765188 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 778/1559] 10.222.0.57 () {58 vars in 958 bytes} [Fri Sep 16 07:55:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 07:55:03.766422 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c3af72-3304-4316-bef8-c68c0e3e61ac None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:03.766707 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c3af72-3304-4316-bef8-c68c0e3e61ac None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:03.766824 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc897b9-778b-40bb-8c5f-f31adba55a87 admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:55:03.767002 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c3af72-3304-4316-bef8-c68c0e3e61ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:03.772510 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3b00ef-e54b-4c74-a8ec-962b68a24a71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:55:03.773100 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3b00ef-e54b-4c74-a8ec-962b68a24a71 admin admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:03.773376 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3b00ef-e54b-4c74-a8ec-962b68a24a71 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:03.773646 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3b00ef-e54b-4c74-a8ec-962b68a24a71 admin admin] PATH_INFO: `/v3/domains` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:03.774315 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3b00ef-e54b-4c74-a8ec-962b68a24a71 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:55:03.774614 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3b00ef-e54b-4c74-a8ec-962b68a24a71 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:55:03.776222 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3b00ef-e54b-4c74-a8ec-962b68a24a71 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:55:03.778249 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:55:03.788599 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-a1c3af72-3304-4316-bef8-c68c0e3e61ac None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:55:03.789880 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-a1c3af72-3304-4316-bef8-c68c0e3e61ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:55:03.799351 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 782/1560] 10.222.0.57 () {58 vars in 1153 bytes} [Fri Sep 16 07:55:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:55:03.799351 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3b00ef-e54b-4c74-a8ec-962b68a24a71 admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:55:03.805104 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 779/1561] 10.222.0.57 () {58 vars in 958 bytes} [Fri Sep 16 07:55:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 07:55:03.805892 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c3af72-3304-4316-bef8-c68c0e3e61ac None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:55:03.806342 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3b00ef-e54b-4c74-a8ec-962b68a24a71 admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:55:03.811896 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0178dfa-3f6e-40df-bad0-8d2ce536893c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:55:03.812594 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0178dfa-3f6e-40df-bad0-8d2ce536893c admin admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:03.812909 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0178dfa-3f6e-40df-bad0-8d2ce536893c admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:03.813209 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0178dfa-3f6e-40df-bad0-8d2ce536893c admin admin] PATH_INFO: `/v3/domains` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:03.814076 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0178dfa-3f6e-40df-bad0-8d2ce536893c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:55:03.814406 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0178dfa-3f6e-40df-bad0-8d2ce536893c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:55:03.816083 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0178dfa-3f6e-40df-bad0-8d2ce536893c admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:55:03.816506 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c3af72-3304-4316-bef8-c68c0e3e61ac None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:55:03.821213 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f375c671-6332-474d-ae4c-b9eaca1b12a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:55:03.821834 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f375c671-6332-474d-ae4c-b9eaca1b12a3 admin admin] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:03.822114 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f375c671-6332-474d-ae4c-b9eaca1b12a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:03.822409 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f375c671-6332-474d-ae4c-b9eaca1b12a3 admin admin] PATH_INFO: `/v3/users` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:03.823025 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f375c671-6332-474d-ae4c-b9eaca1b12a3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:55:03.824903 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f375c671-6332-474d-ae4c-b9eaca1b12a3 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:55:03.828479 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 783/1562] 10.222.0.57 () {58 vars in 1153 bytes} [Fri Sep 16 07:55:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:55:03.829325 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0178dfa-3f6e-40df-bad0-8d2ce536893c admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:55:03.841051 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0178dfa-3f6e-40df-bad0-8d2ce536893c admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:55:03.842428 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:55:03.846045 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06099b87-eb41-47ce-819f-7cfbb522d3f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:55:03.846646 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06099b87-eb41-47ce-819f-7cfbb522d3f8 admin admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:03.846931 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06099b87-eb41-47ce-819f-7cfbb522d3f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:03.847233 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06099b87-eb41-47ce-819f-7cfbb522d3f8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:03.848503 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06099b87-eb41-47ce-819f-7cfbb522d3f8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:55:03.848814 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06099b87-eb41-47ce-819f-7cfbb522d3f8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:55:03.849925 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 780/1563] 10.222.0.57 () {60 vars in 1144 bytes} [Fri Sep 16 07:55:03 2022] POST /identity/v3/users => generated 295 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 07:55:03.850431 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06099b87-eb41-47ce-819f-7cfbb522d3f8 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:55:03.851475 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c96ad9-9b3d-41cb-af56-e41cf48ff16e None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:03.852090 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c96ad9-9b3d-41cb-af56-e41cf48ff16e None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:03.853408 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c96ad9-9b3d-41cb-af56-e41cf48ff16e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:03.863145 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 784/1564] 10.222.0.57 () {58 vars in 1153 bytes} [Fri Sep 16 07:55:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:55:03.864044 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06099b87-eb41-47ce-819f-7cfbb522d3f8 admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:55:03.872383 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-e6c96ad9-9b3d-41cb-af56-e41cf48ff16e None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:55:03.873568 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-e6c96ad9-9b3d-41cb-af56-e41cf48ff16e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:55:03.880095 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06099b87-eb41-47ce-819f-7cfbb522d3f8 admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:55:03.881616 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 781/1565] 10.222.0.57 () {58 vars in 958 bytes} [Fri Sep 16 07:55:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 07:55:03.882313 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c96ad9-9b3d-41cb-af56-e41cf48ff16e None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:55:03.888276 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959daf8e-366d-4c5d-9a9e-a7e781fb3186 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:55:03.888889 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959daf8e-366d-4c5d-9a9e-a7e781fb3186 admin admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:03.889169 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959daf8e-366d-4c5d-9a9e-a7e781fb3186 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:03.889448 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959daf8e-366d-4c5d-9a9e-a7e781fb3186 admin admin] PATH_INFO: `/v3/roles` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:03.890117 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959daf8e-366d-4c5d-9a9e-a7e781fb3186 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:55:03.891513 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c96ad9-9b3d-41cb-af56-e41cf48ff16e None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:55:03.891701 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959daf8e-366d-4c5d-9a9e-a7e781fb3186 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:55:03.896568 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c6fecc-8477-438b-ae63-48bb6d7c97a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:55:03.897153 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c6fecc-8477-438b-ae63-48bb6d7c97a3 admin admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:03.897426 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c6fecc-8477-438b-ae63-48bb6d7c97a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:03.897696 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c6fecc-8477-438b-ae63-48bb6d7c97a3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:03.898354 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c6fecc-8477-438b-ae63-48bb6d7c97a3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:55:03.898651 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c6fecc-8477-438b-ae63-48bb6d7c97a3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:55:03.899657 dv-cinder-740146-20-smb devstack@keystone.service[81431]: WARNING py.warnings [None req-a7c6fecc-8477-438b-ae63-48bb6d7c97a3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 16 07:55:03.899657 dv-cinder-740146-20-smb devstack@keystone.service[81431]: warnings.warn(msg) Sep 16 07:55:03.899657 dv-cinder-740146-20-smb devstack@keystone.service[81431]: Sep 16 07:55:03.900516 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c6fecc-8477-438b-ae63-48bb6d7c97a3 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:55:03.902593 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 785/1566] 10.222.0.57 () {58 vars in 1122 bytes} [Fri Sep 16 07:55:03 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 07:55:03.903413 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959daf8e-366d-4c5d-9a9e-a7e781fb3186 admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:55:03.913520 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959daf8e-366d-4c5d-9a9e-a7e781fb3186 admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:55:03.916214 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 782/1567] 10.222.0.57 () {58 vars in 1153 bytes} [Fri Sep 16 07:55:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:55:03.917019 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c6fecc-8477-438b-ae63-48bb6d7c97a3 admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:55:03.925542 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2802069b-930f-4b0f-8bd2-8b326f2b932f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:55:03.926461 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2802069b-930f-4b0f-8bd2-8b326f2b932f admin admin] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:03.926594 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c6fecc-8477-438b-ae63-48bb6d7c97a3 admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:55:03.926829 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2802069b-930f-4b0f-8bd2-8b326f2b932f admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:03.927104 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2802069b-930f-4b0f-8bd2-8b326f2b932f admin admin] PATH_INFO: `/v3/projects` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:03.927739 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2802069b-930f-4b0f-8bd2-8b326f2b932f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:55:03.929631 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2802069b-930f-4b0f-8bd2-8b326f2b932f admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:55:03.931116 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcd24e7-0974-43e5-be8d-393956836c77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:55:03.931700 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcd24e7-0974-43e5-be8d-393956836c77 admin admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:03.931974 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcd24e7-0974-43e5-be8d-393956836c77 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:03.932242 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcd24e7-0974-43e5-be8d-393956836c77 admin admin] PATH_INFO: `/v3/domains` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:03.932862 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dcd24e7-0974-43e5-be8d-393956836c77 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:55:03.933161 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dcd24e7-0974-43e5-be8d-393956836c77 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:55:03.934744 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dcd24e7-0974-43e5-be8d-393956836c77 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:55:03.946815 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 783/1568] 10.222.0.57 () {58 vars in 1153 bytes} [Fri Sep 16 07:55:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:55:03.947628 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcd24e7-0974-43e5-be8d-393956836c77 admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:55:03.957906 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcd24e7-0974-43e5-be8d-393956836c77 admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:55:03.963062 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 786/1569] 10.222.0.57 () {60 vars in 1153 bytes} [Fri Sep 16 07:55:03 2022] POST /identity/v3/projects => generated 367 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 07:55:03.963062 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2802069b-930f-4b0f-8bd2-8b326f2b932f admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:55:03.963329 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186798c1-c63a-460c-8912-58bf53030060 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:55:03.963329 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186798c1-c63a-460c-8912-58bf53030060 admin admin] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:03.963515 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186798c1-c63a-460c-8912-58bf53030060 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:03.963747 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186798c1-c63a-460c-8912-58bf53030060 admin admin] PATH_INFO: `/v3/projects` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:03.964395 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186798c1-c63a-460c-8912-58bf53030060 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:55:03.966298 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186798c1-c63a-460c-8912-58bf53030060 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:55:03.995124 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 784/1570] 10.222.0.57 () {60 vars in 1153 bytes} [Fri Sep 16 07:55:03 2022] POST /identity/v3/projects => generated 365 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 07:55:03.996023 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186798c1-c63a-460c-8912-58bf53030060 admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:55:04.023644 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2802069b-930f-4b0f-8bd2-8b326f2b932f admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:55:04.057674 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186798c1-c63a-460c-8912-58bf53030060 admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:55:04.062239 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5efff8e-af9f-412f-992f-a66933aa1c57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:55:04.062833 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5efff8e-af9f-412f-992f-a66933aa1c57 admin admin] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:04.063108 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5efff8e-af9f-412f-992f-a66933aa1c57 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:04.063377 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5efff8e-af9f-412f-992f-a66933aa1c57 admin admin] PATH_INFO: `/v3/projects` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:04.063994 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5efff8e-af9f-412f-992f-a66933aa1c57 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:55:04.065958 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5efff8e-af9f-412f-992f-a66933aa1c57 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:55:04.081392 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4037e067-fbd2-454c-8d1d-fc5badfa3529 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:55:04.082571 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4037e067-fbd2-454c-8d1d-fc5badfa3529 admin admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:04.082818 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4037e067-fbd2-454c-8d1d-fc5badfa3529 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:04.083097 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4037e067-fbd2-454c-8d1d-fc5badfa3529 admin admin] PATH_INFO: `/v3/roles` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:04.083824 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4037e067-fbd2-454c-8d1d-fc5badfa3529 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:55:04.085414 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4037e067-fbd2-454c-8d1d-fc5badfa3529 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:55:04.095963 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 787/1571] 10.222.0.57 () {58 vars in 1122 bytes} [Fri Sep 16 07:55:03 2022] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 07:55:04.096379 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 785/1572] 10.222.0.57 () {60 vars in 1153 bytes} [Fri Sep 16 07:55:03 2022] POST /identity/v3/projects => generated 373 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 07:55:04.096911 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4037e067-fbd2-454c-8d1d-fc5badfa3529 admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:55:04.097378 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5efff8e-af9f-412f-992f-a66933aa1c57 admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:55:04.108513 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4037e067-fbd2-454c-8d1d-fc5badfa3529 admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:55:04.141205 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:55:04.165569 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5efff8e-af9f-412f-992f-a66933aa1c57 admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:55:04.166643 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfe6d73-ca4a-4e3b-8287-ceeda754949c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:55:04.167328 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfe6d73-ca4a-4e3b-8287-ceeda754949c admin admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:04.167538 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfe6d73-ca4a-4e3b-8287-ceeda754949c admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:04.167813 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfe6d73-ca4a-4e3b-8287-ceeda754949c admin admin] PATH_INFO: `/v3/domains` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:04.168456 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfe6d73-ca4a-4e3b-8287-ceeda754949c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:55:04.168758 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfe6d73-ca4a-4e3b-8287-ceeda754949c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:55:04.170234 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f91874-66af-4035-8be7-ee75f21469b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:55:04.170377 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfe6d73-ca4a-4e3b-8287-ceeda754949c admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:55:04.170885 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f91874-66af-4035-8be7-ee75f21469b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:04.171162 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f91874-66af-4035-8be7-ee75f21469b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:04.171441 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f91874-66af-4035-8be7-ee75f21469b9 admin admin] PATH_INFO: `/v3/projects/fee071c93f134d5eb969aed6c2952e90/users/c0bb5e7b0e664b3ebbce9f6317b83778/roles/4818d38cf2564825b312e66c9eb24762` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:04.181751 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 788/1573] 10.222.0.57 () {58 vars in 1153 bytes} [Fri Sep 16 07:55:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:55:04.182552 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfe6d73-ca4a-4e3b-8287-ceeda754949c admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:55:04.192389 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfe6d73-ca4a-4e3b-8287-ceeda754949c admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:55:04.193399 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f91874-66af-4035-8be7-ee75f21469b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fee071c93f134d5eb969aed6c2952e90, user_id=c0bb5e7b0e664b3ebbce9f6317b83778, role_id=4818d38cf2564825b312e66c9eb24762)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:55:04.196339 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f91874-66af-4035-8be7-ee75f21469b9 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:55:04.196939 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa31b36e-83bf-4a73-ac91-605505628466 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:55:04.197521 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa31b36e-83bf-4a73-ac91-605505628466 admin admin] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:04.197824 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa31b36e-83bf-4a73-ac91-605505628466 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:04.198098 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa31b36e-83bf-4a73-ac91-605505628466 admin admin] PATH_INFO: `/v3/projects` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:04.198719 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa31b36e-83bf-4a73-ac91-605505628466 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:55:04.200605 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa31b36e-83bf-4a73-ac91-605505628466 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:55:04.210260 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 786/1574] 10.222.0.57 () {60 vars in 1483 bytes} [Fri Sep 16 07:55:04 2022] PUT /identity/v3/projects/fee071c93f134d5eb969aed6c2952e90/users/c0bb5e7b0e664b3ebbce9f6317b83778/roles/4818d38cf2564825b312e66c9eb24762 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 07:55:04.210898 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f91874-66af-4035-8be7-ee75f21469b9 admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:55:04.224582 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:55:04.230725 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 789/1575] 10.222.0.57 () {60 vars in 1153 bytes} [Fri Sep 16 07:55:04 2022] POST /identity/v3/projects => generated 371 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 07:55:04.231148 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa31b36e-83bf-4a73-ac91-605505628466 admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:55:04.278117 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f91874-66af-4035-8be7-ee75f21469b9 admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:55:04.292619 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa31b36e-83bf-4a73-ac91-605505628466 admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:55:04.297244 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e02994-cc7a-4b98-a052-df7ba7b0b81a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:55:04.297885 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e02994-cc7a-4b98-a052-df7ba7b0b81a admin admin] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:04.298166 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e02994-cc7a-4b98-a052-df7ba7b0b81a admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:04.298437 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e02994-cc7a-4b98-a052-df7ba7b0b81a admin admin] PATH_INFO: `/v3/users` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:04.299106 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e02994-cc7a-4b98-a052-df7ba7b0b81a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:55:04.301042 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e02994-cc7a-4b98-a052-df7ba7b0b81a admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:55:04.323854 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 790/1576] 10.222.0.57 () {60 vars in 1144 bytes} [Fri Sep 16 07:55:04 2022] POST /identity/v3/users => generated 284 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 07:55:04.324516 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e02994-cc7a-4b98-a052-df7ba7b0b81a admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:55:04.334304 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e02994-cc7a-4b98-a052-df7ba7b0b81a admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:55:04.335804 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041299c8-6b4b-47b2-a4de-b0ec0d9af477 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:55:04.336431 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041299c8-6b4b-47b2-a4de-b0ec0d9af477 admin admin] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:04.336777 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041299c8-6b4b-47b2-a4de-b0ec0d9af477 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:04.336970 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041299c8-6b4b-47b2-a4de-b0ec0d9af477 admin admin] PATH_INFO: `/v3/projects` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:04.337585 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041299c8-6b4b-47b2-a4de-b0ec0d9af477 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:55:04.339245 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d711dad-51ac-4be8-9f88-9afc916f6b24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:55:04.339575 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041299c8-6b4b-47b2-a4de-b0ec0d9af477 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:55:04.339990 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d711dad-51ac-4be8-9f88-9afc916f6b24 admin admin] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:04.340273 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d711dad-51ac-4be8-9f88-9afc916f6b24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:04.340548 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d711dad-51ac-4be8-9f88-9afc916f6b24 admin admin] PATH_INFO: `/v3/users` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:04.341193 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d711dad-51ac-4be8-9f88-9afc916f6b24 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:55:04.343249 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d711dad-51ac-4be8-9f88-9afc916f6b24 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:55:04.369274 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 791/1577] 10.222.0.57 () {60 vars in 1144 bytes} [Fri Sep 16 07:55:04 2022] POST /identity/v3/users => generated 283 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 07:55:04.369496 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 787/1578] 10.222.0.57 () {60 vars in 1153 bytes} [Fri Sep 16 07:55:04 2022] POST /identity/v3/projects => generated 379 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 07:55:04.369606 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d711dad-51ac-4be8-9f88-9afc916f6b24 admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:55:04.369708 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041299c8-6b4b-47b2-a4de-b0ec0d9af477 admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:55:04.380412 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d711dad-51ac-4be8-9f88-9afc916f6b24 admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:55:04.432576 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041299c8-6b4b-47b2-a4de-b0ec0d9af477 admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:55:04.437109 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ea663c-043a-49ea-a8f8-1663ca6241c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:55:04.437289 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc5caa1-8b1a-4ad8-8064-e6d090c35cdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:55:04.437735 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ea663c-043a-49ea-a8f8-1663ca6241c6 admin admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:04.437893 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc5caa1-8b1a-4ad8-8064-e6d090c35cdd admin admin] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:04.438029 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ea663c-043a-49ea-a8f8-1663ca6241c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:04.438173 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc5caa1-8b1a-4ad8-8064-e6d090c35cdd admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:04.438285 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ea663c-043a-49ea-a8f8-1663ca6241c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:04.438444 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc5caa1-8b1a-4ad8-8064-e6d090c35cdd admin admin] PATH_INFO: `/v3/users` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:04.438931 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ea663c-043a-49ea-a8f8-1663ca6241c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:55:04.439064 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc5caa1-8b1a-4ad8-8064-e6d090c35cdd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:55:04.440512 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ea663c-043a-49ea-a8f8-1663ca6241c6 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:55:04.440957 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc5caa1-8b1a-4ad8-8064-e6d090c35cdd admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:55:04.450904 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 792/1579] 10.222.0.57 () {58 vars in 1122 bytes} [Fri Sep 16 07:55:04 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 07:55:04.451716 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ea663c-043a-49ea-a8f8-1663ca6241c6 admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:55:04.462317 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ea663c-043a-49ea-a8f8-1663ca6241c6 admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:55:04.467280 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66670447-b851-47b8-9cdb-96868e517fc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:55:04.467875 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66670447-b851-47b8-9cdb-96868e517fc6 admin admin] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:04.468159 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66670447-b851-47b8-9cdb-96868e517fc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:04.468424 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66670447-b851-47b8-9cdb-96868e517fc6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:04.469046 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66670447-b851-47b8-9cdb-96868e517fc6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:55:04.470950 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66670447-b851-47b8-9cdb-96868e517fc6 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:55:04.475382 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 788/1580] 10.222.0.57 () {60 vars in 1144 bytes} [Fri Sep 16 07:55:04 2022] POST /identity/v3/users => generated 287 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 07:55:04.475382 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d62fdd-a96e-4699-8d25-1a48d4bf335d None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:04.475382 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d62fdd-a96e-4699-8d25-1a48d4bf335d None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:04.475382 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d62fdd-a96e-4699-8d25-1a48d4bf335d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:04.487646 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:55:04.493382 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-81d62fdd-a96e-4699-8d25-1a48d4bf335d None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:55:04.495003 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-81d62fdd-a96e-4699-8d25-1a48d4bf335d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:55:04.501423 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 793/1581] 10.222.0.57 () {60 vars in 1153 bytes} [Fri Sep 16 07:55:04 2022] POST /identity/v3/projects => generated 383 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 07:55:04.502306 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66670447-b851-47b8-9cdb-96868e517fc6 admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:55:04.506385 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 789/1582] 10.222.0.57 () {58 vars in 958 bytes} [Fri Sep 16 07:55:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 07:55:04.509471 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d62fdd-a96e-4699-8d25-1a48d4bf335d None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:55:04.517499 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d62fdd-a96e-4699-8d25-1a48d4bf335d None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:55:04.544194 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:55:04.565439 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66670447-b851-47b8-9cdb-96868e517fc6 admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:55:04.571467 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4d57cd-1293-4fa7-afb5-58efba85d0d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:55:04.572157 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4d57cd-1293-4fa7-afb5-58efba85d0d6 admin admin] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:04.572438 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4d57cd-1293-4fa7-afb5-58efba85d0d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:04.572723 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4d57cd-1293-4fa7-afb5-58efba85d0d6 admin admin] PATH_INFO: `/v3/users` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:04.573349 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4d57cd-1293-4fa7-afb5-58efba85d0d6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:55:04.575308 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4d57cd-1293-4fa7-afb5-58efba85d0d6 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:55:04.577279 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adffc0e-83ac-48be-b6f0-64126459cbe6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:55:04.577985 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adffc0e-83ac-48be-b6f0-64126459cbe6 admin admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:04.578200 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adffc0e-83ac-48be-b6f0-64126459cbe6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:04.578472 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adffc0e-83ac-48be-b6f0-64126459cbe6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:04.579105 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0adffc0e-83ac-48be-b6f0-64126459cbe6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:55:04.580684 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0adffc0e-83ac-48be-b6f0-64126459cbe6 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:55:04.595480 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 790/1583] 10.222.0.57 () {58 vars in 1122 bytes} [Fri Sep 16 07:55:04 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 07:55:04.595480 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adffc0e-83ac-48be-b6f0-64126459cbe6 admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:55:04.602227 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 794/1584] 10.222.0.57 () {60 vars in 1144 bytes} [Fri Sep 16 07:55:04 2022] POST /identity/v3/users => generated 286 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 07:55:04.602227 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4d57cd-1293-4fa7-afb5-58efba85d0d6 admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:55:04.606601 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adffc0e-83ac-48be-b6f0-64126459cbe6 admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:55:04.609250 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4d57cd-1293-4fa7-afb5-58efba85d0d6 admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:55:04.611174 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa04aec-bfcc-4abb-b069-9b6a4ba8cbc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:55:04.611763 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa04aec-bfcc-4abb-b069-9b6a4ba8cbc5 admin admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:04.612038 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa04aec-bfcc-4abb-b069-9b6a4ba8cbc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:04.612308 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa04aec-bfcc-4abb-b069-9b6a4ba8cbc5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:04.612930 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa04aec-bfcc-4abb-b069-9b6a4ba8cbc5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:55:04.614539 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc31f365-db7c-4e7d-baa6-74275bca92d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:55:04.615090 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa04aec-bfcc-4abb-b069-9b6a4ba8cbc5 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:55:04.615210 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc31f365-db7c-4e7d-baa6-74275bca92d3 admin admin] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:04.615368 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc31f365-db7c-4e7d-baa6-74275bca92d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:04.615755 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc31f365-db7c-4e7d-baa6-74275bca92d3 admin admin] PATH_INFO: `/v3/users` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:04.616267 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc31f365-db7c-4e7d-baa6-74275bca92d3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:55:04.618174 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc31f365-db7c-4e7d-baa6-74275bca92d3 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:55:04.625982 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 791/1585] 10.222.0.57 () {58 vars in 1122 bytes} [Fri Sep 16 07:55:04 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 07:55:04.627015 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa04aec-bfcc-4abb-b069-9b6a4ba8cbc5 admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:55:04.640491 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa04aec-bfcc-4abb-b069-9b6a4ba8cbc5 admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:55:04.647843 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 795/1586] 10.222.0.57 () {60 vars in 1144 bytes} [Fri Sep 16 07:55:04 2022] POST /identity/v3/users => generated 290 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 07:55:04.648007 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0ff554-365e-442d-a9b6-0ad0f3579e62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:55:04.648149 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc31f365-db7c-4e7d-baa6-74275bca92d3 admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:55:04.648257 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0ff554-365e-442d-a9b6-0ad0f3579e62 admin admin] REQUEST_METHOD: `PUT` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:04.648257 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0ff554-365e-442d-a9b6-0ad0f3579e62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:04.648257 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0ff554-365e-442d-a9b6-0ad0f3579e62 admin admin] PATH_INFO: `/v3/projects/6d0a119c290f48b4b23a50366c36246f/users/bb5935d098a241679b2957e8c4742168/roles/4818d38cf2564825b312e66c9eb24762` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:04.655223 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc31f365-db7c-4e7d-baa6-74275bca92d3 admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:55:04.659948 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9456abfa-37cc-4882-9dee-ed71dd085fd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:55:04.660698 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9456abfa-37cc-4882-9dee-ed71dd085fd6 admin admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:04.661165 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9456abfa-37cc-4882-9dee-ed71dd085fd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:04.661440 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9456abfa-37cc-4882-9dee-ed71dd085fd6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:04.662106 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9456abfa-37cc-4882-9dee-ed71dd085fd6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:55:04.662226 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0ff554-365e-442d-a9b6-0ad0f3579e62 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6d0a119c290f48b4b23a50366c36246f, user_id=bb5935d098a241679b2957e8c4742168, role_id=4818d38cf2564825b312e66c9eb24762)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:55:04.663679 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9456abfa-37cc-4882-9dee-ed71dd085fd6 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:55:04.664862 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0ff554-365e-442d-a9b6-0ad0f3579e62 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:55:04.674060 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 796/1587] 10.222.0.57 () {58 vars in 1122 bytes} [Fri Sep 16 07:55:04 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 07:55:04.674826 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9456abfa-37cc-4882-9dee-ed71dd085fd6 admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:55:04.679953 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 792/1588] 10.222.0.57 () {60 vars in 1483 bytes} [Fri Sep 16 07:55:04 2022] PUT /identity/v3/projects/6d0a119c290f48b4b23a50366c36246f/users/bb5935d098a241679b2957e8c4742168/roles/4818d38cf2564825b312e66c9eb24762 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 07:55:04.680750 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0ff554-365e-442d-a9b6-0ad0f3579e62 admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:55:04.687351 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9456abfa-37cc-4882-9dee-ed71dd085fd6 admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:55:04.735728 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0ff554-365e-442d-a9b6-0ad0f3579e62 admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:55:04.740608 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b051ef-50a1-4958-9996-ae5cce5873d2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1062e457207a41e4ba4f0a0c4bf36f1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4735f453c0c24cc4a1c14e9ac84a0b46', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:55:04.741535 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b051ef-50a1-4958-9996-ae5cce5873d2 service neutron] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:04.742122 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b051ef-50a1-4958-9996-ae5cce5873d2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:04.742702 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b051ef-50a1-4958-9996-ae5cce5873d2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:04.745612 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32896e7-1eda-4ced-b8ac-2af1df01137e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:55:04.746288 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32896e7-1eda-4ced-b8ac-2af1df01137e admin admin] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:04.746571 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32896e7-1eda-4ced-b8ac-2af1df01137e admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:04.746839 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32896e7-1eda-4ced-b8ac-2af1df01137e admin admin] PATH_INFO: `/v3/users` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:04.747674 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32896e7-1eda-4ced-b8ac-2af1df01137e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:55:04.749644 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32896e7-1eda-4ced-b8ac-2af1df01137e admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:55:04.754351 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b051ef-50a1-4958-9996-ae5cce5873d2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:55:04.756113 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b051ef-50a1-4958-9996-ae5cce5873d2 service neutron] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:55:04.766861 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 793/1589] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Sep 16 07:55:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 07:55:04.767751 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b051ef-50a1-4958-9996-ae5cce5873d2 service neutron] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:55:04.771734 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 797/1590] 10.222.0.57 () {60 vars in 1144 bytes} [Fri Sep 16 07:55:04 2022] POST /identity/v3/users => generated 292 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 07:55:04.772742 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32896e7-1eda-4ced-b8ac-2af1df01137e admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:55:04.780245 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b051ef-50a1-4958-9996-ae5cce5873d2 service neutron] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:55:04.782727 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32896e7-1eda-4ced-b8ac-2af1df01137e admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:55:04.786168 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdeee0a9-41fe-436e-b50a-cb5a200c22d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:55:04.787095 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdeee0a9-41fe-436e-b50a-cb5a200c22d1 admin admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:04.787655 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdeee0a9-41fe-436e-b50a-cb5a200c22d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:04.788117 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdeee0a9-41fe-436e-b50a-cb5a200c22d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:04.788509 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128f6c9f-16e0-42cc-9621-19ce4974d512 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:55:04.789111 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128f6c9f-16e0-42cc-9621-19ce4974d512 admin admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:04.789389 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdeee0a9-41fe-436e-b50a-cb5a200c22d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:55:04.789516 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128f6c9f-16e0-42cc-9621-19ce4974d512 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:04.789828 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128f6c9f-16e0-42cc-9621-19ce4974d512 admin admin] PATH_INFO: `/v3/roles` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:04.790467 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128f6c9f-16e0-42cc-9621-19ce4974d512 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:55:04.791854 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdeee0a9-41fe-436e-b50a-cb5a200c22d1 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:55:04.792149 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128f6c9f-16e0-42cc-9621-19ce4974d512 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:55:04.803690 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 798/1591] 10.222.0.57 () {58 vars in 1122 bytes} [Fri Sep 16 07:55:04 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 07:55:04.807256 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 794/1592] 10.222.0.57 () {58 vars in 1122 bytes} [Fri Sep 16 07:55:04 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 07:55:04.807391 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128f6c9f-16e0-42cc-9621-19ce4974d512 admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:55:04.807513 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdeee0a9-41fe-436e-b50a-cb5a200c22d1 admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:55:04.815004 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128f6c9f-16e0-42cc-9621-19ce4974d512 admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:55:04.821294 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e578e071-2e80-49a7-b0e3-56ad08295d8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:55:04.822063 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e578e071-2e80-49a7-b0e3-56ad08295d8c admin admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:04.822348 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e578e071-2e80-49a7-b0e3-56ad08295d8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:04.822624 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e578e071-2e80-49a7-b0e3-56ad08295d8c admin admin] PATH_INFO: `/v3/roles` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:04.823277 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e578e071-2e80-49a7-b0e3-56ad08295d8c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:55:04.823401 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdeee0a9-41fe-436e-b50a-cb5a200c22d1 admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:55:04.824876 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e578e071-2e80-49a7-b0e3-56ad08295d8c admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:55:04.828490 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a371a9fe-ac37-4451-87ae-26870078f8e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:55:04.829081 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a371a9fe-ac37-4451-87ae-26870078f8e6 admin admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:04.829353 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a371a9fe-ac37-4451-87ae-26870078f8e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:04.829622 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a371a9fe-ac37-4451-87ae-26870078f8e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:04.830762 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a371a9fe-ac37-4451-87ae-26870078f8e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:55:04.832914 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a371a9fe-ac37-4451-87ae-26870078f8e6 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:55:04.837707 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 799/1593] 10.222.0.57 () {58 vars in 1122 bytes} [Fri Sep 16 07:55:04 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 07:55:04.838750 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e578e071-2e80-49a7-b0e3-56ad08295d8c admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:55:04.846170 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 795/1594] 10.222.0.57 () {58 vars in 1122 bytes} [Fri Sep 16 07:55:04 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 07:55:04.846170 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac8d16d-1938-4cdc-9802-51cfe59bfe0d None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:04.846170 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac8d16d-1938-4cdc-9802-51cfe59bfe0d None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:04.846170 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac8d16d-1938-4cdc-9802-51cfe59bfe0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:04.850563 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e578e071-2e80-49a7-b0e3-56ad08295d8c admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:55:04.855859 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be89a137-43c7-4f3e-bb5e-c3498e314351 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:55:04.856565 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be89a137-43c7-4f3e-bb5e-c3498e314351 admin admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:04.856921 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be89a137-43c7-4f3e-bb5e-c3498e314351 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:04.857269 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be89a137-43c7-4f3e-bb5e-c3498e314351 admin admin] PATH_INFO: `/v3/roles` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:04.858027 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be89a137-43c7-4f3e-bb5e-c3498e314351 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:55:04.860115 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be89a137-43c7-4f3e-bb5e-c3498e314351 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:55:04.865663 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-9ac8d16d-1938-4cdc-9802-51cfe59bfe0d None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:55:04.866898 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-9ac8d16d-1938-4cdc-9802-51cfe59bfe0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:55:04.876638 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 800/1595] 10.222.0.57 () {58 vars in 1122 bytes} [Fri Sep 16 07:55:04 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 07:55:04.876638 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be89a137-43c7-4f3e-bb5e-c3498e314351 admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:55:04.879516 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 796/1596] 10.222.0.57 () {58 vars in 958 bytes} [Fri Sep 16 07:55:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 07:55:04.880464 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac8d16d-1938-4cdc-9802-51cfe59bfe0d None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:55:04.890911 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac8d16d-1938-4cdc-9802-51cfe59bfe0d None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:55:04.897543 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9072da-ac97-4359-aa6a-8275e114e99a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:55:04.898218 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9072da-ac97-4359-aa6a-8275e114e99a admin admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:04.898503 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9072da-ac97-4359-aa6a-8275e114e99a admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:04.898765 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9072da-ac97-4359-aa6a-8275e114e99a admin admin] PATH_INFO: `/v3/roles` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:04.899396 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9072da-ac97-4359-aa6a-8275e114e99a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:55:04.899912 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be89a137-43c7-4f3e-bb5e-c3498e314351 admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:55:04.900986 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9072da-ac97-4359-aa6a-8275e114e99a admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:55:04.904997 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25f5703-b2c4-44c9-810e-78ce16ed8fac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:55:04.905738 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25f5703-b2c4-44c9-810e-78ce16ed8fac admin admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:04.906136 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25f5703-b2c4-44c9-810e-78ce16ed8fac admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:04.906514 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25f5703-b2c4-44c9-810e-78ce16ed8fac admin admin] PATH_INFO: `/v3/roles` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:04.907258 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25f5703-b2c4-44c9-810e-78ce16ed8fac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:55:04.908968 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25f5703-b2c4-44c9-810e-78ce16ed8fac admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:55:04.912904 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 797/1597] 10.222.0.57 () {58 vars in 1122 bytes} [Fri Sep 16 07:55:04 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 07:55:04.914118 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9072da-ac97-4359-aa6a-8275e114e99a admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:55:04.922532 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 801/1598] 10.222.0.57 () {58 vars in 1122 bytes} [Fri Sep 16 07:55:04 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 07:55:04.923419 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25f5703-b2c4-44c9-810e-78ce16ed8fac admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:55:04.924734 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9072da-ac97-4359-aa6a-8275e114e99a admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:55:04.930474 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c52b3f1-aa3e-431b-83bd-7ef631d85c13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:55:04.931147 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c52b3f1-aa3e-431b-83bd-7ef631d85c13 admin admin] REQUEST_METHOD: `PUT` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:04.931417 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c52b3f1-aa3e-431b-83bd-7ef631d85c13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:04.931684 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c52b3f1-aa3e-431b-83bd-7ef631d85c13 admin admin] PATH_INFO: `/v3/projects/656cd8bd49e245a082c5addc5588b428/users/c9369d82ab164b6cb51a9c76d78357ab/roles/4818d38cf2564825b312e66c9eb24762` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:04.932708 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=91,keystone:INSERT=9 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:55:04.939332 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25f5703-b2c4-44c9-810e-78ce16ed8fac admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:55:04.947164 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b8ca1b-42f6-4ea2-98a9-2b6f47fc98fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:55:04.947828 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b8ca1b-42f6-4ea2-98a9-2b6f47fc98fb admin admin] REQUEST_METHOD: `PUT` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:04.948103 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b8ca1b-42f6-4ea2-98a9-2b6f47fc98fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:04.948370 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b8ca1b-42f6-4ea2-98a9-2b6f47fc98fb admin admin] PATH_INFO: `/v3/projects/561f03e618164927bc30241c89b4e8ac/users/b60ea0dbb0c64a62b2594a21784cf3e4/roles/4818d38cf2564825b312e66c9eb24762` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:04.951774 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c52b3f1-aa3e-431b-83bd-7ef631d85c13 admin admin] RBAC: Authorizing `identity:create_grant(project_id=656cd8bd49e245a082c5addc5588b428, user_id=c9369d82ab164b6cb51a9c76d78357ab, role_id=4818d38cf2564825b312e66c9eb24762)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:55:04.954644 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c52b3f1-aa3e-431b-83bd-7ef631d85c13 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:55:04.964716 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b8ca1b-42f6-4ea2-98a9-2b6f47fc98fb admin admin] RBAC: Authorizing `identity:create_grant(project_id=561f03e618164927bc30241c89b4e8ac, user_id=b60ea0dbb0c64a62b2594a21784cf3e4, role_id=4818d38cf2564825b312e66c9eb24762)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:55:04.965751 dv-cinder-740146-20-smb devstack@keystone.service[81430]: WARNING py.warnings [None req-57b8ca1b-42f6-4ea2-98a9-2b6f47fc98fb admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 16 07:55:04.965751 dv-cinder-740146-20-smb devstack@keystone.service[81430]: warnings.warn(msg) Sep 16 07:55:04.965751 dv-cinder-740146-20-smb devstack@keystone.service[81430]: Sep 16 07:55:04.967773 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b8ca1b-42f6-4ea2-98a9-2b6f47fc98fb admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:55:04.971346 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 798/1599] 10.222.0.57 () {60 vars in 1483 bytes} [Fri Sep 16 07:55:04 2022] PUT /identity/v3/projects/656cd8bd49e245a082c5addc5588b428/users/c9369d82ab164b6cb51a9c76d78357ab/roles/4818d38cf2564825b312e66c9eb24762 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 07:55:04.975082 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c52b3f1-aa3e-431b-83bd-7ef631d85c13 admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:55:04.992108 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 802/1600] 10.222.0.57 () {60 vars in 1483 bytes} [Fri Sep 16 07:55:04 2022] PUT /identity/v3/projects/561f03e618164927bc30241c89b4e8ac/users/b60ea0dbb0c64a62b2594a21784cf3e4/roles/4818d38cf2564825b312e66c9eb24762 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 07:55:04.992930 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b8ca1b-42f6-4ea2-98a9-2b6f47fc98fb admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:55:05.025043 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:55:05.067799 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c52b3f1-aa3e-431b-83bd-7ef631d85c13 admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:55:05.072920 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06839958-9c06-4d48-a258-24b75cb4716a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:55:05.073559 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06839958-9c06-4d48-a258-24b75cb4716a admin admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:05.073958 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06839958-9c06-4d48-a258-24b75cb4716a admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:05.074232 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06839958-9c06-4d48-a258-24b75cb4716a admin admin] PATH_INFO: `/v3/roles` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:05.075181 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06839958-9c06-4d48-a258-24b75cb4716a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:55:05.076176 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b8ca1b-42f6-4ea2-98a9-2b6f47fc98fb admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:55:05.076452 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06839958-9c06-4d48-a258-24b75cb4716a admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:55:05.085347 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1542efae-62ed-47bb-b5e9-57030ec1c202 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:55:05.086076 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1542efae-62ed-47bb-b5e9-57030ec1c202 admin admin] REQUEST_METHOD: `PUT` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:05.086391 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1542efae-62ed-47bb-b5e9-57030ec1c202 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:05.086762 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1542efae-62ed-47bb-b5e9-57030ec1c202 admin admin] PATH_INFO: `/v3/projects/43d3d7de170e47b181f5d374e4520117/users/419aaf2c9ad54db28c199fd717ffe015/roles/4818d38cf2564825b312e66c9eb24762` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:05.092970 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 799/1601] 10.222.0.57 () {58 vars in 1122 bytes} [Fri Sep 16 07:55:04 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 07:55:05.092970 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06839958-9c06-4d48-a258-24b75cb4716a admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:55:05.109137 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1542efae-62ed-47bb-b5e9-57030ec1c202 admin admin] RBAC: Authorizing `identity:create_grant(project_id=43d3d7de170e47b181f5d374e4520117, user_id=419aaf2c9ad54db28c199fd717ffe015, role_id=4818d38cf2564825b312e66c9eb24762)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:55:05.112024 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1542efae-62ed-47bb-b5e9-57030ec1c202 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:55:05.133514 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 803/1602] 10.222.0.57 () {60 vars in 1483 bytes} [Fri Sep 16 07:55:04 2022] PUT /identity/v3/projects/43d3d7de170e47b181f5d374e4520117/users/419aaf2c9ad54db28c199fd717ffe015/roles/4818d38cf2564825b312e66c9eb24762 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 07:55:05.138763 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1542efae-62ed-47bb-b5e9-57030ec1c202 admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:55:05.170046 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06839958-9c06-4d48-a258-24b75cb4716a admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:55:05.225469 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc15228-49cf-4101-a940-c07de837658d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1062e457207a41e4ba4f0a0c4bf36f1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4735f453c0c24cc4a1c14e9ac84a0b46', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:55:05.225930 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc15228-49cf-4101-a940-c07de837658d service neutron] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:05.226206 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc15228-49cf-4101-a940-c07de837658d service neutron] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:05.226475 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc15228-49cf-4101-a940-c07de837658d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:05.227607 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1542efae-62ed-47bb-b5e9-57030ec1c202 admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:55:05.232860 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43d15e1-3308-42b0-bd2e-c2dfadc5b67c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:55:05.233757 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43d15e1-3308-42b0-bd2e-c2dfadc5b67c admin admin] REQUEST_METHOD: `PUT` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:05.234194 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43d15e1-3308-42b0-bd2e-c2dfadc5b67c admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:05.234562 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43d15e1-3308-42b0-bd2e-c2dfadc5b67c admin admin] PATH_INFO: `/v3/projects/88c66fd46dbd48b5ae12b957f693f371/users/9dd6a20681a74e76a3dbe33ae94eacd7/roles/4818d38cf2564825b312e66c9eb24762` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:05.236542 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc15228-49cf-4101-a940-c07de837658d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:55:05.238173 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc15228-49cf-4101-a940-c07de837658d service neutron] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:55:05.251639 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 800/1603] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Sep 16 07:55:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 07:55:05.253887 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc15228-49cf-4101-a940-c07de837658d service neutron] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:55:05.260699 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43d15e1-3308-42b0-bd2e-c2dfadc5b67c admin admin] RBAC: Authorizing `identity:create_grant(project_id=88c66fd46dbd48b5ae12b957f693f371, user_id=9dd6a20681a74e76a3dbe33ae94eacd7, role_id=4818d38cf2564825b312e66c9eb24762)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:55:05.264313 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43d15e1-3308-42b0-bd2e-c2dfadc5b67c admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:55:05.264453 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc15228-49cf-4101-a940-c07de837658d service neutron] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:55:05.270016 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f5ed17-4ff1-44e4-ae94-fb2759630f05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:55:05.271041 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f5ed17-4ff1-44e4-ae94-fb2759630f05 admin admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:05.271403 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f5ed17-4ff1-44e4-ae94-fb2759630f05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:05.271750 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f5ed17-4ff1-44e4-ae94-fb2759630f05 admin admin] PATH_INFO: `/v3/roles` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:05.272491 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f5ed17-4ff1-44e4-ae94-fb2759630f05 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:55:05.274236 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f5ed17-4ff1-44e4-ae94-fb2759630f05 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:55:05.280650 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 804/1604] 10.222.0.57 () {60 vars in 1483 bytes} [Fri Sep 16 07:55:05 2022] PUT /identity/v3/projects/88c66fd46dbd48b5ae12b957f693f371/users/9dd6a20681a74e76a3dbe33ae94eacd7/roles/4818d38cf2564825b312e66c9eb24762 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 07:55:05.281690 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29fb2cb-eca5-4084-ab90-6a87c604fa50 None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:05.282010 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29fb2cb-eca5-4084-ab90-6a87c604fa50 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:05.282305 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29fb2cb-eca5-4084-ab90-6a87c604fa50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:05.289262 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 801/1605] 10.222.0.57 () {58 vars in 1122 bytes} [Fri Sep 16 07:55:05 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 07:55:05.289262 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942aea1a-6b11-4f24-84df-c68aeea671ce None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:05.289262 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942aea1a-6b11-4f24-84df-c68aeea671ce None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:05.289262 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942aea1a-6b11-4f24-84df-c68aeea671ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:05.319557 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-942aea1a-6b11-4f24-84df-c68aeea671ce None None] MFA Rules not processed for user `b60ea0dbb0c64a62b2594a21784cf3e4`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:55:05.321511 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-942aea1a-6b11-4f24-84df-c68aeea671ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:55:05.321675 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-a29fb2cb-eca5-4084-ab90-6a87c604fa50 None None] MFA Rules not processed for user `c9369d82ab164b6cb51a9c76d78357ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:55:05.323073 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-a29fb2cb-eca5-4084-ab90-6a87c604fa50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:55:05.363551 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:55:05.402475 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:55:05.404582 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 805/1606] 10.222.0.57 () {58 vars in 958 bytes} [Fri Sep 16 07:55:05 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 07:55:05.405443 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29fb2cb-eca5-4084-ab90-6a87c604fa50 None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:55:05.408581 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 802/1607] 10.222.0.57 () {58 vars in 958 bytes} [Fri Sep 16 07:55:05 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 07:55:05.410944 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7465ca0d-0900-4a5b-9665-cb0cec3b7121 None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:05.411554 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7465ca0d-0900-4a5b-9665-cb0cec3b7121 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:05.413014 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7465ca0d-0900-4a5b-9665-cb0cec3b7121 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:05.445157 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-7465ca0d-0900-4a5b-9665-cb0cec3b7121 None None] MFA Rules not processed for user `419aaf2c9ad54db28c199fd717ffe015`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:55:05.446531 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-7465ca0d-0900-4a5b-9665-cb0cec3b7121 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:55:05.482215 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29fb2cb-eca5-4084-ab90-6a87c604fa50 None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:55:05.487740 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5217a8e-1701-4a68-8fdb-da37c2798327 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:55:05.488609 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5217a8e-1701-4a68-8fdb-da37c2798327 admin admin] REQUEST_METHOD: `PUT` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:05.489013 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5217a8e-1701-4a68-8fdb-da37c2798327 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:05.489355 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5217a8e-1701-4a68-8fdb-da37c2798327 admin admin] PATH_INFO: `/v3/projects/4dc5a8b3ae024a0a82ae970e4edd5cfe/users/ed058b182f0f46a78f2f3a2f3a0e3528/roles/4818d38cf2564825b312e66c9eb24762` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:05.505682 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5217a8e-1701-4a68-8fdb-da37c2798327 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4dc5a8b3ae024a0a82ae970e4edd5cfe, user_id=ed058b182f0f46a78f2f3a2f3a0e3528, role_id=4818d38cf2564825b312e66c9eb24762)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:55:05.508622 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5217a8e-1701-4a68-8fdb-da37c2798327 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:55:05.520343 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 803/1608] 10.222.0.57 () {58 vars in 958 bytes} [Fri Sep 16 07:55:05 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 07:55:05.521139 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7465ca0d-0900-4a5b-9665-cb0cec3b7121 None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:55:05.530220 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 806/1609] 10.222.0.57 () {60 vars in 1483 bytes} [Fri Sep 16 07:55:05 2022] PUT /identity/v3/projects/4dc5a8b3ae024a0a82ae970e4edd5cfe/users/ed058b182f0f46a78f2f3a2f3a0e3528/roles/4818d38cf2564825b312e66c9eb24762 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 07:55:05.532178 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b976a9-f378-4601-8eca-ee57a0eaa109 None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:05.532712 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b976a9-f378-4601-8eca-ee57a0eaa109 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:05.533011 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b976a9-f378-4601-8eca-ee57a0eaa109 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:05.534520 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7465ca0d-0900-4a5b-9665-cb0cec3b7121 None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:55:05.580194 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-99b976a9-f378-4601-8eca-ee57a0eaa109 None None] MFA Rules not processed for user `9dd6a20681a74e76a3dbe33ae94eacd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:55:05.581661 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-99b976a9-f378-4601-8eca-ee57a0eaa109 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:55:05.620090 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6886e317-4a3d-4718-a77f-3809cbf825bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:55:05.620932 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6886e317-4a3d-4718-a77f-3809cbf825bf admin admin] REQUEST_METHOD: `PUT` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:05.621276 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6886e317-4a3d-4718-a77f-3809cbf825bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:05.621657 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6886e317-4a3d-4718-a77f-3809cbf825bf admin admin] PATH_INFO: `/v3/projects/0f970e137a804e408f13226fb1a297d5/users/b606a6e5afe44fb786c2c655912414e4/roles/4818d38cf2564825b312e66c9eb24762` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:05.637751 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6886e317-4a3d-4718-a77f-3809cbf825bf admin admin] RBAC: Authorizing `identity:create_grant(project_id=0f970e137a804e408f13226fb1a297d5, user_id=b606a6e5afe44fb786c2c655912414e4, role_id=4818d38cf2564825b312e66c9eb24762)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:55:05.640517 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6886e317-4a3d-4718-a77f-3809cbf825bf admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:55:05.668788 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 804/1610] 10.222.0.57 () {60 vars in 1483 bytes} [Fri Sep 16 07:55:05 2022] PUT /identity/v3/projects/0f970e137a804e408f13226fb1a297d5/users/b606a6e5afe44fb786c2c655912414e4/roles/4818d38cf2564825b312e66c9eb24762 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 07:55:05.668788 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6886e317-4a3d-4718-a77f-3809cbf825bf admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:55:05.689878 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 807/1611] 10.222.0.57 () {58 vars in 958 bytes} [Fri Sep 16 07:55:05 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 07:55:05.690772 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b976a9-f378-4601-8eca-ee57a0eaa109 None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:55:05.707534 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b976a9-f378-4601-8eca-ee57a0eaa109 None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:55:05.737823 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6886e317-4a3d-4718-a77f-3809cbf825bf admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:55:05.744693 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029f80ef-efbf-4c44-871d-66f296b279f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:55:05.746227 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029f80ef-efbf-4c44-871d-66f296b279f2 admin admin] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:05.746518 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029f80ef-efbf-4c44-871d-66f296b279f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:05.746885 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029f80ef-efbf-4c44-871d-66f296b279f2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:05.747601 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029f80ef-efbf-4c44-871d-66f296b279f2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:55:05.749694 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029f80ef-efbf-4c44-871d-66f296b279f2 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:55:05.762213 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:55:05.772682 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:55:05.780760 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f75c9c-dcfa-407d-8260-bc42689ec8fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:55:05.781301 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f75c9c-dcfa-407d-8260-bc42689ec8fc admin admin] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:05.781592 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f75c9c-dcfa-407d-8260-bc42689ec8fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:05.781943 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f75c9c-dcfa-407d-8260-bc42689ec8fc admin admin] PATH_INFO: `/v3/projects` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:05.782589 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f75c9c-dcfa-407d-8260-bc42689ec8fc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:55:05.784507 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f75c9c-dcfa-407d-8260-bc42689ec8fc admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:55:05.790838 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 805/1612] 10.222.0.57 () {60 vars in 1153 bytes} [Fri Sep 16 07:55:05 2022] POST /identity/v3/projects => generated 367 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 07:55:05.790838 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ff8095-6d5c-4b86-ab0b-2d9c1d49bab1 None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:05.790838 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ff8095-6d5c-4b86-ab0b-2d9c1d49bab1 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:05.791896 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ff8095-6d5c-4b86-ab0b-2d9c1d49bab1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:05.828954 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 808/1613] 10.222.0.57 () {60 vars in 1153 bytes} [Fri Sep 16 07:55:05 2022] POST /identity/v3/projects => generated 365 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 07:55:05.828954 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2326b5a4-61de-4b13-aae6-ff08aaa8541e None None] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:05.828954 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2326b5a4-61de-4b13-aae6-ff08aaa8541e None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:05.828954 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2326b5a4-61de-4b13-aae6-ff08aaa8541e None None] PATH_INFO: `/` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:05.831130 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 809/1614] 10.222.0.57 () {54 vars in 962 bytes} [Fri Sep 16 07:55:05 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 07:55:05.832467 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c440a9e-45b5-4ecc-8bfb-f9625405314a None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:05.833643 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c440a9e-45b5-4ecc-8bfb-f9625405314a None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:05.833643 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c440a9e-45b5-4ecc-8bfb-f9625405314a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:05.858002 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-14ff8095-6d5c-4b86-ab0b-2d9c1d49bab1 None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:55:05.859069 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-14ff8095-6d5c-4b86-ab0b-2d9c1d49bab1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:55:05.873175 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-0c440a9e-45b5-4ecc-8bfb-f9625405314a None None] MFA Rules not processed for user `b606a6e5afe44fb786c2c655912414e4`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:55:05.876886 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-0c440a9e-45b5-4ecc-8bfb-f9625405314a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:55:06.012683 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 806/1615] 10.222.0.57 () {58 vars in 958 bytes} [Fri Sep 16 07:55:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 07:55:06.013605 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ff8095-6d5c-4b86-ab0b-2d9c1d49bab1 None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:55:06.032916 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ff8095-6d5c-4b86-ab0b-2d9c1d49bab1 None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:55:06.046124 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c0401a-2cce-4f7a-b580-8e3c5478c692 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:55:06.046766 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c0401a-2cce-4f7a-b580-8e3c5478c692 admin admin] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:06.047047 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c0401a-2cce-4f7a-b580-8e3c5478c692 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:06.047322 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c0401a-2cce-4f7a-b580-8e3c5478c692 admin admin] PATH_INFO: `/v3/projects` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:06.047969 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c0401a-2cce-4f7a-b580-8e3c5478c692 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:55:06.051528 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c0401a-2cce-4f7a-b580-8e3c5478c692 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:55:06.063243 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 810/1616] 10.222.0.57 () {58 vars in 958 bytes} [Fri Sep 16 07:55:05 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 07:55:06.065586 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c440a9e-45b5-4ecc-8bfb-f9625405314a None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:55:06.124239 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c440a9e-45b5-4ecc-8bfb-f9625405314a None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:55:06.131390 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 807/1617] 10.222.0.57 () {60 vars in 1153 bytes} [Fri Sep 16 07:55:06 2022] POST /identity/v3/projects => generated 373 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 07:55:06.131390 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c0401a-2cce-4f7a-b580-8e3c5478c692 admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:55:06.209430 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c0401a-2cce-4f7a-b580-8e3c5478c692 admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:55:06.221309 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2ea856-1414-4e72-b5cb-f78b2232c879 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:55:06.222170 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2ea856-1414-4e72-b5cb-f78b2232c879 admin admin] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:06.223625 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2ea856-1414-4e72-b5cb-f78b2232c879 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:06.223625 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2ea856-1414-4e72-b5cb-f78b2232c879 admin admin] PATH_INFO: `/v3/users` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:06.226140 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2ea856-1414-4e72-b5cb-f78b2232c879 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:55:06.233051 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2ea856-1414-4e72-b5cb-f78b2232c879 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:55:06.262157 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 808/1618] 10.222.0.57 () {60 vars in 1144 bytes} [Fri Sep 16 07:55:06 2022] POST /identity/v3/users => generated 289 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 07:55:06.267400 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255a73ca-5721-4241-93b0-23998b352171 None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:06.267847 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255a73ca-5721-4241-93b0-23998b352171 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:06.268227 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255a73ca-5721-4241-93b0-23998b352171 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:06.290474 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ecf759-61cb-4a6f-9b7e-c396c336492b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:55:06.292551 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ecf759-61cb-4a6f-9b7e-c396c336492b admin admin] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:06.293833 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ecf759-61cb-4a6f-9b7e-c396c336492b admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:06.294276 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ecf759-61cb-4a6f-9b7e-c396c336492b admin admin] PATH_INFO: `/v3/users` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:06.295285 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ecf759-61cb-4a6f-9b7e-c396c336492b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:55:06.306778 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ecf759-61cb-4a6f-9b7e-c396c336492b admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:55:06.319820 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-255a73ca-5721-4241-93b0-23998b352171 None None] MFA Rules not processed for user `9bec4d9b08514461a1bf63c6b88f53b2`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:55:06.321179 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-255a73ca-5721-4241-93b0-23998b352171 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:55:06.357215 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 811/1619] 10.222.0.57 () {60 vars in 1144 bytes} [Fri Sep 16 07:55:06 2022] POST /identity/v3/users => generated 290 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 07:55:06.358909 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ecf759-61cb-4a6f-9b7e-c396c336492b admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:55:06.421887 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:55:06.480065 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ecf759-61cb-4a6f-9b7e-c396c336492b admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:55:06.481036 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 809/1620] 10.222.0.57 () {58 vars in 1059 bytes} [Fri Sep 16 07:55:06 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 07:55:06.484552 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd2e2b7-d57c-496d-9c02-6daf59d8f202 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1062e457207a41e4ba4f0a0c4bf36f1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4735f453c0c24cc4a1c14e9ac84a0b46', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:55:06.485405 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd2e2b7-d57c-496d-9c02-6daf59d8f202 service neutron] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:06.485530 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5552b7-54f8-42d1-999c-cb18a9f64965 None None] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:06.485781 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd2e2b7-d57c-496d-9c02-6daf59d8f202 service neutron] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:06.485929 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5552b7-54f8-42d1-999c-cb18a9f64965 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:06.486098 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5552b7-54f8-42d1-999c-cb18a9f64965 None None] PATH_INFO: `/` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:06.486206 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd2e2b7-d57c-496d-9c02-6daf59d8f202 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:06.490177 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 810/1621] 10.222.0.57 () {54 vars in 962 bytes} [Fri Sep 16 07:55:06 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 07:55:06.490888 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5552b7-54f8-42d1-999c-cb18a9f64965 None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:55:06.500373 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:55:06.503198 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd2e2b7-d57c-496d-9c02-6daf59d8f202 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:55:06.506018 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd2e2b7-d57c-496d-9c02-6daf59d8f202 service neutron] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:55:06.517298 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 812/1622] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Sep 16 07:55:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 07:55:06.518525 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd2e2b7-d57c-496d-9c02-6daf59d8f202 service neutron] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:55:06.522224 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5552b7-54f8-42d1-999c-cb18a9f64965 None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:55:06.535351 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd2e2b7-d57c-496d-9c02-6daf59d8f202 service neutron] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:55:06.536079 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a8a392-84ca-4c73-9529-17985c0ec038 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:55:06.537865 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a8a392-84ca-4c73-9529-17985c0ec038 admin admin] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:06.538219 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a8a392-84ca-4c73-9529-17985c0ec038 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:06.538504 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a8a392-84ca-4c73-9529-17985c0ec038 admin admin] PATH_INFO: `/v3/users` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:06.542068 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a8a392-84ca-4c73-9529-17985c0ec038 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:55:06.543431 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f283db-f93b-44a7-a754-c0b160699919 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:55:06.544928 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f283db-f93b-44a7-a754-c0b160699919 admin admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:06.545197 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a8a392-84ca-4c73-9529-17985c0ec038 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:55:06.546001 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f283db-f93b-44a7-a754-c0b160699919 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:06.546488 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f283db-f93b-44a7-a754-c0b160699919 admin admin] PATH_INFO: `/v3/roles` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:06.547523 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f283db-f93b-44a7-a754-c0b160699919 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:55:06.549420 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f283db-f93b-44a7-a754-c0b160699919 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:55:06.568001 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 813/1623] 10.222.0.57 () {58 vars in 1122 bytes} [Fri Sep 16 07:55:06 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 07:55:06.569505 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f283db-f93b-44a7-a754-c0b160699919 admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:55:06.585612 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f283db-f93b-44a7-a754-c0b160699919 admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:55:06.591882 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bda940d-5743-4e6e-a921-aa446cbaa24b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:55:06.592779 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bda940d-5743-4e6e-a921-aa446cbaa24b admin admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:06.593302 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bda940d-5743-4e6e-a921-aa446cbaa24b admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:06.593576 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 811/1624] 10.222.0.57 () {60 vars in 1144 bytes} [Fri Sep 16 07:55:06 2022] POST /identity/v3/users => generated 293 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 07:55:06.594011 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bda940d-5743-4e6e-a921-aa446cbaa24b admin admin] PATH_INFO: `/v3/roles` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:06.594900 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bda940d-5743-4e6e-a921-aa446cbaa24b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:55:06.596862 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bda940d-5743-4e6e-a921-aa446cbaa24b admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:55:06.599836 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a8a392-84ca-4c73-9529-17985c0ec038 admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:55:06.610424 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 814/1625] 10.222.0.57 () {58 vars in 1122 bytes} [Fri Sep 16 07:55:06 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 07:55:06.612284 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547ea3ce-aee5-4dbe-b5bf-3a57a0f2943a None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:06.612915 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547ea3ce-aee5-4dbe-b5bf-3a57a0f2943a None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:06.613530 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547ea3ce-aee5-4dbe-b5bf-3a57a0f2943a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:06.642285 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-547ea3ce-aee5-4dbe-b5bf-3a57a0f2943a None None] MFA Rules not processed for user `9bec4d9b08514461a1bf63c6b88f53b2`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:55:06.644055 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-547ea3ce-aee5-4dbe-b5bf-3a57a0f2943a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:55:06.650531 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a8a392-84ca-4c73-9529-17985c0ec038 admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:55:06.666338 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 815/1626] 10.222.0.57 () {58 vars in 1059 bytes} [Fri Sep 16 07:55:06 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 07:55:06.666619 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d806c8bc-e5aa-4527-92be-d9350ff2c7f9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bec4d9b08514461a1bf63c6b88f53b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4735f453c0c24cc4a1c14e9ac84a0b46', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:55:06.667243 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d806c8bc-e5aa-4527-92be-d9350ff2c7f9 service nova] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:06.667522 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d806c8bc-e5aa-4527-92be-d9350ff2c7f9 service nova] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:06.667793 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d806c8bc-e5aa-4527-92be-d9350ff2c7f9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:06.668522 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547ea3ce-aee5-4dbe-b5bf-3a57a0f2943a None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:55:06.687875 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547ea3ce-aee5-4dbe-b5bf-3a57a0f2943a None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:55:06.695937 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a78bce-d485-436d-96b8-22bbe4fbc084 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:55:06.697271 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a78bce-d485-436d-96b8-22bbe4fbc084 admin admin] REQUEST_METHOD: `PUT` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:06.697800 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a78bce-d485-436d-96b8-22bbe4fbc084 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:06.698341 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a78bce-d485-436d-96b8-22bbe4fbc084 admin admin] PATH_INFO: `/v3/projects/4f58b8a30d004067ac5271cdde491a5d/users/e5b4186e095945de97f4ed6f2c8c1fc7/roles/567db03c91854ad9af1e9a87ec1bd275` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:06.720363 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a78bce-d485-436d-96b8-22bbe4fbc084 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f58b8a30d004067ac5271cdde491a5d, user_id=e5b4186e095945de97f4ed6f2c8c1fc7, role_id=567db03c91854ad9af1e9a87ec1bd275)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:55:06.724490 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a78bce-d485-436d-96b8-22bbe4fbc084 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:55:06.766366 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 816/1627] 10.222.0.57 () {60 vars in 1483 bytes} [Fri Sep 16 07:55:06 2022] PUT /identity/v3/projects/4f58b8a30d004067ac5271cdde491a5d/users/e5b4186e095945de97f4ed6f2c8c1fc7/roles/567db03c91854ad9af1e9a87ec1bd275 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 07:55:06.766366 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a78bce-d485-436d-96b8-22bbe4fbc084 admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:55:06.790164 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d806c8bc-e5aa-4527-92be-d9350ff2c7f9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:55:06.791867 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d806c8bc-e5aa-4527-92be-d9350ff2c7f9 service nova] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:55:06.802899 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 812/1628] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Sep 16 07:55:06 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 07:55:06.803855 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d806c8bc-e5aa-4527-92be-d9350ff2c7f9 service nova] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:55:06.814057 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d806c8bc-e5aa-4527-92be-d9350ff2c7f9 service nova] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:55:06.899205 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52ce533-947b-4547-bcc8-92185a18a410 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:55:06.900995 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52ce533-947b-4547-bcc8-92185a18a410 admin admin] REQUEST_METHOD: `PUT` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:06.901589 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52ce533-947b-4547-bcc8-92185a18a410 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:06.902307 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52ce533-947b-4547-bcc8-92185a18a410 admin admin] PATH_INFO: `/v3/projects/8dca0e50f0054fe79a3d6b03222ccec7/users/60dcd5adb87b42bb85e65d5cb1dc0057/roles/567db03c91854ad9af1e9a87ec1bd275` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:06.913443 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a78bce-d485-436d-96b8-22bbe4fbc084 admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:55:06.925704 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52ce533-947b-4547-bcc8-92185a18a410 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8dca0e50f0054fe79a3d6b03222ccec7, user_id=60dcd5adb87b42bb85e65d5cb1dc0057, role_id=567db03c91854ad9af1e9a87ec1bd275)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:55:06.926503 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00022dce-7789-4564-a85b-6a65090f0f24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:55:06.928343 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00022dce-7789-4564-a85b-6a65090f0f24 admin admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:06.929312 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52ce533-947b-4547-bcc8-92185a18a410 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:55:06.929811 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00022dce-7789-4564-a85b-6a65090f0f24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:06.930263 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00022dce-7789-4564-a85b-6a65090f0f24 admin admin] PATH_INFO: `/v3/roles` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:06.931899 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00022dce-7789-4564-a85b-6a65090f0f24 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:55:06.937640 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00022dce-7789-4564-a85b-6a65090f0f24 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:55:06.948272 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 813/1629] 10.222.0.57 () {60 vars in 1483 bytes} [Fri Sep 16 07:55:06 2022] PUT /identity/v3/projects/8dca0e50f0054fe79a3d6b03222ccec7/users/60dcd5adb87b42bb85e65d5cb1dc0057/roles/567db03c91854ad9af1e9a87ec1bd275 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 07:55:06.951280 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52ce533-947b-4547-bcc8-92185a18a410 admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:55:06.967790 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 817/1630] 10.222.0.57 () {58 vars in 1122 bytes} [Fri Sep 16 07:55:06 2022] GET /identity/v3/roles => generated 1420 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 07:55:06.967790 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00022dce-7789-4564-a85b-6a65090f0f24 admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:55:06.980450 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00022dce-7789-4564-a85b-6a65090f0f24 admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:55:07.054994 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:55:07.099676 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52ce533-947b-4547-bcc8-92185a18a410 admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:55:07.108370 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb771327-8a5c-4ae4-9b32-db19b4c141d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:55:07.108957 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb771327-8a5c-4ae4-9b32-db19b4c141d1 admin admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:07.109236 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb771327-8a5c-4ae4-9b32-db19b4c141d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:07.112003 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83489af6-7308-435d-b5ec-eb191df1cafa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bec4d9b08514461a1bf63c6b88f53b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4735f453c0c24cc4a1c14e9ac84a0b46', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:55:07.113082 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83489af6-7308-435d-b5ec-eb191df1cafa service nova] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:07.113239 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb771327-8a5c-4ae4-9b32-db19b4c141d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:07.113356 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83489af6-7308-435d-b5ec-eb191df1cafa service nova] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:07.113632 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb771327-8a5c-4ae4-9b32-db19b4c141d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:55:07.114222 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83489af6-7308-435d-b5ec-eb191df1cafa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:07.115294 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb771327-8a5c-4ae4-9b32-db19b4c141d1 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:55:07.143589 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 818/1631] 10.222.0.57 () {58 vars in 1122 bytes} [Fri Sep 16 07:55:06 2022] GET /identity/v3/roles => generated 1420 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 07:55:07.143589 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb771327-8a5c-4ae4-9b32-db19b4c141d1 admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:55:07.168354 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb771327-8a5c-4ae4-9b32-db19b4c141d1 admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:55:07.178236 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940f7518-db0e-49c9-904b-7b0ebdbd500e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:55:07.178848 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940f7518-db0e-49c9-904b-7b0ebdbd500e admin admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:07.179130 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940f7518-db0e-49c9-904b-7b0ebdbd500e admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:07.179396 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940f7518-db0e-49c9-904b-7b0ebdbd500e admin admin] PATH_INFO: `/v3/roles` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:07.180618 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940f7518-db0e-49c9-904b-7b0ebdbd500e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:55:07.182236 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940f7518-db0e-49c9-904b-7b0ebdbd500e admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:55:07.187301 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83489af6-7308-435d-b5ec-eb191df1cafa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:55:07.189300 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83489af6-7308-435d-b5ec-eb191df1cafa service nova] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:55:07.204458 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 814/1632] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Sep 16 07:55:06 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 255 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 07:55:07.205312 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83489af6-7308-435d-b5ec-eb191df1cafa service nova] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:55:07.214599 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 819/1633] 10.222.0.57 () {58 vars in 1122 bytes} [Fri Sep 16 07:55:07 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 07:55:07.214748 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940f7518-db0e-49c9-904b-7b0ebdbd500e admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:55:07.219061 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83489af6-7308-435d-b5ec-eb191df1cafa service nova] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:55:07.224888 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc90b64-f600-4a6c-a7d4-91a0821b679f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:55:07.225675 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc90b64-f600-4a6c-a7d4-91a0821b679f admin admin] REQUEST_METHOD: `PUT` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:07.226051 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc90b64-f600-4a6c-a7d4-91a0821b679f admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:07.226391 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc90b64-f600-4a6c-a7d4-91a0821b679f admin admin] PATH_INFO: `/v3/projects/07ad2d24196b42b991fbc48db32f5149/users/ddb7d65d5cac46df9692b1d94c0a29db/roles/567db03c91854ad9af1e9a87ec1bd275` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:07.236667 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940f7518-db0e-49c9-904b-7b0ebdbd500e admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:55:07.246897 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc90b64-f600-4a6c-a7d4-91a0821b679f admin admin] RBAC: Authorizing `identity:create_grant(project_id=07ad2d24196b42b991fbc48db32f5149, user_id=ddb7d65d5cac46df9692b1d94c0a29db, role_id=567db03c91854ad9af1e9a87ec1bd275)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:55:07.248661 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb765a5-d32d-4b43-a66b-26d0d7e38804 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:55:07.249345 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb765a5-d32d-4b43-a66b-26d0d7e38804 admin admin] REQUEST_METHOD: `PUT` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:07.249625 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb765a5-d32d-4b43-a66b-26d0d7e38804 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:07.249928 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb765a5-d32d-4b43-a66b-26d0d7e38804 admin admin] PATH_INFO: `/v3/projects/4f58b8a30d004067ac5271cdde491a5d/users/e5b4186e095945de97f4ed6f2c8c1fc7/roles/567db03c91854ad9af1e9a87ec1bd275` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:07.250401 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc90b64-f600-4a6c-a7d4-91a0821b679f admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:55:07.256890 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb765a5-d32d-4b43-a66b-26d0d7e38804 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f58b8a30d004067ac5271cdde491a5d, user_id=e5b4186e095945de97f4ed6f2c8c1fc7, role_id=567db03c91854ad9af1e9a87ec1bd275)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:55:07.264322 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb765a5-d32d-4b43-a66b-26d0d7e38804 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:55:07.276789 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 815/1634] 10.222.0.57 () {60 vars in 1483 bytes} [Fri Sep 16 07:55:07 2022] PUT /identity/v3/projects/07ad2d24196b42b991fbc48db32f5149/users/ddb7d65d5cac46df9692b1d94c0a29db/roles/567db03c91854ad9af1e9a87ec1bd275 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 07:55:07.281689 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc90b64-f600-4a6c-a7d4-91a0821b679f admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:55:07.290700 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 820/1635] 10.222.0.57 () {60 vars in 1483 bytes} [Fri Sep 16 07:55:07 2022] PUT /identity/v3/projects/4f58b8a30d004067ac5271cdde491a5d/users/e5b4186e095945de97f4ed6f2c8c1fc7/roles/567db03c91854ad9af1e9a87ec1bd275 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 07:55:07.292457 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb765a5-d32d-4b43-a66b-26d0d7e38804 admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:55:07.315533 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:55:07.419060 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb765a5-d32d-4b43-a66b-26d0d7e38804 admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:55:07.424454 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc90b64-f600-4a6c-a7d4-91a0821b679f admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:55:07.431416 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a4b236-7159-44a5-8d10-6b29530c2434 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:55:07.431638 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71996b95-0bea-46dd-b787-095d5654b7ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:55:07.432044 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a4b236-7159-44a5-8d10-6b29530c2434 admin admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:07.432322 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a4b236-7159-44a5-8d10-6b29530c2434 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:07.432428 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71996b95-0bea-46dd-b787-095d5654b7ee admin admin] REQUEST_METHOD: `PUT` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:07.432590 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a4b236-7159-44a5-8d10-6b29530c2434 admin admin] PATH_INFO: `/v3/roles` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:07.432706 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71996b95-0bea-46dd-b787-095d5654b7ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:07.432921 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71996b95-0bea-46dd-b787-095d5654b7ee admin admin] PATH_INFO: `/v3/projects/8dca0e50f0054fe79a3d6b03222ccec7/users/60dcd5adb87b42bb85e65d5cb1dc0057/roles/567db03c91854ad9af1e9a87ec1bd275` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:07.433241 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a4b236-7159-44a5-8d10-6b29530c2434 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:55:07.434987 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71996b95-0bea-46dd-b787-095d5654b7ee admin admin] RBAC: Authorizing `identity:create_grant(project_id=8dca0e50f0054fe79a3d6b03222ccec7, user_id=60dcd5adb87b42bb85e65d5cb1dc0057, role_id=567db03c91854ad9af1e9a87ec1bd275)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:55:07.435117 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a4b236-7159-44a5-8d10-6b29530c2434 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:55:07.439148 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71996b95-0bea-46dd-b787-095d5654b7ee admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:55:07.454067 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 816/1636] 10.222.0.57 () {60 vars in 1483 bytes} [Fri Sep 16 07:55:07 2022] PUT /identity/v3/projects/8dca0e50f0054fe79a3d6b03222ccec7/users/60dcd5adb87b42bb85e65d5cb1dc0057/roles/567db03c91854ad9af1e9a87ec1bd275 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 07:55:07.455729 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1580c000-0931-4597-b48c-d607f2b44075 None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:07.456028 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1580c000-0931-4597-b48c-d607f2b44075 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:07.456452 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1580c000-0931-4597-b48c-d607f2b44075 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:07.461915 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 821/1637] 10.222.0.57 () {58 vars in 1122 bytes} [Fri Sep 16 07:55:07 2022] GET /identity/v3/roles => generated 1420 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 07:55:07.461915 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5c2fdf-f8f7-4157-91b2-52882ddf88e1 None None] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:07.461915 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5c2fdf-f8f7-4157-91b2-52882ddf88e1 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:07.461915 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5c2fdf-f8f7-4157-91b2-52882ddf88e1 None None] PATH_INFO: `/` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:07.463010 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 822/1638] 10.222.0.57 () {54 vars in 912 bytes} [Fri Sep 16 07:55:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 07:55:07.464892 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5c2fdf-f8f7-4157-91b2-52882ddf88e1 None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:55:07.502984 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-1580c000-0931-4597-b48c-d607f2b44075 None None] MFA Rules not processed for user `e5b4186e095945de97f4ed6f2c8c1fc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:55:07.505688 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-1580c000-0931-4597-b48c-d607f2b44075 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:55:07.571646 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:55:07.607877 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5c2fdf-f8f7-4157-91b2-52882ddf88e1 None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:55:07.621588 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 817/1639] 10.222.0.57 () {58 vars in 958 bytes} [Fri Sep 16 07:55:07 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 07:55:07.623490 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9e28d6-fe1f-4078-a0cd-eb634419db4d None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:07.623628 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9e28d6-fe1f-4078-a0cd-eb634419db4d None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:07.623780 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9e28d6-fe1f-4078-a0cd-eb634419db4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:07.626201 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a66a7f-dfef-4d6c-a274-ef5716c43af2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:55:07.627849 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a66a7f-dfef-4d6c-a274-ef5716c43af2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:07.628765 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a66a7f-dfef-4d6c-a274-ef5716c43af2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:07.630710 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a66a7f-dfef-4d6c-a274-ef5716c43af2 admin admin] PATH_INFO: `/v3/projects/07ad2d24196b42b991fbc48db32f5149/users/ddb7d65d5cac46df9692b1d94c0a29db/roles/567db03c91854ad9af1e9a87ec1bd275` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:07.637520 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a66a7f-dfef-4d6c-a274-ef5716c43af2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=07ad2d24196b42b991fbc48db32f5149, user_id=ddb7d65d5cac46df9692b1d94c0a29db, role_id=567db03c91854ad9af1e9a87ec1bd275)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:55:07.640795 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a66a7f-dfef-4d6c-a274-ef5716c43af2 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:55:07.667262 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-fb9e28d6-fe1f-4078-a0cd-eb634419db4d None None] MFA Rules not processed for user `60dcd5adb87b42bb85e65d5cb1dc0057`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:55:07.667446 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 823/1640] 10.222.0.57 () {60 vars in 1483 bytes} [Fri Sep 16 07:55:07 2022] PUT /identity/v3/projects/07ad2d24196b42b991fbc48db32f5149/users/ddb7d65d5cac46df9692b1d94c0a29db/roles/567db03c91854ad9af1e9a87ec1bd275 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 07:55:07.668496 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-fb9e28d6-fe1f-4078-a0cd-eb634419db4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:55:07.668632 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe92faef-721b-41b6-a62d-fc361d035725 None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:07.668916 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe92faef-721b-41b6-a62d-fc361d035725 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:07.669266 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe92faef-721b-41b6-a62d-fc361d035725 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:07.711414 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-fe92faef-721b-41b6-a62d-fc361d035725 None None] MFA Rules not processed for user `9bec4d9b08514461a1bf63c6b88f53b2`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:55:07.712776 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-fe92faef-721b-41b6-a62d-fc361d035725 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:55:07.787217 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 818/1641] 10.222.0.57 () {58 vars in 958 bytes} [Fri Sep 16 07:55:07 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 07:55:07.788375 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9e28d6-fe1f-4078-a0cd-eb634419db4d None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:55:07.842274 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 824/1642] 10.222.0.57 () {58 vars in 1009 bytes} [Fri Sep 16 07:55:07 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 07:55:07.844768 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e91080-a8c9-414d-b0da-1c9b968627d5 None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:07.845159 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e91080-a8c9-414d-b0da-1c9b968627d5 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:07.845579 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e91080-a8c9-414d-b0da-1c9b968627d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:07.888008 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-27e91080-a8c9-414d-b0da-1c9b968627d5 None None] MFA Rules not processed for user `ddb7d65d5cac46df9692b1d94c0a29db`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:55:07.890912 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-27e91080-a8c9-414d-b0da-1c9b968627d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:55:07.903021 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9e28d6-fe1f-4078-a0cd-eb634419db4d None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:55:07.914339 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d0b965-e8e1-485d-95fa-718e6bfef792 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544bf6be4c24454a013ca110c43cef2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4735f453c0c24cc4a1c14e9ac84a0b46', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:55:07.914964 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d0b965-e8e1-485d-95fa-718e6bfef792 service cinder] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:07.915242 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d0b965-e8e1-485d-95fa-718e6bfef792 service cinder] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:07.915512 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d0b965-e8e1-485d-95fa-718e6bfef792 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:07.927888 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:55:08.119883 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d0b965-e8e1-485d-95fa-718e6bfef792 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:55:08.119883 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d0b965-e8e1-485d-95fa-718e6bfef792 service cinder] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:55:08.123148 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 819/1643] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Sep 16 07:55:07 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 07:55:08.123148 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d4c5e0-5e3e-471a-a5e6-6a6d9bbba548 None None] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:08.123148 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d4c5e0-5e3e-471a-a5e6-6a6d9bbba548 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:08.123148 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d4c5e0-5e3e-471a-a5e6-6a6d9bbba548 None None] PATH_INFO: `/` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:08.130338 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 820/1644] 10.222.0.57 () {54 vars in 912 bytes} [Fri Sep 16 07:55:08 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 07:55:08.131231 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d4c5e0-5e3e-471a-a5e6-6a6d9bbba548 None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:55:08.164956 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d4c5e0-5e3e-471a-a5e6-6a6d9bbba548 None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:55:08.168234 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 825/1645] 10.222.0.57 () {58 vars in 958 bytes} [Fri Sep 16 07:55:07 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 325 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 07:55:08.169818 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098d4362-9405-43cd-a4e3-a988463780be None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:08.170176 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098d4362-9405-43cd-a4e3-a988463780be None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:08.170394 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098d4362-9405-43cd-a4e3-a988463780be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:08.191224 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015a32c2-d0e8-401a-9872-99206c7e6f30 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544bf6be4c24454a013ca110c43cef2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4735f453c0c24cc4a1c14e9ac84a0b46', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:55:08.191804 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015a32c2-d0e8-401a-9872-99206c7e6f30 service cinder] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:08.192199 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015a32c2-d0e8-401a-9872-99206c7e6f30 service cinder] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:08.192443 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015a32c2-d0e8-401a-9872-99206c7e6f30 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:08.227060 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-098d4362-9405-43cd-a4e3-a988463780be None None] MFA Rules not processed for user `9bec4d9b08514461a1bf63c6b88f53b2`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:55:08.228292 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-098d4362-9405-43cd-a4e3-a988463780be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:55:08.236415 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015a32c2-d0e8-401a-9872-99206c7e6f30 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:55:08.237923 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015a32c2-d0e8-401a-9872-99206c7e6f30 service cinder] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:55:08.266475 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 821/1646] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Sep 16 07:55:08 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 07:55:08.267720 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 826/1647] 10.222.0.57 () {58 vars in 1009 bytes} [Fri Sep 16 07:55:08 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 07:55:08.280874 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015a32c2-d0e8-401a-9872-99206c7e6f30 service cinder] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:55:08.296862 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:55:08.321475 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015a32c2-d0e8-401a-9872-99206c7e6f30 service cinder] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:55:08.341146 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463462c9-2283-4100-99d7-29308f7770d3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544bf6be4c24454a013ca110c43cef2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4735f453c0c24cc4a1c14e9ac84a0b46', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:55:08.342077 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463462c9-2283-4100-99d7-29308f7770d3 service cinder] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:08.342518 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463462c9-2283-4100-99d7-29308f7770d3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:08.342631 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463462c9-2283-4100-99d7-29308f7770d3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:08.364480 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463462c9-2283-4100-99d7-29308f7770d3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:55:08.366276 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463462c9-2283-4100-99d7-29308f7770d3 service cinder] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:55:08.402697 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098d4362-9405-43cd-a4e3-a988463780be None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:55:08.417782 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098d4362-9405-43cd-a4e3-a988463780be None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:55:08.429334 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 822/1648] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Sep 16 07:55:08 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 07:55:08.433675 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b5c95b-1b61-49ea-898e-99a34de75884 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544bf6be4c24454a013ca110c43cef2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4735f453c0c24cc4a1c14e9ac84a0b46', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:55:08.435105 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b5c95b-1b61-49ea-898e-99a34de75884 service cinder] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:08.435267 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b5c95b-1b61-49ea-898e-99a34de75884 service cinder] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:08.435676 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b5c95b-1b61-49ea-898e-99a34de75884 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:08.477855 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b5c95b-1b61-49ea-898e-99a34de75884 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:55:08.480684 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b5c95b-1b61-49ea-898e-99a34de75884 service cinder] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:55:08.535646 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 827/1649] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Sep 16 07:55:08 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 16 07:55:08.697030 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463462c9-2283-4100-99d7-29308f7770d3 service cinder] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:55:08.706873 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463462c9-2283-4100-99d7-29308f7770d3 service cinder] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:55:08.712357 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3f2796-ecc8-448e-ac9f-3e39f27af8b1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544bf6be4c24454a013ca110c43cef2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4735f453c0c24cc4a1c14e9ac84a0b46', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:55:08.713187 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3f2796-ecc8-448e-ac9f-3e39f27af8b1 service cinder] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:08.713300 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3f2796-ecc8-448e-ac9f-3e39f27af8b1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:08.713547 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3f2796-ecc8-448e-ac9f-3e39f27af8b1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:08.743210 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3f2796-ecc8-448e-ac9f-3e39f27af8b1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:55:08.746611 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3f2796-ecc8-448e-ac9f-3e39f27af8b1 service cinder] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:55:08.764486 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 823/1650] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Sep 16 07:55:08 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 07:55:09.740161 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b5c95b-1b61-49ea-898e-99a34de75884 service cinder] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:55:09.755502 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b5c95b-1b61-49ea-898e-99a34de75884 service cinder] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:55:09.770773 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062147e1-a30e-4b52-aa6a-744bcb263bc6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544bf6be4c24454a013ca110c43cef2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4735f453c0c24cc4a1c14e9ac84a0b46', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:55:09.771313 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062147e1-a30e-4b52-aa6a-744bcb263bc6 service cinder] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:09.771681 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062147e1-a30e-4b52-aa6a-744bcb263bc6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:09.771950 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062147e1-a30e-4b52-aa6a-744bcb263bc6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:10.004463 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062147e1-a30e-4b52-aa6a-744bcb263bc6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:55:10.005964 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062147e1-a30e-4b52-aa6a-744bcb263bc6 service cinder] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:55:10.023458 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3f2796-ecc8-448e-ac9f-3e39f27af8b1 service cinder] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:55:10.036495 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3f2796-ecc8-448e-ac9f-3e39f27af8b1 service cinder] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:55:10.041037 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b087394f-aab9-42fd-abec-9996a0b04862 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544bf6be4c24454a013ca110c43cef2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4735f453c0c24cc4a1c14e9ac84a0b46', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:55:10.042058 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b087394f-aab9-42fd-abec-9996a0b04862 service cinder] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:10.042346 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b087394f-aab9-42fd-abec-9996a0b04862 service cinder] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:10.042722 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b087394f-aab9-42fd-abec-9996a0b04862 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:10.045757 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 828/1651] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Sep 16 07:55:09 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 07:55:10.170136 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b087394f-aab9-42fd-abec-9996a0b04862 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:55:10.171676 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b087394f-aab9-42fd-abec-9996a0b04862 service cinder] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:55:10.212898 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 824/1652] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Sep 16 07:55:10 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 07:55:12.301953 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062147e1-a30e-4b52-aa6a-744bcb263bc6 service cinder] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:55:12.566812 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062147e1-a30e-4b52-aa6a-744bcb263bc6 service cinder] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:55:12.600460 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20480e57-da05-48e3-9bf6-2ab0ae0169a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:55:12.601623 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20480e57-da05-48e3-9bf6-2ab0ae0169a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:12.601942 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20480e57-da05-48e3-9bf6-2ab0ae0169a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:12.604314 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20480e57-da05-48e3-9bf6-2ab0ae0169a8 admin admin] PATH_INFO: `/v3/users/419aaf2c9ad54db28c199fd717ffe015` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:12.609245 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20480e57-da05-48e3-9bf6-2ab0ae0169a8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=419aaf2c9ad54db28c199fd717ffe015)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:55:12.616230 dv-cinder-740146-20-smb devstack@keystone.service[81430]: WARNING py.warnings [None req-20480e57-da05-48e3-9bf6-2ab0ae0169a8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 16 07:55:12.616230 dv-cinder-740146-20-smb devstack@keystone.service[81430]: warnings.warn(msg) Sep 16 07:55:12.616230 dv-cinder-740146-20-smb devstack@keystone.service[81430]: Sep 16 07:55:12.621167 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20480e57-da05-48e3-9bf6-2ab0ae0169a8 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:55:12.792841 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:55:12.820395 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-20480e57-da05-48e3-9bf6-2ab0ae0169a8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '419aaf2c9ad54db28c199fd717ffe015'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:55:12.821289 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-20480e57-da05-48e3-9bf6-2ab0ae0169a8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '419aaf2c9ad54db28c199fd717ffe015'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:55:12.833296 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-20480e57-da05-48e3-9bf6-2ab0ae0169a8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '419aaf2c9ad54db28c199fd717ffe015'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:55:12.866792 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-20480e57-da05-48e3-9bf6-2ab0ae0169a8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '419aaf2c9ad54db28c199fd717ffe015'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:55:12.886120 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-20480e57-da05-48e3-9bf6-2ab0ae0169a8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '419aaf2c9ad54db28c199fd717ffe015'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:55:12.896564 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 829/1653] 10.222.0.57 () {58 vars in 1224 bytes} [Fri Sep 16 07:55:12 2022] DELETE /identity/v3/users/419aaf2c9ad54db28c199fd717ffe015 => generated 0 bytes in 598 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 07:55:12.901530 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a2de55-2b5d-4083-9993-58c9c35abc2f None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:12.902657 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a2de55-2b5d-4083-9993-58c9c35abc2f None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:12.903089 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a2de55-2b5d-4083-9993-58c9c35abc2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:12.931610 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-29a2de55-2b5d-4083-9993-58c9c35abc2f None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:55:12.933821 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-29a2de55-2b5d-4083-9993-58c9c35abc2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:55:13.015256 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 825/1654] 10.222.0.57 () {58 vars in 958 bytes} [Fri Sep 16 07:55:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 07:55:13.037936 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20480e57-da05-48e3-9bf6-2ab0ae0169a8 admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:55:13.040224 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-20480e57-da05-48e3-9bf6-2ab0ae0169a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:55:13.058301 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a2de55-2b5d-4083-9993-58c9c35abc2f None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:55:13.061667 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-29a2de55-2b5d-4083-9993-58c9c35abc2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:55:13.094324 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a2de55-2b5d-4083-9993-58c9c35abc2f None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:55:13.118081 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8aac76-ac8e-4722-971b-9911d0524375 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:55:13.119744 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8aac76-ac8e-4722-971b-9911d0524375 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:13.120456 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8aac76-ac8e-4722-971b-9911d0524375 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:13.120891 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8aac76-ac8e-4722-971b-9911d0524375 admin admin] PATH_INFO: `/v3/users/9dd6a20681a74e76a3dbe33ae94eacd7` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:13.122678 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8aac76-ac8e-4722-971b-9911d0524375 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9dd6a20681a74e76a3dbe33ae94eacd7)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:55:13.125485 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8aac76-ac8e-4722-971b-9911d0524375 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:55:13.221293 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20480e57-da05-48e3-9bf6-2ab0ae0169a8 admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:55:13.235033 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0d4356-476d-41f6-9b9f-4982e2a6ca2c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1062e457207a41e4ba4f0a0c4bf36f1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4735f453c0c24cc4a1c14e9ac84a0b46', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:55:13.235714 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0d4356-476d-41f6-9b9f-4982e2a6ca2c service neutron] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:13.236999 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0d4356-476d-41f6-9b9f-4982e2a6ca2c service neutron] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:13.237119 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-7d8aac76-ac8e-4722-971b-9911d0524375 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9dd6a20681a74e76a3dbe33ae94eacd7'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:55:13.237994 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0d4356-476d-41f6-9b9f-4982e2a6ca2c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:13.263182 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0d4356-476d-41f6-9b9f-4982e2a6ca2c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:55:13.267290 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0d4356-476d-41f6-9b9f-4982e2a6ca2c service neutron] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:55:13.272467 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-7d8aac76-ac8e-4722-971b-9911d0524375 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9dd6a20681a74e76a3dbe33ae94eacd7'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:55:13.273359 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-7d8aac76-ac8e-4722-971b-9911d0524375 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9dd6a20681a74e76a3dbe33ae94eacd7'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:55:13.285464 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:55:13.288118 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 830/1655] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Sep 16 07:55:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 251 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 07:55:13.290882 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-7d8aac76-ac8e-4722-971b-9911d0524375 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9dd6a20681a74e76a3dbe33ae94eacd7'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:55:13.302552 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-7d8aac76-ac8e-4722-971b-9911d0524375 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9dd6a20681a74e76a3dbe33ae94eacd7'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:55:13.326975 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752c7f03-4701-4c0f-b6dc-b9ce6762ac97 None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:13.327506 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752c7f03-4701-4c0f-b6dc-b9ce6762ac97 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:13.327613 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 826/1656] 10.222.0.57 () {58 vars in 1224 bytes} [Fri Sep 16 07:55:13 2022] DELETE /identity/v3/users/9dd6a20681a74e76a3dbe33ae94eacd7 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 16 07:55:13.327692 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752c7f03-4701-4c0f-b6dc-b9ce6762ac97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:13.364411 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-752c7f03-4701-4c0f-b6dc-b9ce6762ac97 None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:55:13.366419 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-752c7f03-4701-4c0f-b6dc-b9ce6762ac97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:55:13.460575 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 831/1657] 10.222.0.57 () {58 vars in 958 bytes} [Fri Sep 16 07:55:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 07:55:14.008764 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8aac76-ac8e-4722-971b-9911d0524375 admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:55:14.011010 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-7d8aac76-ac8e-4722-971b-9911d0524375 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:55:14.214287 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1729647b-4a68-48d3-94be-da22355d1805 None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:14.214568 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1729647b-4a68-48d3-94be-da22355d1805 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:14.215030 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1729647b-4a68-48d3-94be-da22355d1805 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:14.251613 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8aac76-ac8e-4722-971b-9911d0524375 admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:55:14.267987 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef721c18-0091-47de-b6d2-3226d164ed1a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1062e457207a41e4ba4f0a0c4bf36f1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4735f453c0c24cc4a1c14e9ac84a0b46', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:55:14.274029 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef721c18-0091-47de-b6d2-3226d164ed1a service neutron] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:14.274610 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef721c18-0091-47de-b6d2-3226d164ed1a service neutron] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:14.275042 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef721c18-0091-47de-b6d2-3226d164ed1a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:14.298881 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-1729647b-4a68-48d3-94be-da22355d1805 None None] MFA Rules not processed for user `bb5935d098a241679b2957e8c4742168`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:55:14.300733 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef721c18-0091-47de-b6d2-3226d164ed1a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:55:14.302401 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef721c18-0091-47de-b6d2-3226d164ed1a service neutron] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:55:14.303464 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-1729647b-4a68-48d3-94be-da22355d1805 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:55:14.361293 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 827/1658] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Sep 16 07:55:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 07:55:14.364790 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef721c18-0091-47de-b6d2-3226d164ed1a service neutron] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:55:14.368219 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-ef721c18-0091-47de-b6d2-3226d164ed1a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:55:14.436077 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef721c18-0091-47de-b6d2-3226d164ed1a service neutron] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:55:14.467030 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8570b18f-5e94-4873-9537-399d137110f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:55:14.469345 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8570b18f-5e94-4873-9537-399d137110f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:14.470053 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8570b18f-5e94-4873-9537-399d137110f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:14.471675 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8570b18f-5e94-4873-9537-399d137110f3 admin admin] PATH_INFO: `/v3/projects/43d3d7de170e47b181f5d374e4520117` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:14.475689 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8570b18f-5e94-4873-9537-399d137110f3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=43d3d7de170e47b181f5d374e4520117)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:55:14.477549 dv-cinder-740146-20-smb devstack@keystone.service[81431]: WARNING py.warnings [None req-8570b18f-5e94-4873-9537-399d137110f3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 16 07:55:14.477549 dv-cinder-740146-20-smb devstack@keystone.service[81431]: warnings.warn(msg) Sep 16 07:55:14.477549 dv-cinder-740146-20-smb devstack@keystone.service[81431]: Sep 16 07:55:14.479402 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8570b18f-5e94-4873-9537-399d137110f3 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:55:14.505799 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:55:14.547694 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 832/1659] 10.222.0.57 () {58 vars in 958 bytes} [Fri Sep 16 07:55:14 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 334 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 16 07:55:14.563060 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1729647b-4a68-48d3-94be-da22355d1805 None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:55:14.564710 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-1729647b-4a68-48d3-94be-da22355d1805 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:55:14.639421 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-8570b18f-5e94-4873-9537-399d137110f3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '43d3d7de170e47b181f5d374e4520117', 'request_id': 'req-8570b18f-5e94-4873-9537-399d137110f3'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:55:14.666899 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-8570b18f-5e94-4873-9537-399d137110f3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '43d3d7de170e47b181f5d374e4520117', 'request_id': 'req-8570b18f-5e94-4873-9537-399d137110f3'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:55:14.685008 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-8570b18f-5e94-4873-9537-399d137110f3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '43d3d7de170e47b181f5d374e4520117', 'request_id': 'req-8570b18f-5e94-4873-9537-399d137110f3'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:55:14.723841 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-8570b18f-5e94-4873-9537-399d137110f3 admin admin] The token cache is being invalidate because project 43d3d7de170e47b181f5d374e4520117 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81431) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 07:55:14.724155 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-8570b18f-5e94-4873-9537-399d137110f3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:55:14.725966 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-8570b18f-5e94-4873-9537-399d137110f3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:55:14.729900 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 828/1660] 10.222.0.57 () {58 vars in 1233 bytes} [Fri Sep 16 07:55:14 2022] DELETE /identity/v3/projects/43d3d7de170e47b181f5d374e4520117 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 07:55:14.735567 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41d9b6a-f50d-4a39-8a06-fc48d7d8d80d None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:14.736664 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41d9b6a-f50d-4a39-8a06-fc48d7d8d80d None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:14.737049 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41d9b6a-f50d-4a39-8a06-fc48d7d8d80d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:14.779216 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1729647b-4a68-48d3-94be-da22355d1805 None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:55:14.779847 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-f41d9b6a-f50d-4a39-8a06-fc48d7d8d80d None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:55:14.781151 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-f41d9b6a-f50d-4a39-8a06-fc48d7d8d80d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:55:14.959023 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c771c66b-76d5-44ee-b657-01de71bbbbb8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bec4d9b08514461a1bf63c6b88f53b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4735f453c0c24cc4a1c14e9ac84a0b46', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:55:14.959653 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c771c66b-76d5-44ee-b657-01de71bbbbb8 service nova] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:14.959935 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c771c66b-76d5-44ee-b657-01de71bbbbb8 service nova] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:14.960277 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c771c66b-76d5-44ee-b657-01de71bbbbb8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:14.966684 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 829/1661] 10.222.0.57 () {58 vars in 958 bytes} [Fri Sep 16 07:55:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 16 07:55:14.966851 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-c771c66b-76d5-44ee-b657-01de71bbbbb8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:55:14.969637 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6ffc77-a390-4e78-bfd5-e472b462d34f None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:14.970789 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6ffc77-a390-4e78-bfd5-e472b462d34f None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:14.971483 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6ffc77-a390-4e78-bfd5-e472b462d34f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:15.018703 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-eb6ffc77-a390-4e78-bfd5-e472b462d34f None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:55:15.026204 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-eb6ffc77-a390-4e78-bfd5-e472b462d34f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:55:15.048216 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 830/1662] 10.222.0.57 () {58 vars in 958 bytes} [Fri Sep 16 07:55:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 07:55:15.053342 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6ffc77-a390-4e78-bfd5-e472b462d34f None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:55:15.081771 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6ffc77-a390-4e78-bfd5-e472b462d34f None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:55:15.096511 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c99ca1-1960-4119-b7e8-7766c6bb7f73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:55:15.097198 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c99ca1-1960-4119-b7e8-7766c6bb7f73 admin admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:15.098495 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c99ca1-1960-4119-b7e8-7766c6bb7f73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:15.098775 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c99ca1-1960-4119-b7e8-7766c6bb7f73 admin admin] PATH_INFO: `/v3/domains` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:15.099436 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c99ca1-1960-4119-b7e8-7766c6bb7f73 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:55:15.103469 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c99ca1-1960-4119-b7e8-7766c6bb7f73 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:55:15.105594 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c99ca1-1960-4119-b7e8-7766c6bb7f73 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:55:15.114329 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:55:15.140093 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 831/1663] 10.222.0.57 () {58 vars in 1153 bytes} [Fri Sep 16 07:55:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:55:15.141382 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c99ca1-1960-4119-b7e8-7766c6bb7f73 admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:55:15.188972 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c99ca1-1960-4119-b7e8-7766c6bb7f73 admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:55:15.200139 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d22eec-5b3a-4dad-a1fc-4f0f80fd4701 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:55:15.202335 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d22eec-5b3a-4dad-a1fc-4f0f80fd4701 admin admin] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:15.202926 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c771c66b-76d5-44ee-b657-01de71bbbbb8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:55:15.204423 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c771c66b-76d5-44ee-b657-01de71bbbbb8 service nova] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:55:15.207122 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d22eec-5b3a-4dad-a1fc-4f0f80fd4701 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:15.207846 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d22eec-5b3a-4dad-a1fc-4f0f80fd4701 admin admin] PATH_INFO: `/v3/projects` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:15.208746 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d22eec-5b3a-4dad-a1fc-4f0f80fd4701 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:55:15.215130 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d22eec-5b3a-4dad-a1fc-4f0f80fd4701 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:55:15.246780 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 833/1664] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Sep 16 07:55:14 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 685 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 07:55:15.334030 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c771c66b-76d5-44ee-b657-01de71bbbbb8 service nova] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:55:15.349462 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 832/1665] 10.222.0.57 () {60 vars in 1153 bytes} [Fri Sep 16 07:55:15 2022] POST /identity/v3/projects => generated 405 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 07:55:15.350705 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c771c66b-76d5-44ee-b657-01de71bbbbb8 service nova] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:55:15.435733 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:55:15.572837 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d22eec-5b3a-4dad-a1fc-4f0f80fd4701 admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:55:15.574751 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-25d22eec-5b3a-4dad-a1fc-4f0f80fd4701 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:55:15.627562 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46591feb-474f-43df-9735-6697551cc468 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:55:15.628868 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46591feb-474f-43df-9735-6697551cc468 admin admin] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:15.629051 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46591feb-474f-43df-9735-6697551cc468 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:15.629274 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46591feb-474f-43df-9735-6697551cc468 admin admin] PATH_INFO: `/v3/users` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:15.629971 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46591feb-474f-43df-9735-6697551cc468 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:55:15.640056 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46591feb-474f-43df-9735-6697551cc468 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:55:15.736604 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 834/1666] 10.222.0.57 () {60 vars in 1144 bytes} [Fri Sep 16 07:55:15 2022] POST /identity/v3/users => generated 303 bytes in 399 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 16 07:55:15.738526 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46591feb-474f-43df-9735-6697551cc468 admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:55:15.776489 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46591feb-474f-43df-9735-6697551cc468 admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:55:15.803610 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddde00f4-f881-495e-beae-3dc1523bc4f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:55:15.805646 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddde00f4-f881-495e-beae-3dc1523bc4f7 admin admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:15.806016 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddde00f4-f881-495e-beae-3dc1523bc4f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:15.806303 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddde00f4-f881-495e-beae-3dc1523bc4f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:15.806975 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddde00f4-f881-495e-beae-3dc1523bc4f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:55:15.809762 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddde00f4-f881-495e-beae-3dc1523bc4f7 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:55:15.824249 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d22eec-5b3a-4dad-a1fc-4f0f80fd4701 admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:55:15.828402 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 835/1667] 10.222.0.57 () {58 vars in 1122 bytes} [Fri Sep 16 07:55:15 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 07:55:15.828402 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddde00f4-f881-495e-beae-3dc1523bc4f7 admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:55:15.829307 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-ddde00f4-f881-495e-beae-3dc1523bc4f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:55:15.843035 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34257d34-abfe-444e-8a2c-5e2b8c33b2a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:55:15.844302 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34257d34-abfe-444e-8a2c-5e2b8c33b2a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:15.845580 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34257d34-abfe-444e-8a2c-5e2b8c33b2a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:15.850149 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34257d34-abfe-444e-8a2c-5e2b8c33b2a7 admin admin] PATH_INFO: `/v3/users/b606a6e5afe44fb786c2c655912414e4` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:15.852307 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34257d34-abfe-444e-8a2c-5e2b8c33b2a7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b606a6e5afe44fb786c2c655912414e4)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:55:15.854520 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34257d34-abfe-444e-8a2c-5e2b8c33b2a7 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:55:15.855044 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddde00f4-f881-495e-beae-3dc1523bc4f7 admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:55:15.860816 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c10bcc6-4d07-459e-8063-bf066c329f51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:55:15.861716 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c10bcc6-4d07-459e-8063-bf066c329f51 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:15.862160 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c10bcc6-4d07-459e-8063-bf066c329f51 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:15.862709 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c10bcc6-4d07-459e-8063-bf066c329f51 admin admin] PATH_INFO: `/v3/projects/88c66fd46dbd48b5ae12b957f693f371` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:15.864045 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c10bcc6-4d07-459e-8063-bf066c329f51 admin admin] RBAC: Authorizing `identity:delete_project(project_id=88c66fd46dbd48b5ae12b957f693f371)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:55:15.866297 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c10bcc6-4d07-459e-8063-bf066c329f51 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:55:15.984522 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-34257d34-abfe-444e-8a2c-5e2b8c33b2a7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b606a6e5afe44fb786c2c655912414e4'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:55:15.987486 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-6c10bcc6-4d07-459e-8063-bf066c329f51 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '88c66fd46dbd48b5ae12b957f693f371', 'request_id': 'req-6c10bcc6-4d07-459e-8063-bf066c329f51'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:55:16.022901 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-6c10bcc6-4d07-459e-8063-bf066c329f51 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '88c66fd46dbd48b5ae12b957f693f371', 'request_id': 'req-6c10bcc6-4d07-459e-8063-bf066c329f51'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:55:16.062652 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-6c10bcc6-4d07-459e-8063-bf066c329f51 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '88c66fd46dbd48b5ae12b957f693f371', 'request_id': 'req-6c10bcc6-4d07-459e-8063-bf066c329f51'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:55:16.068129 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-34257d34-abfe-444e-8a2c-5e2b8c33b2a7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b606a6e5afe44fb786c2c655912414e4'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:55:16.071980 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-34257d34-abfe-444e-8a2c-5e2b8c33b2a7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b606a6e5afe44fb786c2c655912414e4'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:55:16.085908 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-34257d34-abfe-444e-8a2c-5e2b8c33b2a7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b606a6e5afe44fb786c2c655912414e4'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:55:16.095836 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-6c10bcc6-4d07-459e-8063-bf066c329f51 admin admin] The token cache is being invalidate because project 88c66fd46dbd48b5ae12b957f693f371 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81430) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 07:55:16.096135 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-6c10bcc6-4d07-459e-8063-bf066c329f51 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:55:16.098891 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-6c10bcc6-4d07-459e-8063-bf066c329f51 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:55:16.103393 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 836/1668] 10.222.0.57 () {58 vars in 1233 bytes} [Fri Sep 16 07:55:15 2022] DELETE /identity/v3/projects/88c66fd46dbd48b5ae12b957f693f371 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 07:55:16.104472 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c10bcc6-4d07-459e-8063-bf066c329f51 admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:55:16.105932 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-6c10bcc6-4d07-459e-8063-bf066c329f51 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:55:16.123460 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-34257d34-abfe-444e-8a2c-5e2b8c33b2a7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b606a6e5afe44fb786c2c655912414e4'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:55:16.150388 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 833/1669] 10.222.0.57 () {58 vars in 1224 bytes} [Fri Sep 16 07:55:15 2022] DELETE /identity/v3/users/b606a6e5afe44fb786c2c655912414e4 => generated 0 bytes in 574 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 07:55:16.153470 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34257d34-abfe-444e-8a2c-5e2b8c33b2a7 admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:55:16.161878 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-34257d34-abfe-444e-8a2c-5e2b8c33b2a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:55:16.269785 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c10bcc6-4d07-459e-8063-bf066c329f51 admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:55:16.366064 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:55:16.455928 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:55:16.485473 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095eef66-5a0a-43d2-9525-3064fca914fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:55:16.487002 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095eef66-5a0a-43d2-9525-3064fca914fb admin admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:16.489302 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095eef66-5a0a-43d2-9525-3064fca914fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:16.489857 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095eef66-5a0a-43d2-9525-3064fca914fb admin admin] PATH_INFO: `/v3/roles` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:16.490907 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095eef66-5a0a-43d2-9525-3064fca914fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:55:16.491254 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34257d34-abfe-444e-8a2c-5e2b8c33b2a7 admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:55:16.497158 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095eef66-5a0a-43d2-9525-3064fca914fb admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:55:16.511486 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3f2314-c160-40f4-84a6-9b1c7ccae3ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:55:16.514385 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3f2314-c160-40f4-84a6-9b1c7ccae3ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:16.514883 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3f2314-c160-40f4-84a6-9b1c7ccae3ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:16.517369 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3f2314-c160-40f4-84a6-9b1c7ccae3ce admin admin] PATH_INFO: `/v3/users/ddb7d65d5cac46df9692b1d94c0a29db` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:16.527923 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3f2314-c160-40f4-84a6-9b1c7ccae3ce admin admin] RBAC: Authorizing `identity:delete_user(user_id=ddb7d65d5cac46df9692b1d94c0a29db)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:55:16.532812 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3f2314-c160-40f4-84a6-9b1c7ccae3ce admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:55:16.543853 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 837/1670] 10.222.0.57 () {58 vars in 1122 bytes} [Fri Sep 16 07:55:16 2022] GET /identity/v3/roles => generated 1420 bytes in 440 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 07:55:16.553355 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c3737f-1a40-4205-94ee-3a05a7df0c73 None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:16.553695 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c3737f-1a40-4205-94ee-3a05a7df0c73 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:16.555469 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c3737f-1a40-4205-94ee-3a05a7df0c73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:16.616592 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-18c3737f-1a40-4205-94ee-3a05a7df0c73 None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:55:16.620600 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-18c3737f-1a40-4205-94ee-3a05a7df0c73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:55:16.644116 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 838/1671] 10.222.0.57 () {58 vars in 958 bytes} [Fri Sep 16 07:55:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 07:55:16.645246 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c3737f-1a40-4205-94ee-3a05a7df0c73 None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:55:16.658326 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c3737f-1a40-4205-94ee-3a05a7df0c73 None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:55:16.679398 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea043e85-290e-4f76-b6e7-013201adfe91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:55:16.680499 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea043e85-290e-4f76-b6e7-013201adfe91 admin admin] REQUEST_METHOD: `PUT` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:16.680960 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea043e85-290e-4f76-b6e7-013201adfe91 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:16.681420 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea043e85-290e-4f76-b6e7-013201adfe91 admin admin] PATH_INFO: `/v3/projects/76eecaff299e427787aadbd1bc9a1a01/users/7acd9907fd3149d691366c2ae8d4ff5d/roles/4818d38cf2564825b312e66c9eb24762` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:16.698122 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-cc3f2314-c160-40f4-84a6-9b1c7ccae3ce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ddb7d65d5cac46df9692b1d94c0a29db'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:55:16.719991 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea043e85-290e-4f76-b6e7-013201adfe91 admin admin] RBAC: Authorizing `identity:create_grant(project_id=76eecaff299e427787aadbd1bc9a1a01, user_id=7acd9907fd3149d691366c2ae8d4ff5d, role_id=4818d38cf2564825b312e66c9eb24762)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:55:16.724824 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea043e85-290e-4f76-b6e7-013201adfe91 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:55:16.740612 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-cc3f2314-c160-40f4-84a6-9b1c7ccae3ce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ddb7d65d5cac46df9692b1d94c0a29db'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:55:16.741331 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-cc3f2314-c160-40f4-84a6-9b1c7ccae3ce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ddb7d65d5cac46df9692b1d94c0a29db'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:55:16.763433 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-cc3f2314-c160-40f4-84a6-9b1c7ccae3ce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ddb7d65d5cac46df9692b1d94c0a29db'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:55:16.763549 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 839/1672] 10.222.0.57 () {60 vars in 1483 bytes} [Fri Sep 16 07:55:16 2022] PUT /identity/v3/projects/76eecaff299e427787aadbd1bc9a1a01/users/7acd9907fd3149d691366c2ae8d4ff5d/roles/4818d38cf2564825b312e66c9eb24762 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 07:55:16.764679 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea043e85-290e-4f76-b6e7-013201adfe91 admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:55:16.768690 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-ea043e85-290e-4f76-b6e7-013201adfe91 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:55:16.786916 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-cc3f2314-c160-40f4-84a6-9b1c7ccae3ce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ddb7d65d5cac46df9692b1d94c0a29db'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:55:16.808785 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 834/1673] 10.222.0.57 () {58 vars in 1224 bytes} [Fri Sep 16 07:55:16 2022] DELETE /identity/v3/users/ddb7d65d5cac46df9692b1d94c0a29db => generated 0 bytes in 654 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 07:55:16.809648 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4762621-afb7-4b56-91d0-e9fd3c2f15d0 None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:16.809966 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4762621-afb7-4b56-91d0-e9fd3c2f15d0 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:16.810247 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4762621-afb7-4b56-91d0-e9fd3c2f15d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:16.869240 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-d4762621-afb7-4b56-91d0-e9fd3c2f15d0 None None] MFA Rules not processed for user `7acd9907fd3149d691366c2ae8d4ff5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:55:16.870536 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-d4762621-afb7-4b56-91d0-e9fd3c2f15d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:55:17.037194 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea043e85-290e-4f76-b6e7-013201adfe91 admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:55:17.038154 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 835/1674] 10.222.0.57 () {58 vars in 958 bytes} [Fri Sep 16 07:55:16 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 07:55:17.043115 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4762621-afb7-4b56-91d0-e9fd3c2f15d0 None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:55:17.045035 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-d4762621-afb7-4b56-91d0-e9fd3c2f15d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:55:17.202329 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4762621-afb7-4b56-91d0-e9fd3c2f15d0 None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:55:17.208154 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296b9f02-1420-4620-acb6-9546280d56c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:55:17.208971 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296b9f02-1420-4620-acb6-9546280d56c7 admin admin] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:17.209582 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296b9f02-1420-4620-acb6-9546280d56c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:17.210767 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296b9f02-1420-4620-acb6-9546280d56c7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:17.211802 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296b9f02-1420-4620-acb6-9546280d56c7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:55:17.215836 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296b9f02-1420-4620-acb6-9546280d56c7 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:55:17.232882 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:55:17.246074 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e178f1-44b4-46de-aa05-ce6886c3e186 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1062e457207a41e4ba4f0a0c4bf36f1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4735f453c0c24cc4a1c14e9ac84a0b46', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:55:17.246838 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e178f1-44b4-46de-aa05-ce6886c3e186 service neutron] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:17.248796 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e178f1-44b4-46de-aa05-ce6886c3e186 service neutron] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:17.249080 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e178f1-44b4-46de-aa05-ce6886c3e186 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:17.254386 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-95e178f1-44b4-46de-aa05-ce6886c3e186 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:55:17.285985 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e178f1-44b4-46de-aa05-ce6886c3e186 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:55:17.290073 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 836/1675] 10.222.0.57 () {60 vars in 1153 bytes} [Fri Sep 16 07:55:17 2022] POST /identity/v3/projects => generated 405 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 16 07:55:17.290256 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e178f1-44b4-46de-aa05-ce6886c3e186 service neutron] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:55:17.291173 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296b9f02-1420-4620-acb6-9546280d56c7 admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:55:17.321947 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 840/1676] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Sep 16 07:55:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 558 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 07:55:17.465531 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296b9f02-1420-4620-acb6-9546280d56c7 admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:55:17.478384 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd1300b-cfa5-4900-8acd-98eba0f20187 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:55:17.479037 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd1300b-cfa5-4900-8acd-98eba0f20187 admin admin] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:17.479324 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd1300b-cfa5-4900-8acd-98eba0f20187 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:17.479605 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd1300b-cfa5-4900-8acd-98eba0f20187 admin admin] PATH_INFO: `/v3/users` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:17.480257 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd1300b-cfa5-4900-8acd-98eba0f20187 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:55:17.482425 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd1300b-cfa5-4900-8acd-98eba0f20187 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:55:17.526714 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 837/1677] 10.222.0.57 () {60 vars in 1144 bytes} [Fri Sep 16 07:55:17 2022] POST /identity/v3/users => generated 309 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 16 07:55:17.527832 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e178f1-44b4-46de-aa05-ce6886c3e186 service neutron] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:55:17.543889 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e178f1-44b4-46de-aa05-ce6886c3e186 service neutron] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:55:17.564482 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba3ca5b-d105-4d6f-979e-cebb268140ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:55:17.565115 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba3ca5b-d105-4d6f-979e-cebb268140ff admin admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:17.565498 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba3ca5b-d105-4d6f-979e-cebb268140ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:17.565920 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba3ca5b-d105-4d6f-979e-cebb268140ff admin admin] PATH_INFO: `/v3/roles` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:17.568106 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba3ca5b-d105-4d6f-979e-cebb268140ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:55:17.570285 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba3ca5b-d105-4d6f-979e-cebb268140ff admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:55:17.583248 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 841/1678] 10.222.0.57 () {58 vars in 1122 bytes} [Fri Sep 16 07:55:17 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 07:55:17.587160 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd1300b-cfa5-4900-8acd-98eba0f20187 admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:55:17.606137 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd1300b-cfa5-4900-8acd-98eba0f20187 admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:55:17.616749 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9131785a-16c7-411a-9dc5-ccd987406fd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:55:17.617698 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9131785a-16c7-411a-9dc5-ccd987406fd8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:17.618223 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9131785a-16c7-411a-9dc5-ccd987406fd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:17.618701 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9131785a-16c7-411a-9dc5-ccd987406fd8 admin admin] PATH_INFO: `/v3/projects/7f9f49a6bb3b4bacbdcf0553fd5e5045/users/4ee83bc7034e47a9a31342e8d7b61a4d/roles/567db03c91854ad9af1e9a87ec1bd275` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:17.668637 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9131785a-16c7-411a-9dc5-ccd987406fd8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f9f49a6bb3b4bacbdcf0553fd5e5045, user_id=4ee83bc7034e47a9a31342e8d7b61a4d, role_id=567db03c91854ad9af1e9a87ec1bd275)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:55:17.672008 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9131785a-16c7-411a-9dc5-ccd987406fd8 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:55:17.698970 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 838/1679] 10.222.0.57 () {60 vars in 1483 bytes} [Fri Sep 16 07:55:17 2022] PUT /identity/v3/projects/7f9f49a6bb3b4bacbdcf0553fd5e5045/users/4ee83bc7034e47a9a31342e8d7b61a4d/roles/567db03c91854ad9af1e9a87ec1bd275 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 07:55:17.703564 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba3ca5b-d105-4d6f-979e-cebb268140ff admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:55:17.721737 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba3ca5b-d105-4d6f-979e-cebb268140ff admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:55:17.847947 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:55:17.884427 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761888f5-f0f3-446f-8ecf-d81103317eca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:55:17.885369 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761888f5-f0f3-446f-8ecf-d81103317eca admin admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:17.885369 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761888f5-f0f3-446f-8ecf-d81103317eca admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:17.885604 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761888f5-f0f3-446f-8ecf-d81103317eca admin admin] PATH_INFO: `/v3/roles` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:17.886414 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761888f5-f0f3-446f-8ecf-d81103317eca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:55:17.888020 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761888f5-f0f3-446f-8ecf-d81103317eca admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:55:17.916049 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 842/1680] 10.222.0.57 () {58 vars in 1122 bytes} [Fri Sep 16 07:55:17 2022] GET /identity/v3/roles => generated 1420 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 07:55:17.918021 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9131785a-16c7-411a-9dc5-ccd987406fd8 admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:55:17.938619 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9131785a-16c7-411a-9dc5-ccd987406fd8 admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:55:17.951577 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9405d0-f37c-411a-aecb-4fe7c13e6d1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:55:17.953775 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9405d0-f37c-411a-aecb-4fe7c13e6d1d admin admin] REQUEST_METHOD: `PUT` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:17.953923 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9405d0-f37c-411a-aecb-4fe7c13e6d1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:17.954174 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9405d0-f37c-411a-aecb-4fe7c13e6d1d admin admin] PATH_INFO: `/v3/projects/7f9f49a6bb3b4bacbdcf0553fd5e5045/users/4ee83bc7034e47a9a31342e8d7b61a4d/roles/567db03c91854ad9af1e9a87ec1bd275` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:17.959701 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9405d0-f37c-411a-aecb-4fe7c13e6d1d admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f9f49a6bb3b4bacbdcf0553fd5e5045, user_id=4ee83bc7034e47a9a31342e8d7b61a4d, role_id=567db03c91854ad9af1e9a87ec1bd275)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:55:17.965952 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9405d0-f37c-411a-aecb-4fe7c13e6d1d admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:55:18.000315 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 839/1681] 10.222.0.57 () {60 vars in 1483 bytes} [Fri Sep 16 07:55:17 2022] PUT /identity/v3/projects/7f9f49a6bb3b4bacbdcf0553fd5e5045/users/4ee83bc7034e47a9a31342e8d7b61a4d/roles/567db03c91854ad9af1e9a87ec1bd275 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 07:55:18.011759 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e52dcf-11e7-4f93-bf63-9e4973c06908 None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:18.012328 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e52dcf-11e7-4f93-bf63-9e4973c06908 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:18.013125 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e52dcf-11e7-4f93-bf63-9e4973c06908 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:18.078098 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-98e52dcf-11e7-4f93-bf63-9e4973c06908 None None] MFA Rules not processed for user `4ee83bc7034e47a9a31342e8d7b61a4d`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:55:18.080606 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-98e52dcf-11e7-4f93-bf63-9e4973c06908 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:55:18.120138 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9405d0-f37c-411a-aecb-4fe7c13e6d1d admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:55:18.122296 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-ac9405d0-f37c-411a-aecb-4fe7c13e6d1d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:55:18.251650 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 843/1682] 10.222.0.57 () {58 vars in 958 bytes} [Fri Sep 16 07:55:18 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 07:55:18.266325 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e52dcf-11e7-4f93-bf63-9e4973c06908 None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:55:18.267775 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-98e52dcf-11e7-4f93-bf63-9e4973c06908 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:55:18.288656 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9405d0-f37c-411a-aecb-4fe7c13e6d1d admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:55:18.312755 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b39fd6-ef6f-4b5a-8d6b-c6cdcc47cefd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:55:18.313808 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b39fd6-ef6f-4b5a-8d6b-c6cdcc47cefd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:18.315055 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b39fd6-ef6f-4b5a-8d6b-c6cdcc47cefd admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:18.316337 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b39fd6-ef6f-4b5a-8d6b-c6cdcc47cefd admin admin] PATH_INFO: `/v3/projects/07ad2d24196b42b991fbc48db32f5149` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:18.319055 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b39fd6-ef6f-4b5a-8d6b-c6cdcc47cefd admin admin] RBAC: Authorizing `identity:delete_project(project_id=07ad2d24196b42b991fbc48db32f5149)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:55:18.322379 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b39fd6-ef6f-4b5a-8d6b-c6cdcc47cefd admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:55:18.426728 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=91,keystone:INSERT=6,keystone:DELETE=3 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:55:18.431070 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e52dcf-11e7-4f93-bf63-9e4973c06908 None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:55:18.449526 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-48b39fd6-ef6f-4b5a-8d6b-c6cdcc47cefd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '07ad2d24196b42b991fbc48db32f5149', 'request_id': 'req-48b39fd6-ef6f-4b5a-8d6b-c6cdcc47cefd'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:55:18.466947 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-48b39fd6-ef6f-4b5a-8d6b-c6cdcc47cefd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '07ad2d24196b42b991fbc48db32f5149', 'request_id': 'req-48b39fd6-ef6f-4b5a-8d6b-c6cdcc47cefd'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:55:18.482638 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-48b39fd6-ef6f-4b5a-8d6b-c6cdcc47cefd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '07ad2d24196b42b991fbc48db32f5149', 'request_id': 'req-48b39fd6-ef6f-4b5a-8d6b-c6cdcc47cefd'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:55:18.510328 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-48b39fd6-ef6f-4b5a-8d6b-c6cdcc47cefd admin admin] The token cache is being invalidate because project 07ad2d24196b42b991fbc48db32f5149 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81431) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 07:55:18.512147 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-48b39fd6-ef6f-4b5a-8d6b-c6cdcc47cefd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:55:18.515311 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-48b39fd6-ef6f-4b5a-8d6b-c6cdcc47cefd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:55:18.523666 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 840/1683] 10.222.0.57 () {58 vars in 1233 bytes} [Fri Sep 16 07:55:18 2022] DELETE /identity/v3/projects/07ad2d24196b42b991fbc48db32f5149 => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 07:55:18.525204 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b39fd6-ef6f-4b5a-8d6b-c6cdcc47cefd admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:55:18.529647 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-48b39fd6-ef6f-4b5a-8d6b-c6cdcc47cefd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:55:18.576357 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01dbd35-152f-4a4b-a85a-fd8f247a9114 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544bf6be4c24454a013ca110c43cef2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4735f453c0c24cc4a1c14e9ac84a0b46', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:55:18.577916 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01dbd35-152f-4a4b-a85a-fd8f247a9114 service cinder] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:18.578341 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01dbd35-152f-4a4b-a85a-fd8f247a9114 service cinder] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:18.578728 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01dbd35-152f-4a4b-a85a-fd8f247a9114 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:18.581110 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-d01dbd35-152f-4a4b-a85a-fd8f247a9114 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:55:18.652146 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:55:18.708829 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01dbd35-152f-4a4b-a85a-fd8f247a9114 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:55:18.712873 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01dbd35-152f-4a4b-a85a-fd8f247a9114 service cinder] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:55:18.719232 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b39fd6-ef6f-4b5a-8d6b-c6cdcc47cefd admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:55:18.745782 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6452c60-9158-41b2-944e-2b04070c9e51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:55:18.746623 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6452c60-9158-41b2-944e-2b04070c9e51 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:18.746910 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6452c60-9158-41b2-944e-2b04070c9e51 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:18.747191 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6452c60-9158-41b2-944e-2b04070c9e51 admin admin] PATH_INFO: `/v3/users/c9369d82ab164b6cb51a9c76d78357ab` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:18.755215 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6452c60-9158-41b2-944e-2b04070c9e51 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c9369d82ab164b6cb51a9c76d78357ab)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:55:18.755778 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 844/1684] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Sep 16 07:55:18 2022] GET /identity/v3/auth/tokens => generated 3349 bytes in 490 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 16 07:55:18.757261 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99959d9-295e-461d-a754-e58fa8ad8349 None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:18.757550 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99959d9-295e-461d-a754-e58fa8ad8349 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:18.762295 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6452c60-9158-41b2-944e-2b04070c9e51 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:55:18.764745 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99959d9-295e-461d-a754-e58fa8ad8349 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:18.855342 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-d99959d9-295e-461d-a754-e58fa8ad8349 None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:55:18.858956 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-d99959d9-295e-461d-a754-e58fa8ad8349 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:55:18.894772 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 845/1685] 10.222.0.57 () {58 vars in 958 bytes} [Fri Sep 16 07:55:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 07:55:18.904053 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f123714e-b1b7-4763-8c6a-6624a5840fea None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:18.904385 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f123714e-b1b7-4763-8c6a-6624a5840fea None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:18.904602 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f123714e-b1b7-4763-8c6a-6624a5840fea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:18.931164 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-c6452c60-9158-41b2-944e-2b04070c9e51 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c9369d82ab164b6cb51a9c76d78357ab'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:55:18.956568 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-f123714e-b1b7-4763-8c6a-6624a5840fea None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:55:18.957824 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-f123714e-b1b7-4763-8c6a-6624a5840fea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:55:18.983872 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 846/1686] 10.222.0.57 () {58 vars in 958 bytes} [Fri Sep 16 07:55:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 07:55:18.988508 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f123714e-b1b7-4763-8c6a-6624a5840fea None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:55:18.995017 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-c6452c60-9158-41b2-944e-2b04070c9e51 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c9369d82ab164b6cb51a9c76d78357ab'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:55:18.995788 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-c6452c60-9158-41b2-944e-2b04070c9e51 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c9369d82ab164b6cb51a9c76d78357ab'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:55:19.007107 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f123714e-b1b7-4763-8c6a-6624a5840fea None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:55:19.009538 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-c6452c60-9158-41b2-944e-2b04070c9e51 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c9369d82ab164b6cb51a9c76d78357ab'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:55:19.023647 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-c6452c60-9158-41b2-944e-2b04070c9e51 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c9369d82ab164b6cb51a9c76d78357ab'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:55:19.024435 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7eb9ebb-c1de-47a1-90cb-7c26eb110be2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:55:19.025066 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7eb9ebb-c1de-47a1-90cb-7c26eb110be2 admin admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:19.025343 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7eb9ebb-c1de-47a1-90cb-7c26eb110be2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:19.025609 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7eb9ebb-c1de-47a1-90cb-7c26eb110be2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:19.027404 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7eb9ebb-c1de-47a1-90cb-7c26eb110be2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:55:19.027721 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7eb9ebb-c1de-47a1-90cb-7c26eb110be2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:55:19.030137 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7eb9ebb-c1de-47a1-90cb-7c26eb110be2 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:55:19.048823 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 841/1687] 10.222.0.57 () {58 vars in 1224 bytes} [Fri Sep 16 07:55:18 2022] DELETE /identity/v3/users/c9369d82ab164b6cb51a9c76d78357ab => generated 0 bytes in 521 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 07:55:19.050878 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b20f1b-fb2d-43b0-b79a-eefcb26a60cd None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:19.051165 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b20f1b-fb2d-43b0-b79a-eefcb26a60cd None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:19.051440 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b20f1b-fb2d-43b0-b79a-eefcb26a60cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:19.083310 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 847/1688] 10.222.0.57 () {58 vars in 1153 bytes} [Fri Sep 16 07:55:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:55:19.084275 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7eb9ebb-c1de-47a1-90cb-7c26eb110be2 admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:55:19.093814 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-a7eb9ebb-c1de-47a1-90cb-7c26eb110be2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:55:19.125221 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-a7b20f1b-fb2d-43b0-b79a-eefcb26a60cd None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:55:19.126480 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-a7b20f1b-fb2d-43b0-b79a-eefcb26a60cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:55:19.136116 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7eb9ebb-c1de-47a1-90cb-7c26eb110be2 admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:55:19.213858 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:55:19.295574 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 842/1689] 10.222.0.57 () {58 vars in 958 bytes} [Fri Sep 16 07:55:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 07:55:19.296537 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b20f1b-fb2d-43b0-b79a-eefcb26a60cd None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:55:19.304122 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-a7b20f1b-fb2d-43b0-b79a-eefcb26a60cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:55:19.348298 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b20f1b-fb2d-43b0-b79a-eefcb26a60cd None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:55:19.361991 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fae5c1-aa34-476a-b7df-5d7e0cd1fd14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:55:19.365248 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fae5c1-aa34-476a-b7df-5d7e0cd1fd14 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:19.365535 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fae5c1-aa34-476a-b7df-5d7e0cd1fd14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:19.365837 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fae5c1-aa34-476a-b7df-5d7e0cd1fd14 admin admin] PATH_INFO: `/v3/users/7acd9907fd3149d691366c2ae8d4ff5d` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:19.372245 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c34f240-fdf6-4798-a141-7dd0c349cca6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:55:19.372897 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c34f240-fdf6-4798-a141-7dd0c349cca6 admin admin] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:19.373176 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c34f240-fdf6-4798-a141-7dd0c349cca6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:19.373449 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c34f240-fdf6-4798-a141-7dd0c349cca6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:19.375222 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fae5c1-aa34-476a-b7df-5d7e0cd1fd14 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7acd9907fd3149d691366c2ae8d4ff5d)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:55:19.377635 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c34f240-fdf6-4798-a141-7dd0c349cca6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:55:19.380324 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c34f240-fdf6-4798-a141-7dd0c349cca6 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:55:19.381593 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fae5c1-aa34-476a-b7df-5d7e0cd1fd14 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:55:19.485089 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 843/1690] 10.222.0.57 () {60 vars in 1153 bytes} [Fri Sep 16 07:55:19 2022] POST /identity/v3/projects => generated 381 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 07:55:19.490942 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c34f240-fdf6-4798-a141-7dd0c349cca6 admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:55:19.499605 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-2c34f240-fdf6-4798-a141-7dd0c349cca6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:55:19.539222 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-27fae5c1-aa34-476a-b7df-5d7e0cd1fd14 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7acd9907fd3149d691366c2ae8d4ff5d'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:55:19.540396 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-27fae5c1-aa34-476a-b7df-5d7e0cd1fd14 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7acd9907fd3149d691366c2ae8d4ff5d'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:55:19.555857 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-27fae5c1-aa34-476a-b7df-5d7e0cd1fd14 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7acd9907fd3149d691366c2ae8d4ff5d'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:55:19.589831 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-27fae5c1-aa34-476a-b7df-5d7e0cd1fd14 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7acd9907fd3149d691366c2ae8d4ff5d'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:55:19.600113 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-27fae5c1-aa34-476a-b7df-5d7e0cd1fd14 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7acd9907fd3149d691366c2ae8d4ff5d'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:55:19.620786 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 848/1691] 10.222.0.57 () {58 vars in 1224 bytes} [Fri Sep 16 07:55:19 2022] DELETE /identity/v3/users/7acd9907fd3149d691366c2ae8d4ff5d => generated 0 bytes in 537 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 07:55:19.626460 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fae5c1-aa34-476a-b7df-5d7e0cd1fd14 admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:55:19.632271 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-27fae5c1-aa34-476a-b7df-5d7e0cd1fd14 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:55:19.664464 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c34f240-fdf6-4798-a141-7dd0c349cca6 admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:55:19.714815 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:55:19.751335 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c13b9c3-0863-40cd-9b67-34ea56da5f24 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1062e457207a41e4ba4f0a0c4bf36f1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4735f453c0c24cc4a1c14e9ac84a0b46', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:55:19.753065 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c13b9c3-0863-40cd-9b67-34ea56da5f24 service neutron] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:19.753567 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c13b9c3-0863-40cd-9b67-34ea56da5f24 service neutron] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:19.754166 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c13b9c3-0863-40cd-9b67-34ea56da5f24 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:19.757338 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-0c13b9c3-0863-40cd-9b67-34ea56da5f24 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:55:19.802496 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fae5c1-aa34-476a-b7df-5d7e0cd1fd14 admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:55:19.830277 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158aa5d8-9f1c-4653-9651-b531929c581a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:55:19.831058 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158aa5d8-9f1c-4653-9651-b531929c581a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:19.831938 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158aa5d8-9f1c-4653-9651-b531929c581a admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:19.832279 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158aa5d8-9f1c-4653-9651-b531929c581a admin admin] PATH_INFO: `/v3/users/b60ea0dbb0c64a62b2594a21784cf3e4` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:19.834362 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158aa5d8-9f1c-4653-9651-b531929c581a admin admin] RBAC: Authorizing `identity:delete_user(user_id=b60ea0dbb0c64a62b2594a21784cf3e4)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:55:19.839105 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158aa5d8-9f1c-4653-9651-b531929c581a admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:55:19.855936 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c13b9c3-0863-40cd-9b67-34ea56da5f24 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:55:19.857902 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c13b9c3-0863-40cd-9b67-34ea56da5f24 service neutron] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:55:19.884770 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 844/1692] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Sep 16 07:55:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 07:55:19.894726 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c13b9c3-0863-40cd-9b67-34ea56da5f24 service neutron] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:55:19.906788 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-0c13b9c3-0863-40cd-9b67-34ea56da5f24 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:55:19.965178 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c13b9c3-0863-40cd-9b67-34ea56da5f24 service neutron] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:55:19.975499 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-158aa5d8-9f1c-4653-9651-b531929c581a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b60ea0dbb0c64a62b2594a21784cf3e4'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:55:19.976488 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-158aa5d8-9f1c-4653-9651-b531929c581a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b60ea0dbb0c64a62b2594a21784cf3e4'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:55:19.980051 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e527d47-dcc3-4355-b747-e01280dfca7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:55:19.980416 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e527d47-dcc3-4355-b747-e01280dfca7b admin admin] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:19.980792 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e527d47-dcc3-4355-b747-e01280dfca7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:19.981058 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e527d47-dcc3-4355-b747-e01280dfca7b admin admin] PATH_INFO: `/v3/users` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:19.981844 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e527d47-dcc3-4355-b747-e01280dfca7b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:55:19.984046 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e527d47-dcc3-4355-b747-e01280dfca7b admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:55:19.990368 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-158aa5d8-9f1c-4653-9651-b531929c581a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b60ea0dbb0c64a62b2594a21784cf3e4'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:55:20.047628 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 845/1693] 10.222.0.57 () {60 vars in 1144 bytes} [Fri Sep 16 07:55:19 2022] POST /identity/v3/users => generated 291 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 07:55:20.049232 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a9f5c2-5eb0-4a06-ab66-1649ace21111 None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:20.049653 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a9f5c2-5eb0-4a06-ab66-1649ace21111 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:20.050720 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a9f5c2-5eb0-4a06-ab66-1649ace21111 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:20.052893 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-158aa5d8-9f1c-4653-9651-b531929c581a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b60ea0dbb0c64a62b2594a21784cf3e4'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:55:20.072972 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-158aa5d8-9f1c-4653-9651-b531929c581a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b60ea0dbb0c64a62b2594a21784cf3e4'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:55:20.087875 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 849/1694] 10.222.0.57 () {58 vars in 1224 bytes} [Fri Sep 16 07:55:19 2022] DELETE /identity/v3/users/b60ea0dbb0c64a62b2594a21784cf3e4 => generated 0 bytes in 467 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 07:55:20.088806 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158aa5d8-9f1c-4653-9651-b531929c581a admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:55:20.090217 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-158aa5d8-9f1c-4653-9651-b531929c581a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:55:20.132572 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:55:20.143392 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-a1a9f5c2-5eb0-4a06-ab66-1649ace21111 None None] MFA Rules not processed for user `c0bb5e7b0e664b3ebbce9f6317b83778`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:55:20.145539 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-a1a9f5c2-5eb0-4a06-ab66-1649ace21111 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:55:20.301462 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158aa5d8-9f1c-4653-9651-b531929c581a admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:55:20.311317 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9296d87b-bb0b-40a8-a714-af413a039dd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:55:20.311987 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9296d87b-bb0b-40a8-a714-af413a039dd5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:20.312265 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9296d87b-bb0b-40a8-a714-af413a039dd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:20.312666 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9296d87b-bb0b-40a8-a714-af413a039dd5 admin admin] PATH_INFO: `/v3/projects/0f970e137a804e408f13226fb1a297d5` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:20.320578 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9296d87b-bb0b-40a8-a714-af413a039dd5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0f970e137a804e408f13226fb1a297d5)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:55:20.322567 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9296d87b-bb0b-40a8-a714-af413a039dd5 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:55:20.329469 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 846/1695] 10.222.0.57 () {58 vars in 958 bytes} [Fri Sep 16 07:55:20 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 281 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 07:55:20.334043 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e693d6e-b7e4-44f6-bbd1-3fe261ec1e4c None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:20.334401 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e693d6e-b7e4-44f6-bbd1-3fe261ec1e4c None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:20.334751 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e693d6e-b7e4-44f6-bbd1-3fe261ec1e4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:20.402802 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-3e693d6e-b7e4-44f6-bbd1-3fe261ec1e4c None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:55:20.406369 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:55:20.407228 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-3e693d6e-b7e4-44f6-bbd1-3fe261ec1e4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:55:20.429043 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-9296d87b-bb0b-40a8-a714-af413a039dd5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0f970e137a804e408f13226fb1a297d5', 'request_id': 'req-9296d87b-bb0b-40a8-a714-af413a039dd5'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:55:20.439687 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-9296d87b-bb0b-40a8-a714-af413a039dd5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0f970e137a804e408f13226fb1a297d5', 'request_id': 'req-9296d87b-bb0b-40a8-a714-af413a039dd5'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:55:20.452667 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-9296d87b-bb0b-40a8-a714-af413a039dd5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0f970e137a804e408f13226fb1a297d5', 'request_id': 'req-9296d87b-bb0b-40a8-a714-af413a039dd5'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:55:20.473590 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-9296d87b-bb0b-40a8-a714-af413a039dd5 admin admin] The token cache is being invalidate because project 0f970e137a804e408f13226fb1a297d5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81430) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 07:55:20.474193 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-9296d87b-bb0b-40a8-a714-af413a039dd5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:55:20.476448 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-9296d87b-bb0b-40a8-a714-af413a039dd5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:55:20.480702 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 850/1696] 10.222.0.57 () {58 vars in 1233 bytes} [Fri Sep 16 07:55:20 2022] DELETE /identity/v3/projects/0f970e137a804e408f13226fb1a297d5 => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 07:55:20.481842 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9296d87b-bb0b-40a8-a714-af413a039dd5 admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:55:20.483650 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-9296d87b-bb0b-40a8-a714-af413a039dd5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:55:20.557123 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 847/1697] 10.222.0.57 () {58 vars in 958 bytes} [Fri Sep 16 07:55:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 07:55:20.559058 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d791964-5938-4c51-9f03-b140cd0de82d None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:20.559602 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d791964-5938-4c51-9f03-b140cd0de82d None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:20.560271 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d791964-5938-4c51-9f03-b140cd0de82d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:20.594386 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-9d791964-5938-4c51-9f03-b140cd0de82d None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:55:20.595994 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-9d791964-5938-4c51-9f03-b140cd0de82d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:55:20.606504 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 848/1698] 10.222.0.57 () {58 vars in 958 bytes} [Fri Sep 16 07:55:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 07:55:20.608132 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1db536-beb8-4061-9381-1f9b410672c3 None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:20.608592 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1db536-beb8-4061-9381-1f9b410672c3 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:20.609218 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1db536-beb8-4061-9381-1f9b410672c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:20.640618 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-cc1db536-beb8-4061-9381-1f9b410672c3 None None] MFA Rules not processed for user `c0bb5e7b0e664b3ebbce9f6317b83778`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:55:20.642088 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-cc1db536-beb8-4061-9381-1f9b410672c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:55:20.666466 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9296d87b-bb0b-40a8-a714-af413a039dd5 admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:55:20.674023 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b00ffdd-2636-4456-a0dd-9959c26da77d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:55:20.674660 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b00ffdd-2636-4456-a0dd-9959c26da77d admin admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:20.675763 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b00ffdd-2636-4456-a0dd-9959c26da77d admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:20.676574 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b00ffdd-2636-4456-a0dd-9959c26da77d admin admin] PATH_INFO: `/v3/roles` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:20.677260 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b00ffdd-2636-4456-a0dd-9959c26da77d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:55:20.683648 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b00ffdd-2636-4456-a0dd-9959c26da77d admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:55:20.712934 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 851/1699] 10.222.0.57 () {58 vars in 1122 bytes} [Fri Sep 16 07:55:20 2022] GET /identity/v3/roles => generated 1420 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 07:55:20.715954 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d825c6-51e7-4f79-a82f-47193ba33b3a None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:20.716652 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d825c6-51e7-4f79-a82f-47193ba33b3a None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:20.718962 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d825c6-51e7-4f79-a82f-47193ba33b3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:20.741343 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 849/1700] 10.222.0.57 () {58 vars in 958 bytes} [Fri Sep 16 07:55:20 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 07:55:20.742446 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1db536-beb8-4061-9381-1f9b410672c3 None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:55:20.747805 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-cc1db536-beb8-4061-9381-1f9b410672c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:55:20.767246 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-04d825c6-51e7-4f79-a82f-47193ba33b3a None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:55:20.768490 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-04d825c6-51e7-4f79-a82f-47193ba33b3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:55:20.778630 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 852/1701] 10.222.0.57 () {58 vars in 958 bytes} [Fri Sep 16 07:55:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 07:55:20.779627 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d825c6-51e7-4f79-a82f-47193ba33b3a None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:55:20.781355 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-04d825c6-51e7-4f79-a82f-47193ba33b3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:55:20.782705 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1db536-beb8-4061-9381-1f9b410672c3 None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:55:20.792555 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f33430-e4dc-4ad1-8560-848d11d6743e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:55:20.793711 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f33430-e4dc-4ad1-8560-848d11d6743e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:20.794117 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f33430-e4dc-4ad1-8560-848d11d6743e admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:20.794496 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f33430-e4dc-4ad1-8560-848d11d6743e admin admin] PATH_INFO: `/v3/projects/656cd8bd49e245a082c5addc5588b428` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:20.796651 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f33430-e4dc-4ad1-8560-848d11d6743e admin admin] RBAC: Authorizing `identity:delete_project(project_id=656cd8bd49e245a082c5addc5588b428)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:55:20.802685 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f33430-e4dc-4ad1-8560-848d11d6743e admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:55:20.895768 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d825c6-51e7-4f79-a82f-47193ba33b3a None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:55:20.902046 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b2b5b2-a6a0-4971-b0d6-223a67faa5dd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1062e457207a41e4ba4f0a0c4bf36f1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4735f453c0c24cc4a1c14e9ac84a0b46', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:55:20.902760 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b2b5b2-a6a0-4971-b0d6-223a67faa5dd service neutron] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:20.903038 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b2b5b2-a6a0-4971-b0d6-223a67faa5dd service neutron] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:20.903317 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b2b5b2-a6a0-4971-b0d6-223a67faa5dd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:20.910860 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:55:20.918557 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b2b5b2-a6a0-4971-b0d6-223a67faa5dd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:55:20.920053 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b2b5b2-a6a0-4971-b0d6-223a67faa5dd service neutron] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:55:20.922550 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-e9f33430-e4dc-4ad1-8560-848d11d6743e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '656cd8bd49e245a082c5addc5588b428', 'request_id': 'req-e9f33430-e4dc-4ad1-8560-848d11d6743e'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:55:20.931428 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-e9f33430-e4dc-4ad1-8560-848d11d6743e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '656cd8bd49e245a082c5addc5588b428', 'request_id': 'req-e9f33430-e4dc-4ad1-8560-848d11d6743e'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:55:20.938260 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 853/1702] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Sep 16 07:55:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 07:55:20.939786 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b2b5b2-a6a0-4971-b0d6-223a67faa5dd service neutron] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:55:20.941616 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-e9f33430-e4dc-4ad1-8560-848d11d6743e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '656cd8bd49e245a082c5addc5588b428', 'request_id': 'req-e9f33430-e4dc-4ad1-8560-848d11d6743e'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:55:20.951858 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b2b5b2-a6a0-4971-b0d6-223a67faa5dd service neutron] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:55:20.962130 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-e9f33430-e4dc-4ad1-8560-848d11d6743e admin admin] The token cache is being invalidate because project 656cd8bd49e245a082c5addc5588b428 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81431) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 07:55:20.966538 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-e9f33430-e4dc-4ad1-8560-848d11d6743e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:55:20.967627 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-e9f33430-e4dc-4ad1-8560-848d11d6743e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:55:20.972240 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 850/1703] 10.222.0.57 () {58 vars in 1233 bytes} [Fri Sep 16 07:55:20 2022] DELETE /identity/v3/projects/656cd8bd49e245a082c5addc5588b428 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 07:55:20.974292 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f33430-e4dc-4ad1-8560-848d11d6743e admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:55:20.977661 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-e9f33430-e4dc-4ad1-8560-848d11d6743e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:55:21.035872 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674a1900-5167-4dd5-b254-927096f9edb1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1062e457207a41e4ba4f0a0c4bf36f1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4735f453c0c24cc4a1c14e9ac84a0b46', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:55:21.036653 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674a1900-5167-4dd5-b254-927096f9edb1 service neutron] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:21.038176 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674a1900-5167-4dd5-b254-927096f9edb1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:21.038644 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674a1900-5167-4dd5-b254-927096f9edb1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:21.041977 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-674a1900-5167-4dd5-b254-927096f9edb1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:55:21.073189 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:DELETE=4,keystone:SELECT=95,keystone:INSERT=1 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:55:21.142159 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f33430-e4dc-4ad1-8560-848d11d6743e admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:55:21.156586 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e28119-389f-4488-9385-af2b8d506665 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:55:21.157437 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e28119-389f-4488-9385-af2b8d506665 admin admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:21.157839 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e28119-389f-4488-9385-af2b8d506665 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:21.158388 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e28119-389f-4488-9385-af2b8d506665 admin admin] PATH_INFO: `/v3/roles` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:21.161260 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e28119-389f-4488-9385-af2b8d506665 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:55:21.166832 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e28119-389f-4488-9385-af2b8d506665 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:55:21.183707 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674a1900-5167-4dd5-b254-927096f9edb1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:55:21.187739 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674a1900-5167-4dd5-b254-927096f9edb1 service neutron] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:55:21.198525 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 851/1704] 10.222.0.57 () {58 vars in 1122 bytes} [Fri Sep 16 07:55:20 2022] GET /identity/v3/roles => generated 1420 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 07:55:21.198525 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e28119-389f-4488-9385-af2b8d506665 admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:55:21.201938 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-f2e28119-389f-4488-9385-af2b8d506665 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:55:21.213411 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 854/1705] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Sep 16 07:55:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 275 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 07:55:21.216335 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1442f8-0513-4c5a-a573-01ee6543125d None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:21.217853 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1442f8-0513-4c5a-a573-01ee6543125d None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:21.218496 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1442f8-0513-4c5a-a573-01ee6543125d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:21.251871 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-fc1442f8-0513-4c5a-a573-01ee6543125d None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:55:21.254008 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-fc1442f8-0513-4c5a-a573-01ee6543125d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:55:21.263520 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 855/1706] 10.222.0.57 () {58 vars in 958 bytes} [Fri Sep 16 07:55:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 07:55:21.264691 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1442f8-0513-4c5a-a573-01ee6543125d None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:55:21.266335 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-fc1442f8-0513-4c5a-a573-01ee6543125d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:55:21.280068 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1442f8-0513-4c5a-a573-01ee6543125d None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:55:21.292015 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70baacdd-5d40-4adf-8d69-41f0b4472b16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:55:21.292744 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70baacdd-5d40-4adf-8d69-41f0b4472b16 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:21.293083 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70baacdd-5d40-4adf-8d69-41f0b4472b16 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:21.293444 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70baacdd-5d40-4adf-8d69-41f0b4472b16 admin admin] PATH_INFO: `/v3/users/60dcd5adb87b42bb85e65d5cb1dc0057` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:21.296148 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70baacdd-5d40-4adf-8d69-41f0b4472b16 admin admin] RBAC: Authorizing `identity:delete_user(user_id=60dcd5adb87b42bb85e65d5cb1dc0057)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:55:21.306838 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70baacdd-5d40-4adf-8d69-41f0b4472b16 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:55:21.392124 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e28119-389f-4488-9385-af2b8d506665 admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:55:21.399300 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-70baacdd-5d40-4adf-8d69-41f0b4472b16 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '60dcd5adb87b42bb85e65d5cb1dc0057'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:55:21.400620 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-70baacdd-5d40-4adf-8d69-41f0b4472b16 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '60dcd5adb87b42bb85e65d5cb1dc0057'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:55:21.413604 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb8aeeb-a919-436c-a56d-881b2bcb65a7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bec4d9b08514461a1bf63c6b88f53b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4735f453c0c24cc4a1c14e9ac84a0b46', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:55:21.414363 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb8aeeb-a919-436c-a56d-881b2bcb65a7 service nova] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:21.414663 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb8aeeb-a919-436c-a56d-881b2bcb65a7 service nova] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:21.415028 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb8aeeb-a919-436c-a56d-881b2bcb65a7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:21.417463 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-5fb8aeeb-a919-436c-a56d-881b2bcb65a7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:55:21.424280 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-70baacdd-5d40-4adf-8d69-41f0b4472b16 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '60dcd5adb87b42bb85e65d5cb1dc0057'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:55:21.448912 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-70baacdd-5d40-4adf-8d69-41f0b4472b16 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '60dcd5adb87b42bb85e65d5cb1dc0057'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:55:21.470697 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-70baacdd-5d40-4adf-8d69-41f0b4472b16 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '60dcd5adb87b42bb85e65d5cb1dc0057'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:55:21.492299 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 856/1707] 10.222.0.57 () {58 vars in 1224 bytes} [Fri Sep 16 07:55:21 2022] DELETE /identity/v3/users/60dcd5adb87b42bb85e65d5cb1dc0057 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 07:55:21.493187 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70baacdd-5d40-4adf-8d69-41f0b4472b16 admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:55:21.496268 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-70baacdd-5d40-4adf-8d69-41f0b4472b16 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:55:21.575254 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb8aeeb-a919-436c-a56d-881b2bcb65a7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:55:21.577188 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb8aeeb-a919-436c-a56d-881b2bcb65a7 service nova] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:55:21.587740 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:55:21.608432 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 852/1708] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Sep 16 07:55:21 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 07:55:21.609936 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb8aeeb-a919-436c-a56d-881b2bcb65a7 service nova] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:55:21.613754 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-5fb8aeeb-a919-436c-a56d-881b2bcb65a7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:55:21.648324 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb8aeeb-a919-436c-a56d-881b2bcb65a7 service nova] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:55:21.660965 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70baacdd-5d40-4adf-8d69-41f0b4472b16 admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:55:21.663116 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59eae3e0-338e-4113-9482-980b22b0547e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:55:21.663803 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59eae3e0-338e-4113-9482-980b22b0547e admin admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:21.664034 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59eae3e0-338e-4113-9482-980b22b0547e admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:21.664310 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59eae3e0-338e-4113-9482-980b22b0547e admin admin] PATH_INFO: `/v3/domains` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:21.664966 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59eae3e0-338e-4113-9482-980b22b0547e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:55:21.665894 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59eae3e0-338e-4113-9482-980b22b0547e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:55:21.670704 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59eae3e0-338e-4113-9482-980b22b0547e admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:55:21.672590 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6640d694-8f64-4a2c-b490-b3a36d5587ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:55:21.672754 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6640d694-8f64-4a2c-b490-b3a36d5587ac admin admin] REQUEST_METHOD: `PUT` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:21.672944 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6640d694-8f64-4a2c-b490-b3a36d5587ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:21.673219 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6640d694-8f64-4a2c-b490-b3a36d5587ac admin admin] PATH_INFO: `/v3/projects/c45ffe1cdc124fb0a858d09fff2f1018/users/5f9a1ff4c32040cf9dce821c0a7404fd/roles/4818d38cf2564825b312e66c9eb24762` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:21.702590 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 853/1709] 10.222.0.57 () {58 vars in 1153 bytes} [Fri Sep 16 07:55:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:55:21.707880 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59eae3e0-338e-4113-9482-980b22b0547e admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:55:21.708968 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6640d694-8f64-4a2c-b490-b3a36d5587ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=c45ffe1cdc124fb0a858d09fff2f1018, user_id=5f9a1ff4c32040cf9dce821c0a7404fd, role_id=4818d38cf2564825b312e66c9eb24762)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:55:21.717904 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6640d694-8f64-4a2c-b490-b3a36d5587ac admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:55:21.740596 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59eae3e0-338e-4113-9482-980b22b0547e admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:55:21.767140 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d700962-22ef-4b96-845a-d700a9fe08d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:55:21.767790 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d700962-22ef-4b96-845a-d700a9fe08d9 admin admin] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:21.768070 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d700962-22ef-4b96-845a-d700a9fe08d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:21.768338 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d700962-22ef-4b96-845a-d700a9fe08d9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:21.769965 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 857/1710] 10.222.0.57 () {60 vars in 1483 bytes} [Fri Sep 16 07:55:21 2022] PUT /identity/v3/projects/c45ffe1cdc124fb0a858d09fff2f1018/users/5f9a1ff4c32040cf9dce821c0a7404fd/roles/4818d38cf2564825b312e66c9eb24762 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 07:55:21.772124 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7ada3a-1132-4001-a00c-a5bbdccf3d93 None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:21.772124 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7ada3a-1132-4001-a00c-a5bbdccf3d93 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:21.772302 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7ada3a-1132-4001-a00c-a5bbdccf3d93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:21.773287 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d700962-22ef-4b96-845a-d700a9fe08d9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:55:21.780965 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d700962-22ef-4b96-845a-d700a9fe08d9 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:55:21.794408 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:55:21.844418 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-9a7ada3a-1132-4001-a00c-a5bbdccf3d93 None None] MFA Rules not processed for user `ed058b182f0f46a78f2f3a2f3a0e3528`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:55:21.845146 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 854/1711] 10.222.0.57 () {60 vars in 1153 bytes} [Fri Sep 16 07:55:21 2022] POST /identity/v3/projects => generated 379 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 07:55:21.846540 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9689f98-6a01-49a1-8f90-8a8658166579 None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:21.846903 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9689f98-6a01-49a1-8f90-8a8658166579 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:21.847181 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9689f98-6a01-49a1-8f90-8a8658166579 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:21.849095 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-9a7ada3a-1132-4001-a00c-a5bbdccf3d93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:55:21.872955 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-b9689f98-6a01-49a1-8f90-8a8658166579 None None] MFA Rules not processed for user `bb5935d098a241679b2957e8c4742168`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:55:21.874228 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-b9689f98-6a01-49a1-8f90-8a8658166579 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:55:22.035114 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 855/1712] 10.222.0.57 () {58 vars in 958 bytes} [Fri Sep 16 07:55:21 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 07:55:22.044818 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96ca6db-9145-459a-8694-b1ac2ba06aac None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:22.045098 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96ca6db-9145-459a-8694-b1ac2ba06aac None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:22.045378 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96ca6db-9145-459a-8694-b1ac2ba06aac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:22.064821 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 858/1713] 10.222.0.57 () {58 vars in 958 bytes} [Fri Sep 16 07:55:21 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 294 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 07:55:22.066898 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7ada3a-1132-4001-a00c-a5bbdccf3d93 None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:55:22.127058 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-f96ca6db-9145-459a-8694-b1ac2ba06aac None None] MFA Rules not processed for user `5f9a1ff4c32040cf9dce821c0a7404fd`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:55:22.132039 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-f96ca6db-9145-459a-8694-b1ac2ba06aac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:55:22.301441 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7ada3a-1132-4001-a00c-a5bbdccf3d93 None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:55:22.317296 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988a7e66-8ace-40bb-a0b8-abcaaf257be1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:55:22.320207 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988a7e66-8ace-40bb-a0b8-abcaaf257be1 admin admin] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:22.322140 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988a7e66-8ace-40bb-a0b8-abcaaf257be1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:22.322809 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988a7e66-8ace-40bb-a0b8-abcaaf257be1 admin admin] PATH_INFO: `/v3/users` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:22.323686 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988a7e66-8ace-40bb-a0b8-abcaaf257be1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:55:22.337639 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988a7e66-8ace-40bb-a0b8-abcaaf257be1 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:55:22.365296 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 856/1714] 10.222.0.57 () {58 vars in 958 bytes} [Fri Sep 16 07:55:22 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 330 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 07:55:22.368325 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b795a332-d839-45f0-a2d2-e652af7ca42d None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:22.369188 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b795a332-d839-45f0-a2d2-e652af7ca42d None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:22.369690 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b795a332-d839-45f0-a2d2-e652af7ca42d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:22.395980 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 859/1715] 10.222.0.57 () {60 vars in 1144 bytes} [Fri Sep 16 07:55:22 2022] POST /identity/v3/users => generated 290 bytes in 327 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 07:55:22.395980 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988a7e66-8ace-40bb-a0b8-abcaaf257be1 admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:55:22.396324 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-988a7e66-8ace-40bb-a0b8-abcaaf257be1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:55:22.425479 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988a7e66-8ace-40bb-a0b8-abcaaf257be1 admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:55:22.425855 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-b795a332-d839-45f0-a2d2-e652af7ca42d None None] MFA Rules not processed for user `ed058b182f0f46a78f2f3a2f3a0e3528`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:55:22.441035 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-b795a332-d839-45f0-a2d2-e652af7ca42d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:55:22.448548 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0403469-9403-47ac-93c2-1fcd4cd4b4e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:55:22.449186 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0403469-9403-47ac-93c2-1fcd4cd4b4e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:22.449571 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0403469-9403-47ac-93c2-1fcd4cd4b4e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:22.449992 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0403469-9403-47ac-93c2-1fcd4cd4b4e2 admin admin] PATH_INFO: `/v3/projects/76eecaff299e427787aadbd1bc9a1a01` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:22.451271 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0403469-9403-47ac-93c2-1fcd4cd4b4e2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=76eecaff299e427787aadbd1bc9a1a01)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:55:22.459915 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0403469-9403-47ac-93c2-1fcd4cd4b4e2 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:55:22.462799 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 857/1716] 10.222.0.57 () {58 vars in 958 bytes} [Fri Sep 16 07:55:22 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 07:55:22.466231 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b795a332-d839-45f0-a2d2-e652af7ca42d None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:55:22.497654 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b795a332-d839-45f0-a2d2-e652af7ca42d None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:55:22.522156 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874672d1-b776-410c-9b1c-46e27cf50cf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:55:22.524640 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874672d1-b776-410c-9b1c-46e27cf50cf8 admin admin] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:22.526637 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874672d1-b776-410c-9b1c-46e27cf50cf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:22.527257 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874672d1-b776-410c-9b1c-46e27cf50cf8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:22.530432 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874672d1-b776-410c-9b1c-46e27cf50cf8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:55:22.536459 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874672d1-b776-410c-9b1c-46e27cf50cf8 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:55:22.571310 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-c0403469-9403-47ac-93c2-1fcd4cd4b4e2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '76eecaff299e427787aadbd1bc9a1a01', 'request_id': 'req-c0403469-9403-47ac-93c2-1fcd4cd4b4e2'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:55:22.590743 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-c0403469-9403-47ac-93c2-1fcd4cd4b4e2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '76eecaff299e427787aadbd1bc9a1a01', 'request_id': 'req-c0403469-9403-47ac-93c2-1fcd4cd4b4e2'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:55:22.606398 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-c0403469-9403-47ac-93c2-1fcd4cd4b4e2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '76eecaff299e427787aadbd1bc9a1a01', 'request_id': 'req-c0403469-9403-47ac-93c2-1fcd4cd4b4e2'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:55:22.619463 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 858/1717] 10.222.0.57 () {60 vars in 1153 bytes} [Fri Sep 16 07:55:22 2022] POST /identity/v3/projects => generated 379 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 07:55:22.620625 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874672d1-b776-410c-9b1c-46e27cf50cf8 admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:55:22.624148 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-c0403469-9403-47ac-93c2-1fcd4cd4b4e2 admin admin] The token cache is being invalidate because project 76eecaff299e427787aadbd1bc9a1a01 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81430) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 07:55:22.624449 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-c0403469-9403-47ac-93c2-1fcd4cd4b4e2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:55:22.627670 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-c0403469-9403-47ac-93c2-1fcd4cd4b4e2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:55:22.631688 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 860/1718] 10.222.0.57 () {58 vars in 1233 bytes} [Fri Sep 16 07:55:22 2022] DELETE /identity/v3/projects/76eecaff299e427787aadbd1bc9a1a01 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 07:55:22.632144 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0403469-9403-47ac-93c2-1fcd4cd4b4e2 admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:55:22.633967 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-c0403469-9403-47ac-93c2-1fcd4cd4b4e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:55:22.652202 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:55:22.690093 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:55:22.751779 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0403469-9403-47ac-93c2-1fcd4cd4b4e2 admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:55:22.758271 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5472ef-cbe3-4973-b9eb-836a60e48e94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:55:22.758552 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874672d1-b776-410c-9b1c-46e27cf50cf8 admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:55:22.758982 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5472ef-cbe3-4973-b9eb-836a60e48e94 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:22.759370 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5472ef-cbe3-4973-b9eb-836a60e48e94 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:22.759644 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5472ef-cbe3-4973-b9eb-836a60e48e94 admin admin] PATH_INFO: `/v3/projects/561f03e618164927bc30241c89b4e8ac` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:22.761651 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5472ef-cbe3-4973-b9eb-836a60e48e94 admin admin] RBAC: Authorizing `identity:delete_project(project_id=561f03e618164927bc30241c89b4e8ac)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:55:22.763798 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5472ef-cbe3-4973-b9eb-836a60e48e94 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:55:22.772335 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84211ebb-37e3-416e-a475-e7cea5e5cb0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:55:22.774341 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84211ebb-37e3-416e-a475-e7cea5e5cb0c admin admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:22.774633 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84211ebb-37e3-416e-a475-e7cea5e5cb0c admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:22.774909 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84211ebb-37e3-416e-a475-e7cea5e5cb0c admin admin] PATH_INFO: `/v3/roles` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:22.775561 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84211ebb-37e3-416e-a475-e7cea5e5cb0c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:55:22.777185 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84211ebb-37e3-416e-a475-e7cea5e5cb0c admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:55:22.800302 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 859/1719] 10.222.0.57 () {58 vars in 1122 bytes} [Fri Sep 16 07:55:22 2022] GET /identity/v3/roles => generated 1420 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 07:55:22.800302 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84211ebb-37e3-416e-a475-e7cea5e5cb0c admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:55:22.805198 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-84211ebb-37e3-416e-a475-e7cea5e5cb0c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:55:22.836084 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84211ebb-37e3-416e-a475-e7cea5e5cb0c admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:55:22.853869 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-0b5472ef-cbe3-4973-b9eb-836a60e48e94 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '561f03e618164927bc30241c89b4e8ac', 'request_id': 'req-0b5472ef-cbe3-4973-b9eb-836a60e48e94'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:55:22.869661 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-0b5472ef-cbe3-4973-b9eb-836a60e48e94 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '561f03e618164927bc30241c89b4e8ac', 'request_id': 'req-0b5472ef-cbe3-4973-b9eb-836a60e48e94'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:55:22.896177 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-0b5472ef-cbe3-4973-b9eb-836a60e48e94 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '561f03e618164927bc30241c89b4e8ac', 'request_id': 'req-0b5472ef-cbe3-4973-b9eb-836a60e48e94'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:55:22.929087 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-0b5472ef-cbe3-4973-b9eb-836a60e48e94 admin admin] The token cache is being invalidate because project 561f03e618164927bc30241c89b4e8ac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81430) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 07:55:22.929355 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-0b5472ef-cbe3-4973-b9eb-836a60e48e94 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:55:22.930497 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-0b5472ef-cbe3-4973-b9eb-836a60e48e94 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:55:22.936442 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 861/1720] 10.222.0.57 () {58 vars in 1233 bytes} [Fri Sep 16 07:55:22 2022] DELETE /identity/v3/projects/561f03e618164927bc30241c89b4e8ac => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 07:55:22.940991 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5472ef-cbe3-4973-b9eb-836a60e48e94 admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:55:22.943665 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-0b5472ef-cbe3-4973-b9eb-836a60e48e94 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:55:22.948229 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf8861a-07dd-44c3-bc05-b46a13520f6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:55:22.949071 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf8861a-07dd-44c3-bc05-b46a13520f6c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:22.949389 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf8861a-07dd-44c3-bc05-b46a13520f6c admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:22.949789 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf8861a-07dd-44c3-bc05-b46a13520f6c admin admin] PATH_INFO: `/v3/projects/8dca0e50f0054fe79a3d6b03222ccec7` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:22.951057 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf8861a-07dd-44c3-bc05-b46a13520f6c admin admin] RBAC: Authorizing `identity:delete_project(project_id=8dca0e50f0054fe79a3d6b03222ccec7)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:55:22.953098 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf8861a-07dd-44c3-bc05-b46a13520f6c admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:55:22.973956 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5472ef-cbe3-4973-b9eb-836a60e48e94 admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:55:22.990854 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7662642d-d894-4d09-9dfd-5f8bac26c58f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:55:22.992475 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7662642d-d894-4d09-9dfd-5f8bac26c58f admin admin] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:22.992915 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7662642d-d894-4d09-9dfd-5f8bac26c58f admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:22.994389 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7662642d-d894-4d09-9dfd-5f8bac26c58f admin admin] PATH_INFO: `/v3/users` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:22.996771 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7662642d-d894-4d09-9dfd-5f8bac26c58f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:55:22.999519 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7662642d-d894-4d09-9dfd-5f8bac26c58f admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:55:23.030082 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 862/1721] 10.222.0.57 () {60 vars in 1144 bytes} [Fri Sep 16 07:55:22 2022] POST /identity/v3/users => generated 296 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 07:55:23.030785 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-2bf8861a-07dd-44c3-bc05-b46a13520f6c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8dca0e50f0054fe79a3d6b03222ccec7', 'request_id': 'req-2bf8861a-07dd-44c3-bc05-b46a13520f6c'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:55:23.031493 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7662642d-d894-4d09-9dfd-5f8bac26c58f admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:55:23.033605 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-7662642d-d894-4d09-9dfd-5f8bac26c58f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:55:23.040275 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-2bf8861a-07dd-44c3-bc05-b46a13520f6c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8dca0e50f0054fe79a3d6b03222ccec7', 'request_id': 'req-2bf8861a-07dd-44c3-bc05-b46a13520f6c'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:55:23.050572 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-2bf8861a-07dd-44c3-bc05-b46a13520f6c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8dca0e50f0054fe79a3d6b03222ccec7', 'request_id': 'req-2bf8861a-07dd-44c3-bc05-b46a13520f6c'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:55:23.053206 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7662642d-d894-4d09-9dfd-5f8bac26c58f admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:55:23.065962 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-2bf8861a-07dd-44c3-bc05-b46a13520f6c admin admin] The token cache is being invalidate because project 8dca0e50f0054fe79a3d6b03222ccec7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81431) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 07:55:23.066328 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-2bf8861a-07dd-44c3-bc05-b46a13520f6c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:55:23.067505 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-2bf8861a-07dd-44c3-bc05-b46a13520f6c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:55:23.072349 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 860/1722] 10.222.0.57 () {58 vars in 1233 bytes} [Fri Sep 16 07:55:22 2022] DELETE /identity/v3/projects/8dca0e50f0054fe79a3d6b03222ccec7 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 07:55:23.072349 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf8861a-07dd-44c3-bc05-b46a13520f6c admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:55:23.072349 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-2bf8861a-07dd-44c3-bc05-b46a13520f6c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:55:23.153036 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:55:23.155046 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38212de-1fab-4f68-886e-0c5e48a58adc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:55:23.156160 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38212de-1fab-4f68-886e-0c5e48a58adc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:23.156784 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38212de-1fab-4f68-886e-0c5e48a58adc admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:23.157184 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38212de-1fab-4f68-886e-0c5e48a58adc admin admin] PATH_INFO: `/v3/users/4ee83bc7034e47a9a31342e8d7b61a4d` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:23.158945 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38212de-1fab-4f68-886e-0c5e48a58adc admin admin] RBAC: Authorizing `identity:delete_user(user_id=4ee83bc7034e47a9a31342e8d7b61a4d)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:55:23.162534 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf8861a-07dd-44c3-bc05-b46a13520f6c admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:55:23.162988 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38212de-1fab-4f68-886e-0c5e48a58adc admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:55:23.169494 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4e9b68-fc1a-4fa1-a245-5b4633545d12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:55:23.171357 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4e9b68-fc1a-4fa1-a245-5b4633545d12 admin admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:23.172016 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4e9b68-fc1a-4fa1-a245-5b4633545d12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:23.172483 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4e9b68-fc1a-4fa1-a245-5b4633545d12 admin admin] PATH_INFO: `/v3/roles` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:23.173335 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4e9b68-fc1a-4fa1-a245-5b4633545d12 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:55:23.177642 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4e9b68-fc1a-4fa1-a245-5b4633545d12 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:55:23.196233 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 861/1723] 10.222.0.57 () {58 vars in 1122 bytes} [Fri Sep 16 07:55:23 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 07:55:23.198653 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8e9f68-d291-4363-9d67-bb16e16cc8a1 None None] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:23.199685 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:55:23.201419 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8e9f68-d291-4363-9d67-bb16e16cc8a1 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:23.202077 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8e9f68-d291-4363-9d67-bb16e16cc8a1 None None] PATH_INFO: `/` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:23.205508 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 862/1724] 10.222.0.57 () {54 vars in 912 bytes} [Fri Sep 16 07:55:23 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 07:55:23.207542 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8e9f68-d291-4363-9d67-bb16e16cc8a1 None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:55:23.210472 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-1d8e9f68-d291-4363-9d67-bb16e16cc8a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:55:23.231235 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8e9f68-d291-4363-9d67-bb16e16cc8a1 None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:55:23.236060 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141fdb9b-b211-4458-931b-ed5f9e3dfe17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:55:23.237061 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141fdb9b-b211-4458-931b-ed5f9e3dfe17 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:23.237061 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141fdb9b-b211-4458-931b-ed5f9e3dfe17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:23.237495 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141fdb9b-b211-4458-931b-ed5f9e3dfe17 admin admin] PATH_INFO: `/v3/users/e5b4186e095945de97f4ed6f2c8c1fc7` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:23.239099 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141fdb9b-b211-4458-931b-ed5f9e3dfe17 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e5b4186e095945de97f4ed6f2c8c1fc7)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:55:23.241139 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141fdb9b-b211-4458-931b-ed5f9e3dfe17 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:55:23.250658 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-f38212de-1fab-4f68-886e-0c5e48a58adc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4ee83bc7034e47a9a31342e8d7b61a4d'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:55:23.251626 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-f38212de-1fab-4f68-886e-0c5e48a58adc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4ee83bc7034e47a9a31342e8d7b61a4d'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:55:23.261876 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-f38212de-1fab-4f68-886e-0c5e48a58adc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4ee83bc7034e47a9a31342e8d7b61a4d'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:55:23.301158 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-f38212de-1fab-4f68-886e-0c5e48a58adc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4ee83bc7034e47a9a31342e8d7b61a4d'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:55:23.320201 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-141fdb9b-b211-4458-931b-ed5f9e3dfe17 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e5b4186e095945de97f4ed6f2c8c1fc7'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:55:23.323922 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-f38212de-1fab-4f68-886e-0c5e48a58adc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4ee83bc7034e47a9a31342e8d7b61a4d'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:55:23.335704 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 863/1725] 10.222.0.57 () {58 vars in 1224 bytes} [Fri Sep 16 07:55:23 2022] DELETE /identity/v3/users/4ee83bc7034e47a9a31342e8d7b61a4d => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 07:55:23.337316 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e654e0a-cde6-490e-bb3c-9d07d3ec1533 None None] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:23.337609 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e654e0a-cde6-490e-bb3c-9d07d3ec1533 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:23.337945 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e654e0a-cde6-490e-bb3c-9d07d3ec1533 None None] PATH_INFO: `/` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:23.341322 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-141fdb9b-b211-4458-931b-ed5f9e3dfe17 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e5b4186e095945de97f4ed6f2c8c1fc7'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:55:23.347118 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-141fdb9b-b211-4458-931b-ed5f9e3dfe17 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e5b4186e095945de97f4ed6f2c8c1fc7'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:55:23.373313 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-141fdb9b-b211-4458-931b-ed5f9e3dfe17 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e5b4186e095945de97f4ed6f2c8c1fc7'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:55:23.388868 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 864/1726] 10.222.0.57 () {54 vars in 912 bytes} [Fri Sep 16 07:55:23 2022] GET /identity => generated 270 bytes in 52 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 07:55:23.391435 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-141fdb9b-b211-4458-931b-ed5f9e3dfe17 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e5b4186e095945de97f4ed6f2c8c1fc7'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:55:23.394013 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e654e0a-cde6-490e-bb3c-9d07d3ec1533 None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:55:23.399740 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-0e654e0a-cde6-490e-bb3c-9d07d3ec1533 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:55:23.402103 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 863/1727] 10.222.0.57 () {58 vars in 1224 bytes} [Fri Sep 16 07:55:23 2022] DELETE /identity/v3/users/e5b4186e095945de97f4ed6f2c8c1fc7 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 07:55:23.404018 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b8d9d1-8e85-4368-b03e-42cdc265f6ae None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:23.404525 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b8d9d1-8e85-4368-b03e-42cdc265f6ae None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:23.404983 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b8d9d1-8e85-4368-b03e-42cdc265f6ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:23.432370 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-c3b8d9d1-8e85-4368-b03e-42cdc265f6ae None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:55:23.435061 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-c3b8d9d1-8e85-4368-b03e-42cdc265f6ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:55:23.544672 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 864/1728] 10.222.0.57 () {58 vars in 958 bytes} [Fri Sep 16 07:55:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 07:55:23.553207 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b8d9d1-8e85-4368-b03e-42cdc265f6ae None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:55:23.561418 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-c3b8d9d1-8e85-4368-b03e-42cdc265f6ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:55:23.610217 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b8d9d1-8e85-4368-b03e-42cdc265f6ae None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:55:23.621872 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed74fde9-d921-4fea-9f7b-5db9adc9321e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:55:23.622477 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed74fde9-d921-4fea-9f7b-5db9adc9321e admin admin] REQUEST_METHOD: `PUT` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:23.622756 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed74fde9-d921-4fea-9f7b-5db9adc9321e admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:23.623036 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed74fde9-d921-4fea-9f7b-5db9adc9321e admin admin] PATH_INFO: `/v3/projects/dc64ce02b1d146f28a90bae00330c377/users/e84500b1b4b241c99cec8d6eba7c4774/roles/4818d38cf2564825b312e66c9eb24762` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:23.627200 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e654e0a-cde6-490e-bb3c-9d07d3ec1533 None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:55:23.638419 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9079349-9587-4e0f-94e7-e2e29fcb00b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:55:23.639048 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9079349-9587-4e0f-94e7-e2e29fcb00b0 admin admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:23.639326 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9079349-9587-4e0f-94e7-e2e29fcb00b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:23.639594 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9079349-9587-4e0f-94e7-e2e29fcb00b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:23.640246 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9079349-9587-4e0f-94e7-e2e29fcb00b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:55:23.641869 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9079349-9587-4e0f-94e7-e2e29fcb00b0 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:55:23.661619 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed74fde9-d921-4fea-9f7b-5db9adc9321e admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc64ce02b1d146f28a90bae00330c377, user_id=e84500b1b4b241c99cec8d6eba7c4774, role_id=4818d38cf2564825b312e66c9eb24762)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:55:23.667756 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed74fde9-d921-4fea-9f7b-5db9adc9321e admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:55:23.673808 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 865/1729] 10.222.0.57 () {58 vars in 1122 bytes} [Fri Sep 16 07:55:23 2022] GET /identity/v3/roles => generated 1420 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 07:55:23.676167 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b627be-80dd-4ef5-a920-64bcb2c91b46 None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:23.676872 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b627be-80dd-4ef5-a920-64bcb2c91b46 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:23.677265 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b627be-80dd-4ef5-a920-64bcb2c91b46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:23.711023 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 865/1730] 10.222.0.57 () {60 vars in 1483 bytes} [Fri Sep 16 07:55:23 2022] PUT /identity/v3/projects/dc64ce02b1d146f28a90bae00330c377/users/e84500b1b4b241c99cec8d6eba7c4774/roles/4818d38cf2564825b312e66c9eb24762 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 07:55:23.717103 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742a561f-e84d-4c2f-a0a8-6f1a141dc5ff None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:23.717392 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742a561f-e84d-4c2f-a0a8-6f1a141dc5ff None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:23.717663 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742a561f-e84d-4c2f-a0a8-6f1a141dc5ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:23.809637 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-742a561f-e84d-4c2f-a0a8-6f1a141dc5ff None None] MFA Rules not processed for user `1062e457207a41e4ba4f0a0c4bf36f1d`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:55:23.815148 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-742a561f-e84d-4c2f-a0a8-6f1a141dc5ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:55:23.823014 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-44b627be-80dd-4ef5-a920-64bcb2c91b46 None None] MFA Rules not processed for user `1062e457207a41e4ba4f0a0c4bf36f1d`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:55:23.824943 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-44b627be-80dd-4ef5-a920-64bcb2c91b46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:55:23.904715 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:55:23.942206 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 866/1731] 10.222.0.57 () {58 vars in 1009 bytes} [Fri Sep 16 07:55:23 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 07:55:23.943836 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6301d4ae-cd6b-41c1-9bcb-3ae5620a2733 None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:23.944020 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6301d4ae-cd6b-41c1-9bcb-3ae5620a2733 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:23.944237 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6301d4ae-cd6b-41c1-9bcb-3ae5620a2733 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:23.960263 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 866/1732] 10.222.0.57 () {58 vars in 1009 bytes} [Fri Sep 16 07:55:23 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 07:55:23.961605 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742a561f-e84d-4c2f-a0a8-6f1a141dc5ff None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:55:24.000637 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-6301d4ae-cd6b-41c1-9bcb-3ae5620a2733 None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:55:24.002329 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-6301d4ae-cd6b-41c1-9bcb-3ae5620a2733 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:55:24.081957 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:DELETE=7,keystone:SELECT=92,keystone:INSERT=1 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:55:24.135080 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742a561f-e84d-4c2f-a0a8-6f1a141dc5ff None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:55:24.141223 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06927f1-82b5-4022-bf19-259d0fa261ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:55:24.141960 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06927f1-82b5-4022-bf19-259d0fa261ed admin admin] REQUEST_METHOD: `PUT` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:24.142214 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06927f1-82b5-4022-bf19-259d0fa261ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:24.142486 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06927f1-82b5-4022-bf19-259d0fa261ed admin admin] PATH_INFO: `/v3/projects/807f63ac6d19461cb60db5e71a33fee8/users/22b4322dca794f6faeda69128ec358db/roles/567db03c91854ad9af1e9a87ec1bd275` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:24.171756 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06927f1-82b5-4022-bf19-259d0fa261ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=807f63ac6d19461cb60db5e71a33fee8, user_id=22b4322dca794f6faeda69128ec358db, role_id=567db03c91854ad9af1e9a87ec1bd275)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:55:24.174475 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06927f1-82b5-4022-bf19-259d0fa261ed admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:55:24.187306 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 867/1733] 10.222.0.57 () {58 vars in 958 bytes} [Fri Sep 16 07:55:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 07:55:24.189156 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62f27cc-7bb6-41c8-bc6f-7976e2130ba4 None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:24.189586 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62f27cc-7bb6-41c8-bc6f-7976e2130ba4 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:24.190200 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62f27cc-7bb6-41c8-bc6f-7976e2130ba4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:24.206752 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 867/1734] 10.222.0.57 () {60 vars in 1483 bytes} [Fri Sep 16 07:55:23 2022] PUT /identity/v3/projects/807f63ac6d19461cb60db5e71a33fee8/users/22b4322dca794f6faeda69128ec358db/roles/567db03c91854ad9af1e9a87ec1bd275 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 07:55:24.207751 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06927f1-82b5-4022-bf19-259d0fa261ed admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:55:24.212910 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-d06927f1-82b5-4022-bf19-259d0fa261ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:55:24.271206 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-b62f27cc-7bb6-41c8-bc6f-7976e2130ba4 None None] MFA Rules not processed for user `e84500b1b4b241c99cec8d6eba7c4774`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:55:24.272066 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-b62f27cc-7bb6-41c8-bc6f-7976e2130ba4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:55:24.317127 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06927f1-82b5-4022-bf19-259d0fa261ed admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:55:24.321869 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101a822d-2ba3-4a08-a31f-d8b0b4071bad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1062e457207a41e4ba4f0a0c4bf36f1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4735f453c0c24cc4a1c14e9ac84a0b46', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:55:24.322489 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101a822d-2ba3-4a08-a31f-d8b0b4071bad service neutron] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:24.322762 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101a822d-2ba3-4a08-a31f-d8b0b4071bad service neutron] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:24.323183 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101a822d-2ba3-4a08-a31f-d8b0b4071bad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:24.347833 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101a822d-2ba3-4a08-a31f-d8b0b4071bad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:55:24.349898 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101a822d-2ba3-4a08-a31f-d8b0b4071bad service neutron] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:55:24.372899 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 868/1735] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Sep 16 07:55:24 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 07:55:24.393227 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101a822d-2ba3-4a08-a31f-d8b0b4071bad service neutron] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:55:24.397169 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 868/1736] 10.222.0.57 () {58 vars in 958 bytes} [Fri Sep 16 07:55:24 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 07:55:24.398903 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62f27cc-7bb6-41c8-bc6f-7976e2130ba4 None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:55:24.401034 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-b62f27cc-7bb6-41c8-bc6f-7976e2130ba4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:55:24.422894 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101a822d-2ba3-4a08-a31f-d8b0b4071bad service neutron] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:55:24.433964 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb1eeed-d910-4acc-99e3-e5a3e77f8b35 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1062e457207a41e4ba4f0a0c4bf36f1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4735f453c0c24cc4a1c14e9ac84a0b46', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:55:24.434851 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb1eeed-d910-4acc-99e3-e5a3e77f8b35 service neutron] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:24.435232 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb1eeed-d910-4acc-99e3-e5a3e77f8b35 service neutron] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:24.435616 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb1eeed-d910-4acc-99e3-e5a3e77f8b35 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:24.452107 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb1eeed-d910-4acc-99e3-e5a3e77f8b35 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:55:24.454644 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb1eeed-d910-4acc-99e3-e5a3e77f8b35 service neutron] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:55:24.476753 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 869/1737] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Sep 16 07:55:24 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 07:55:24.477668 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb1eeed-d910-4acc-99e3-e5a3e77f8b35 service neutron] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:55:24.541084 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62f27cc-7bb6-41c8-bc6f-7976e2130ba4 None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:55:24.556829 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba373af-3860-4833-aa8f-d3c02a2eeb4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:55:24.558971 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba373af-3860-4833-aa8f-d3c02a2eeb4e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:24.559365 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba373af-3860-4833-aa8f-d3c02a2eeb4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:24.560090 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba373af-3860-4833-aa8f-d3c02a2eeb4e admin admin] PATH_INFO: `/v3/projects/7f9f49a6bb3b4bacbdcf0553fd5e5045` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:24.563714 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba373af-3860-4833-aa8f-d3c02a2eeb4e admin admin] RBAC: Authorizing `identity:delete_project(project_id=7f9f49a6bb3b4bacbdcf0553fd5e5045)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:55:24.570768 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba373af-3860-4833-aa8f-d3c02a2eeb4e admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:55:24.620964 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:55:24.632911 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb1eeed-d910-4acc-99e3-e5a3e77f8b35 service neutron] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:55:24.640584 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07827f2f-005e-429f-b96f-737688f55ec9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:55:24.642563 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07827f2f-005e-429f-b96f-737688f55ec9 admin admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:24.647184 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07827f2f-005e-429f-b96f-737688f55ec9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:24.648335 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07827f2f-005e-429f-b96f-737688f55ec9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:24.650045 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07827f2f-005e-429f-b96f-737688f55ec9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:55:24.650931 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07827f2f-005e-429f-b96f-737688f55ec9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:55:24.653543 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07827f2f-005e-429f-b96f-737688f55ec9 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:55:24.682370 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-5ba373af-3860-4833-aa8f-d3c02a2eeb4e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7f9f49a6bb3b4bacbdcf0553fd5e5045', 'request_id': 'req-5ba373af-3860-4833-aa8f-d3c02a2eeb4e'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:55:24.684987 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 870/1738] 10.222.0.57 () {58 vars in 1153 bytes} [Fri Sep 16 07:55:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:55:24.686584 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07827f2f-005e-429f-b96f-737688f55ec9 admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:55:24.696734 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-5ba373af-3860-4833-aa8f-d3c02a2eeb4e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7f9f49a6bb3b4bacbdcf0553fd5e5045', 'request_id': 'req-5ba373af-3860-4833-aa8f-d3c02a2eeb4e'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:55:24.706363 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-5ba373af-3860-4833-aa8f-d3c02a2eeb4e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7f9f49a6bb3b4bacbdcf0553fd5e5045', 'request_id': 'req-5ba373af-3860-4833-aa8f-d3c02a2eeb4e'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:55:24.711870 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:55:24.714053 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07827f2f-005e-429f-b96f-737688f55ec9 admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:55:24.750384 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-5ba373af-3860-4833-aa8f-d3c02a2eeb4e admin admin] The token cache is being invalidate because project 7f9f49a6bb3b4bacbdcf0553fd5e5045 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81430) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 07:55:24.752064 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-5ba373af-3860-4833-aa8f-d3c02a2eeb4e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:55:24.753935 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-5ba373af-3860-4833-aa8f-d3c02a2eeb4e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:55:24.759077 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 869/1739] 10.222.0.57 () {58 vars in 1233 bytes} [Fri Sep 16 07:55:24 2022] DELETE /identity/v3/projects/7f9f49a6bb3b4bacbdcf0553fd5e5045 => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 07:55:24.760112 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba373af-3860-4833-aa8f-d3c02a2eeb4e admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:55:24.763394 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-5ba373af-3860-4833-aa8f-d3c02a2eeb4e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:55:24.901766 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba373af-3860-4833-aa8f-d3c02a2eeb4e admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:55:24.916628 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3caacead-2cb5-41df-95c1-452a22f9608e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:55:24.917385 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3caacead-2cb5-41df-95c1-452a22f9608e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:24.917793 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3caacead-2cb5-41df-95c1-452a22f9608e admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:24.919145 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3caacead-2cb5-41df-95c1-452a22f9608e admin admin] PATH_INFO: `/v3/projects/4f58b8a30d004067ac5271cdde491a5d` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:24.919422 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3caacead-2cb5-41df-95c1-452a22f9608e admin admin] RBAC: Authorizing `identity:delete_project(project_id=4f58b8a30d004067ac5271cdde491a5d)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:55:24.921445 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3caacead-2cb5-41df-95c1-452a22f9608e admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:55:24.936858 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a595c37e-5dc1-4852-b664-3457b7a128f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:55:24.937573 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a595c37e-5dc1-4852-b664-3457b7a128f6 admin admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:24.938713 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a595c37e-5dc1-4852-b664-3457b7a128f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:24.939004 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a595c37e-5dc1-4852-b664-3457b7a128f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:24.939785 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a595c37e-5dc1-4852-b664-3457b7a128f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:55:24.942534 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a595c37e-5dc1-4852-b664-3457b7a128f6 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:55:24.976871 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 871/1740] 10.222.0.57 () {58 vars in 1122 bytes} [Fri Sep 16 07:55:24 2022] GET /identity/v3/roles => generated 1420 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 07:55:24.977920 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a595c37e-5dc1-4852-b664-3457b7a128f6 admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:55:24.984973 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-a595c37e-5dc1-4852-b664-3457b7a128f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:55:25.004518 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a595c37e-5dc1-4852-b664-3457b7a128f6 admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:55:25.037897 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-3caacead-2cb5-41df-95c1-452a22f9608e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4f58b8a30d004067ac5271cdde491a5d', 'request_id': 'req-3caacead-2cb5-41df-95c1-452a22f9608e'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:55:25.053860 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-3caacead-2cb5-41df-95c1-452a22f9608e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4f58b8a30d004067ac5271cdde491a5d', 'request_id': 'req-3caacead-2cb5-41df-95c1-452a22f9608e'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:55:25.070343 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-3caacead-2cb5-41df-95c1-452a22f9608e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4f58b8a30d004067ac5271cdde491a5d', 'request_id': 'req-3caacead-2cb5-41df-95c1-452a22f9608e'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:55:25.091004 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-3caacead-2cb5-41df-95c1-452a22f9608e admin admin] The token cache is being invalidate because project 4f58b8a30d004067ac5271cdde491a5d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81430) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 07:55:25.091365 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-3caacead-2cb5-41df-95c1-452a22f9608e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:55:25.091943 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-3caacead-2cb5-41df-95c1-452a22f9608e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:55:25.092534 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af003460-8a51-43f2-99ea-0443ef4ea45c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:55:25.093388 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af003460-8a51-43f2-99ea-0443ef4ea45c admin admin] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:25.093891 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af003460-8a51-43f2-99ea-0443ef4ea45c admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:25.094445 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af003460-8a51-43f2-99ea-0443ef4ea45c admin admin] PATH_INFO: `/v3/projects` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:25.097557 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 870/1741] 10.222.0.57 () {58 vars in 1233 bytes} [Fri Sep 16 07:55:24 2022] DELETE /identity/v3/projects/4f58b8a30d004067ac5271cdde491a5d => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 07:55:25.098473 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3caacead-2cb5-41df-95c1-452a22f9608e admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:55:25.098815 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af003460-8a51-43f2-99ea-0443ef4ea45c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:55:25.099869 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-3caacead-2cb5-41df-95c1-452a22f9608e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:55:25.106237 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af003460-8a51-43f2-99ea-0443ef4ea45c admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:55:25.119453 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3caacead-2cb5-41df-95c1-452a22f9608e admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:55:25.126632 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff145819-918e-4b14-b68a-e19a2092aeab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:55:25.127253 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff145819-918e-4b14-b68a-e19a2092aeab admin admin] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:25.127586 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff145819-918e-4b14-b68a-e19a2092aeab admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:25.128188 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff145819-918e-4b14-b68a-e19a2092aeab admin admin] PATH_INFO: `/v3/projects` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:25.128847 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff145819-918e-4b14-b68a-e19a2092aeab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:55:25.131362 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff145819-918e-4b14-b68a-e19a2092aeab admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:55:25.173154 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 872/1742] 10.222.0.57 () {60 vars in 1153 bytes} [Fri Sep 16 07:55:24 2022] POST /identity/v3/projects => generated 379 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 07:55:25.175645 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5d62b3-43cf-4dd8-b060-495f37338e70 None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:25.176377 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5d62b3-43cf-4dd8-b060-495f37338e70 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:25.177326 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5d62b3-43cf-4dd8-b060-495f37338e70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:25.190779 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 871/1743] 10.222.0.57 () {60 vars in 1153 bytes} [Fri Sep 16 07:55:25 2022] POST /identity/v3/projects => generated 371 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 07:55:25.190779 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff145819-918e-4b14-b68a-e19a2092aeab admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:55:25.192158 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-ff145819-918e-4b14-b68a-e19a2092aeab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:55:25.221150 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-6c5d62b3-43cf-4dd8-b060-495f37338e70 None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:55:25.223435 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-6c5d62b3-43cf-4dd8-b060-495f37338e70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:55:25.344843 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff145819-918e-4b14-b68a-e19a2092aeab admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:55:25.364589 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb24b1f-6dec-464d-a168-27f9e2ae63c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:55:25.366671 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb24b1f-6dec-464d-a168-27f9e2ae63c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:25.369339 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb24b1f-6dec-464d-a168-27f9e2ae63c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:25.369771 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb24b1f-6dec-464d-a168-27f9e2ae63c0 admin admin] PATH_INFO: `/v3/projects/807f63ac6d19461cb60db5e71a33fee8/users/22b4322dca794f6faeda69128ec358db/roles/567db03c91854ad9af1e9a87ec1bd275` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:25.375097 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb24b1f-6dec-464d-a168-27f9e2ae63c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=807f63ac6d19461cb60db5e71a33fee8, user_id=22b4322dca794f6faeda69128ec358db, role_id=567db03c91854ad9af1e9a87ec1bd275)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:55:25.379476 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 873/1744] 10.222.0.57 () {58 vars in 958 bytes} [Fri Sep 16 07:55:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 07:55:25.381924 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef2f5e5-84f1-4641-8e52-37c09352d098 None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:25.382211 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef2f5e5-84f1-4641-8e52-37c09352d098 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:25.382481 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef2f5e5-84f1-4641-8e52-37c09352d098 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:25.383388 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb24b1f-6dec-464d-a168-27f9e2ae63c0 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:55:25.389522 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:55:25.426414 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 872/1745] 10.222.0.57 () {60 vars in 1483 bytes} [Fri Sep 16 07:55:25 2022] PUT /identity/v3/projects/807f63ac6d19461cb60db5e71a33fee8/users/22b4322dca794f6faeda69128ec358db/roles/567db03c91854ad9af1e9a87ec1bd275 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 07:55:25.427409 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb24b1f-6dec-464d-a168-27f9e2ae63c0 admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:55:25.457631 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-5eb24b1f-6dec-464d-a168-27f9e2ae63c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:55:25.467319 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-1ef2f5e5-84f1-4641-8e52-37c09352d098 None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:55:25.468619 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-1ef2f5e5-84f1-4641-8e52-37c09352d098 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:55:25.482854 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:55:25.650495 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 874/1746] 10.222.0.57 () {58 vars in 958 bytes} [Fri Sep 16 07:55:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 07:55:25.651548 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef2f5e5-84f1-4641-8e52-37c09352d098 None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:55:25.660684 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb24b1f-6dec-464d-a168-27f9e2ae63c0 admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:55:25.667570 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af6e8ea-99f8-4207-b4e1-b7c7db4d7cf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:55:25.668391 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af6e8ea-99f8-4207-b4e1-b7c7db4d7cf2 admin admin] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:25.669663 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af6e8ea-99f8-4207-b4e1-b7c7db4d7cf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:25.670123 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af6e8ea-99f8-4207-b4e1-b7c7db4d7cf2 admin admin] PATH_INFO: `/v3/users` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:25.670910 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af6e8ea-99f8-4207-b4e1-b7c7db4d7cf2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:55:25.673352 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af6e8ea-99f8-4207-b4e1-b7c7db4d7cf2 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:55:25.676106 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef2f5e5-84f1-4641-8e52-37c09352d098 None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:55:25.683132 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f82b43-24a4-44a0-b06e-cfdff6c184b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:55:25.695292 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f82b43-24a4-44a0-b06e-cfdff6c184b9 admin admin] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:25.695779 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f82b43-24a4-44a0-b06e-cfdff6c184b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:25.697016 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f82b43-24a4-44a0-b06e-cfdff6c184b9 admin admin] PATH_INFO: `/v3/users` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:25.698381 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f82b43-24a4-44a0-b06e-cfdff6c184b9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:55:25.701574 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f82b43-24a4-44a0-b06e-cfdff6c184b9 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:55:25.703630 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 873/1747] 10.222.0.57 () {60 vars in 1144 bytes} [Fri Sep 16 07:55:25 2022] POST /identity/v3/users => generated 296 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 07:55:25.705308 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25132f6f-5913-4254-b514-b13013f38e48 None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:25.706368 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25132f6f-5913-4254-b514-b13013f38e48 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:25.707180 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25132f6f-5913-4254-b514-b13013f38e48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:25.735293 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-25132f6f-5913-4254-b514-b13013f38e48 None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:55:25.736522 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-25132f6f-5913-4254-b514-b13013f38e48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:55:25.743475 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 875/1748] 10.222.0.57 () {60 vars in 1144 bytes} [Fri Sep 16 07:55:25 2022] POST /identity/v3/users => generated 286 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 07:55:25.745086 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b44d20-cf66-4d7a-9ec3-af6450594f28 None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:25.745419 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b44d20-cf66-4d7a-9ec3-af6450594f28 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:25.745697 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b44d20-cf66-4d7a-9ec3-af6450594f28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:25.769890 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 874/1749] 10.222.0.57 () {58 vars in 958 bytes} [Fri Sep 16 07:55:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 07:55:25.770962 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25132f6f-5913-4254-b514-b13013f38e48 None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:55:25.773001 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-25132f6f-5913-4254-b514-b13013f38e48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:55:25.785479 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-63b44d20-cf66-4d7a-9ec3-af6450594f28 None None] MFA Rules not processed for user `22b4322dca794f6faeda69128ec358db`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:55:25.787109 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-63b44d20-cf66-4d7a-9ec3-af6450594f28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:55:25.879492 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 876/1750] 10.222.0.57 () {58 vars in 958 bytes} [Fri Sep 16 07:55:25 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 07:55:25.884523 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b44d20-cf66-4d7a-9ec3-af6450594f28 None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:55:25.884523 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-63b44d20-cf66-4d7a-9ec3-af6450594f28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:55:25.901655 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25132f6f-5913-4254-b514-b13013f38e48 None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:55:25.908323 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0dc9fc-7fa4-49e2-b90f-6ba8133c9e81 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bec4d9b08514461a1bf63c6b88f53b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4735f453c0c24cc4a1c14e9ac84a0b46', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:55:25.909548 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0dc9fc-7fa4-49e2-b90f-6ba8133c9e81 service nova] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:25.909970 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0dc9fc-7fa4-49e2-b90f-6ba8133c9e81 service nova] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:25.910367 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0dc9fc-7fa4-49e2-b90f-6ba8133c9e81 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:25.912626 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-9d0dc9fc-7fa4-49e2-b90f-6ba8133c9e81 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:55:25.967502 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b44d20-cf66-4d7a-9ec3-af6450594f28 None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:55:25.973423 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6982fb45-7db5-45ee-a8e3-967dec072a25 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7d4ccdd6ef9400ba9e344df0964da1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4735f453c0c24cc4a1c14e9ac84a0b46', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:55:25.974223 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6982fb45-7db5-45ee-a8e3-967dec072a25 service placement] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:25.975428 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6982fb45-7db5-45ee-a8e3-967dec072a25 service placement] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:25.975428 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6982fb45-7db5-45ee-a8e3-967dec072a25 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:25.976787 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-6982fb45-7db5-45ee-a8e3-967dec072a25 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:55:25.983312 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0dc9fc-7fa4-49e2-b90f-6ba8133c9e81 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:55:25.985072 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0dc9fc-7fa4-49e2-b90f-6ba8133c9e81 service nova] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:55:25.989580 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6982fb45-7db5-45ee-a8e3-967dec072a25 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:55:25.991345 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6982fb45-7db5-45ee-a8e3-967dec072a25 service placement] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:55:25.996749 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 875/1751] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Sep 16 07:55:25 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 07:55:25.998806 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36f67a3-8beb-43b6-bdcc-75c455e76bb5 None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:25.999231 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36f67a3-8beb-43b6-bdcc-75c455e76bb5 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:25.999537 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36f67a3-8beb-43b6-bdcc-75c455e76bb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:26.003096 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 877/1752] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Sep 16 07:55:25 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 07:55:26.004591 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86484fc4-fa93-43bd-82e0-3f2c169c3b1c None None] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:26.004975 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86484fc4-fa93-43bd-82e0-3f2c169c3b1c None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:26.005343 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86484fc4-fa93-43bd-82e0-3f2c169c3b1c None None] PATH_INFO: `/` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:26.007745 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 878/1753] 10.222.0.57 () {54 vars in 961 bytes} [Fri Sep 16 07:55:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 07:55:26.008778 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86484fc4-fa93-43bd-82e0-3f2c169c3b1c None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:55:26.026369 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86484fc4-fa93-43bd-82e0-3f2c169c3b1c None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:55:26.060097 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e66788-302e-4b1e-8bf6-68f6c7b544d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:55:26.060919 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e66788-302e-4b1e-8bf6-68f6c7b544d2 admin admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:26.061375 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e66788-302e-4b1e-8bf6-68f6c7b544d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:26.061931 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e66788-302e-4b1e-8bf6-68f6c7b544d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:26.062533 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e66788-302e-4b1e-8bf6-68f6c7b544d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:55:26.066856 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e66788-302e-4b1e-8bf6-68f6c7b544d2 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:55:26.072585 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-c36f67a3-8beb-43b6-bdcc-75c455e76bb5 None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:55:26.072815 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:55:26.074462 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-c36f67a3-8beb-43b6-bdcc-75c455e76bb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:55:26.096987 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 879/1754] 10.222.0.57 () {58 vars in 1122 bytes} [Fri Sep 16 07:55:26 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 07:55:26.099656 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e66788-302e-4b1e-8bf6-68f6c7b544d2 admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:55:26.109580 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 876/1755] 10.222.0.57 () {58 vars in 958 bytes} [Fri Sep 16 07:55:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 07:55:26.109580 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36f67a3-8beb-43b6-bdcc-75c455e76bb5 None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:55:26.138717 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e66788-302e-4b1e-8bf6-68f6c7b544d2 admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:55:26.138900 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36f67a3-8beb-43b6-bdcc-75c455e76bb5 None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:55:26.160130 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8398d20e-dbd0-476d-abb9-dc22ad661590 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:55:26.162545 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7572ff3f-7579-4267-87b6-2b87f0b71e48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:55:26.163280 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7572ff3f-7579-4267-87b6-2b87f0b71e48 admin admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:26.163783 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8398d20e-dbd0-476d-abb9-dc22ad661590 admin admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:26.169140 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7572ff3f-7579-4267-87b6-2b87f0b71e48 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:26.170453 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8398d20e-dbd0-476d-abb9-dc22ad661590 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:26.171827 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7572ff3f-7579-4267-87b6-2b87f0b71e48 admin admin] PATH_INFO: `/v3/domains` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:26.172277 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8398d20e-dbd0-476d-abb9-dc22ad661590 admin admin] PATH_INFO: `/v3/roles` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:26.173400 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7572ff3f-7579-4267-87b6-2b87f0b71e48 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:55:26.175620 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8398d20e-dbd0-476d-abb9-dc22ad661590 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:55:26.176077 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7572ff3f-7579-4267-87b6-2b87f0b71e48 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:55:26.178768 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8398d20e-dbd0-476d-abb9-dc22ad661590 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:55:26.180114 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7572ff3f-7579-4267-87b6-2b87f0b71e48 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:55:26.184215 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:55:26.198288 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 880/1756] 10.222.0.57 () {58 vars in 1122 bytes} [Fri Sep 16 07:55:26 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 07:55:26.199700 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189dd62f-25bf-4599-a9c7-49af9a693edf None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:26.200152 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189dd62f-25bf-4599-a9c7-49af9a693edf None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:26.200435 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189dd62f-25bf-4599-a9c7-49af9a693edf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:26.225267 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 877/1757] 10.222.0.57 () {58 vars in 1153 bytes} [Fri Sep 16 07:55:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:55:26.228141 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7572ff3f-7579-4267-87b6-2b87f0b71e48 admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:55:26.230833 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-189dd62f-25bf-4599-a9c7-49af9a693edf None None] MFA Rules not processed for user `c0bb5e7b0e664b3ebbce9f6317b83778`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:55:26.232366 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-189dd62f-25bf-4599-a9c7-49af9a693edf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:55:26.234827 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-7572ff3f-7579-4267-87b6-2b87f0b71e48 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:55:26.352767 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7572ff3f-7579-4267-87b6-2b87f0b71e48 admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:55:26.357685 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3def1ac4-4223-41e2-8961-f6fa612a2f56 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544bf6be4c24454a013ca110c43cef2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4735f453c0c24cc4a1c14e9ac84a0b46', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:55:26.359836 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3def1ac4-4223-41e2-8961-f6fa612a2f56 service cinder] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:26.360349 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3def1ac4-4223-41e2-8961-f6fa612a2f56 service cinder] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:26.360825 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3def1ac4-4223-41e2-8961-f6fa612a2f56 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:26.376843 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3def1ac4-4223-41e2-8961-f6fa612a2f56 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:55:26.379978 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3def1ac4-4223-41e2-8961-f6fa612a2f56 service cinder] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:55:26.385092 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 881/1758] 10.222.0.57 () {58 vars in 958 bytes} [Fri Sep 16 07:55:26 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 07:55:26.386669 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e07d483-e2e5-4a62-9a42-4c0368c03afd None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:26.386955 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e07d483-e2e5-4a62-9a42-4c0368c03afd None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:26.387226 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e07d483-e2e5-4a62-9a42-4c0368c03afd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:26.392732 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 878/1759] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Sep 16 07:55:26 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 07:55:26.393973 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3def1ac4-4223-41e2-8961-f6fa612a2f56 service cinder] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:55:26.413433 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3def1ac4-4223-41e2-8961-f6fa612a2f56 service cinder] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:55:26.424386 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94bc41d-7a97-4d85-be23-b6acc64ec7a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:55:26.426131 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94bc41d-7a97-4d85-be23-b6acc64ec7a4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:26.426418 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94bc41d-7a97-4d85-be23-b6acc64ec7a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:26.426692 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94bc41d-7a97-4d85-be23-b6acc64ec7a4 admin admin] PATH_INFO: `/v3/projects/1f230c2cd0ce4904b355234bbe3f2bc0/users/2bbd4d4f0620449a913f2e08f09d9266/roles/567db03c91854ad9af1e9a87ec1bd275` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:26.468479 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-7e07d483-e2e5-4a62-9a42-4c0368c03afd None None] MFA Rules not processed for user `c7d4ccdd6ef9400ba9e344df0964da1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:55:26.469710 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-7e07d483-e2e5-4a62-9a42-4c0368c03afd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:55:26.488643 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94bc41d-7a97-4d85-be23-b6acc64ec7a4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1f230c2cd0ce4904b355234bbe3f2bc0, user_id=2bbd4d4f0620449a913f2e08f09d9266, role_id=567db03c91854ad9af1e9a87ec1bd275)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:55:26.491992 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 882/1760] 10.222.0.57 () {58 vars in 1058 bytes} [Fri Sep 16 07:55:26 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 07:55:26.500152 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e07d483-e2e5-4a62-9a42-4c0368c03afd None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:55:26.508088 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94bc41d-7a97-4d85-be23-b6acc64ec7a4 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:55:26.563594 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 879/1761] 10.222.0.57 () {60 vars in 1483 bytes} [Fri Sep 16 07:55:26 2022] PUT /identity/v3/projects/1f230c2cd0ce4904b355234bbe3f2bc0/users/2bbd4d4f0620449a913f2e08f09d9266/roles/567db03c91854ad9af1e9a87ec1bd275 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 07:55:26.564696 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94bc41d-7a97-4d85-be23-b6acc64ec7a4 admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:55:26.575139 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e07d483-e2e5-4a62-9a42-4c0368c03afd None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:55:26.676839 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94bc41d-7a97-4d85-be23-b6acc64ec7a4 admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:55:26.683494 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d15529c-27ed-432c-bb19-01c2bdafbda0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:55:26.684347 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d15529c-27ed-432c-bb19-01c2bdafbda0 admin admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:26.684637 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d15529c-27ed-432c-bb19-01c2bdafbda0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:26.684915 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d15529c-27ed-432c-bb19-01c2bdafbda0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:26.689895 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d15529c-27ed-432c-bb19-01c2bdafbda0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:55:26.694864 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d15529c-27ed-432c-bb19-01c2bdafbda0 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:55:26.723134 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 880/1762] 10.222.0.57 () {58 vars in 1122 bytes} [Fri Sep 16 07:55:26 2022] GET /identity/v3/roles => generated 1420 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 07:55:26.724079 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d15529c-27ed-432c-bb19-01c2bdafbda0 admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:55:26.750528 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d15529c-27ed-432c-bb19-01c2bdafbda0 admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:55:26.766752 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f79504-5653-47e9-9a6f-85e690680f0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:55:26.767707 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c977ac0-77b7-451d-bcc0-40e9788eb8e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:55:26.769151 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f79504-5653-47e9-9a6f-85e690680f0e admin admin] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:26.769839 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f79504-5653-47e9-9a6f-85e690680f0e admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:26.770236 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c977ac0-77b7-451d-bcc0-40e9788eb8e3 admin admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:26.770609 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c977ac0-77b7-451d-bcc0-40e9788eb8e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:26.770781 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f79504-5653-47e9-9a6f-85e690680f0e admin admin] PATH_INFO: `/v3/projects` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:26.771414 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f79504-5653-47e9-9a6f-85e690680f0e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:55:26.771914 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c977ac0-77b7-451d-bcc0-40e9788eb8e3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:26.773948 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c977ac0-77b7-451d-bcc0-40e9788eb8e3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:55:26.774190 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c977ac0-77b7-451d-bcc0-40e9788eb8e3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:55:26.777345 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c977ac0-77b7-451d-bcc0-40e9788eb8e3 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:55:26.777908 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f79504-5653-47e9-9a6f-85e690680f0e admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:55:26.818248 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 883/1763] 10.222.0.57 () {58 vars in 1153 bytes} [Fri Sep 16 07:55:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:55:26.821215 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c977ac0-77b7-451d-bcc0-40e9788eb8e3 admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:55:26.868005 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 881/1764] 10.222.0.57 () {60 vars in 1153 bytes} [Fri Sep 16 07:55:26 2022] POST /identity/v3/projects => generated 377 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 07:55:26.876315 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f79504-5653-47e9-9a6f-85e690680f0e admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:55:26.985050 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c977ac0-77b7-451d-bcc0-40e9788eb8e3 admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:55:27.014029 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:55:27.077569 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f79504-5653-47e9-9a6f-85e690680f0e admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:55:27.090287 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:55:27.090606 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed63d26-1ad0-4ab4-a66e-d31d49fbe1e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:55:27.091612 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed63d26-1ad0-4ab4-a66e-d31d49fbe1e7 admin admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:27.092105 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed63d26-1ad0-4ab4-a66e-d31d49fbe1e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:27.092681 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed63d26-1ad0-4ab4-a66e-d31d49fbe1e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:27.093552 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed63d26-1ad0-4ab4-a66e-d31d49fbe1e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:55:27.095456 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed63d26-1ad0-4ab4-a66e-d31d49fbe1e7 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:55:27.116222 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 882/1765] 10.222.0.57 () {58 vars in 1122 bytes} [Fri Sep 16 07:55:26 2022] GET /identity/v3/roles => generated 1420 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 07:55:27.120833 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed63d26-1ad0-4ab4-a66e-d31d49fbe1e7 admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:55:27.146136 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed63d26-1ad0-4ab4-a66e-d31d49fbe1e7 admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:55:27.161240 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50234097-523b-438b-814d-78c6838475b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:55:27.161957 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50234097-523b-438b-814d-78c6838475b5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:27.162235 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50234097-523b-438b-814d-78c6838475b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:27.162532 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50234097-523b-438b-814d-78c6838475b5 admin admin] PATH_INFO: `/v3/projects/425be61bcfa047bfb4bb7d9d9a3d88a2/users/1c7a0339a9644455940a4975dce12a6a/roles/4818d38cf2564825b312e66c9eb24762` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:27.178982 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c89d47f-3d72-4db8-8055-19fdd6f7eed6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7d4ccdd6ef9400ba9e344df0964da1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4735f453c0c24cc4a1c14e9ac84a0b46', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:55:27.179922 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c89d47f-3d72-4db8-8055-19fdd6f7eed6 service placement] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:27.180738 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c89d47f-3d72-4db8-8055-19fdd6f7eed6 service placement] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:27.181119 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c89d47f-3d72-4db8-8055-19fdd6f7eed6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:27.202724 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c89d47f-3d72-4db8-8055-19fdd6f7eed6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:55:27.206406 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c89d47f-3d72-4db8-8055-19fdd6f7eed6 service placement] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:55:27.210920 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50234097-523b-438b-814d-78c6838475b5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=425be61bcfa047bfb4bb7d9d9a3d88a2, user_id=1c7a0339a9644455940a4975dce12a6a, role_id=4818d38cf2564825b312e66c9eb24762)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:55:27.214967 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50234097-523b-438b-814d-78c6838475b5 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:55:27.236246 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 884/1766] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Sep 16 07:55:26 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 07:55:27.236246 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c89d47f-3d72-4db8-8055-19fdd6f7eed6 service placement] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:55:27.251635 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 883/1767] 10.222.0.57 () {60 vars in 1483 bytes} [Fri Sep 16 07:55:27 2022] PUT /identity/v3/projects/425be61bcfa047bfb4bb7d9d9a3d88a2/users/1c7a0339a9644455940a4975dce12a6a/roles/4818d38cf2564825b312e66c9eb24762 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 07:55:27.252239 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50234097-523b-438b-814d-78c6838475b5 admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:55:27.264288 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c89d47f-3d72-4db8-8055-19fdd6f7eed6 service placement] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:55:27.434320 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50234097-523b-438b-814d-78c6838475b5 admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:55:27.448089 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdc5d83-a571-42b0-b5db-08834d7938de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:55:27.448847 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdc5d83-a571-42b0-b5db-08834d7938de admin admin] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:27.449474 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdc5d83-a571-42b0-b5db-08834d7938de admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:27.451584 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdc5d83-a571-42b0-b5db-08834d7938de admin admin] PATH_INFO: `/v3/projects` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:27.452440 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecdc5d83-a571-42b0-b5db-08834d7938de admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:55:27.455795 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1616064d-5ac0-478d-aa60-3aefe34905c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:55:27.456702 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecdc5d83-a571-42b0-b5db-08834d7938de admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:55:27.456922 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1616064d-5ac0-478d-aa60-3aefe34905c5 admin admin] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:27.457306 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1616064d-5ac0-478d-aa60-3aefe34905c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:27.457623 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1616064d-5ac0-478d-aa60-3aefe34905c5 admin admin] PATH_INFO: `/v3/users` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:27.460255 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1616064d-5ac0-478d-aa60-3aefe34905c5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:55:27.464984 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1616064d-5ac0-478d-aa60-3aefe34905c5 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:55:27.530531 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 884/1768] 10.222.0.57 () {60 vars in 1144 bytes} [Fri Sep 16 07:55:27 2022] POST /identity/v3/users => generated 289 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 07:55:27.531592 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1616064d-5ac0-478d-aa60-3aefe34905c5 admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:55:27.534894 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 885/1769] 10.222.0.57 () {60 vars in 1153 bytes} [Fri Sep 16 07:55:27 2022] POST /identity/v3/projects => generated 363 bytes in 304 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 07:55:27.536015 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdc5d83-a571-42b0-b5db-08834d7938de admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:55:27.562778 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1616064d-5ac0-478d-aa60-3aefe34905c5 admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:55:27.711091 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b275fa-50c5-4c73-99a0-1e19d2e6d27d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:55:27.715793 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b275fa-50c5-4c73-99a0-1e19d2e6d27d admin admin] REQUEST_METHOD: `PUT` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:27.716090 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b275fa-50c5-4c73-99a0-1e19d2e6d27d admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:27.716379 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b275fa-50c5-4c73-99a0-1e19d2e6d27d admin admin] PATH_INFO: `/v3/projects/1f230c2cd0ce4904b355234bbe3f2bc0/users/2bbd4d4f0620449a913f2e08f09d9266/roles/567db03c91854ad9af1e9a87ec1bd275` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:27.721067 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdc5d83-a571-42b0-b5db-08834d7938de admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:55:27.723562 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b275fa-50c5-4c73-99a0-1e19d2e6d27d admin admin] RBAC: Authorizing `identity:create_grant(project_id=1f230c2cd0ce4904b355234bbe3f2bc0, user_id=2bbd4d4f0620449a913f2e08f09d9266, role_id=567db03c91854ad9af1e9a87ec1bd275)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:55:27.730573 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b275fa-50c5-4c73-99a0-1e19d2e6d27d admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:55:27.749792 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad947d12-d004-4f0b-957f-c27ec271404a tempest-VolumeQuotaClassesTest-870281530 tempest-VolumeQuotaClassesTest-870281530-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22b4322dca794f6faeda69128ec358db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '807f63ac6d19461cb60db5e71a33fee8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:55:27.754730 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 885/1770] 10.222.0.57 () {60 vars in 1483 bytes} [Fri Sep 16 07:55:27 2022] PUT /identity/v3/projects/1f230c2cd0ce4904b355234bbe3f2bc0/users/2bbd4d4f0620449a913f2e08f09d9266/roles/567db03c91854ad9af1e9a87ec1bd275 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 07:55:27.755036 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad947d12-d004-4f0b-957f-c27ec271404a tempest-VolumeQuotaClassesTest-870281530 tempest-VolumeQuotaClassesTest-870281530-project-admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:27.755506 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad947d12-d004-4f0b-957f-c27ec271404a tempest-VolumeQuotaClassesTest-870281530 tempest-VolumeQuotaClassesTest-870281530-project-admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:27.755778 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad947d12-d004-4f0b-957f-c27ec271404a tempest-VolumeQuotaClassesTest-870281530 tempest-VolumeQuotaClassesTest-870281530-project-admin] PATH_INFO: `/v3/domains` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:27.756476 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b441af16-a237-4964-be2b-089a1405db9c None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:27.756618 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad947d12-d004-4f0b-957f-c27ec271404a tempest-VolumeQuotaClassesTest-870281530 tempest-VolumeQuotaClassesTest-870281530-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:55:27.756786 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad947d12-d004-4f0b-957f-c27ec271404a tempest-VolumeQuotaClassesTest-870281530 tempest-VolumeQuotaClassesTest-870281530-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:55:27.756916 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b441af16-a237-4964-be2b-089a1405db9c None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:27.757252 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b441af16-a237-4964-be2b-089a1405db9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:27.758471 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad947d12-d004-4f0b-957f-c27ec271404a tempest-VolumeQuotaClassesTest-870281530 tempest-VolumeQuotaClassesTest-870281530-project-admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:55:27.812933 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-b441af16-a237-4964-be2b-089a1405db9c None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:55:27.816083 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-b441af16-a237-4964-be2b-089a1405db9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:55:27.820826 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 886/1771] 10.222.0.57 () {58 vars in 1153 bytes} [Fri Sep 16 07:55:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:55:27.826637 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad947d12-d004-4f0b-957f-c27ec271404a tempest-VolumeQuotaClassesTest-870281530 tempest-VolumeQuotaClassesTest-870281530-project-admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:55:27.863721 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad947d12-d004-4f0b-957f-c27ec271404a tempest-VolumeQuotaClassesTest-870281530 tempest-VolumeQuotaClassesTest-870281530-project-admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:55:27.915365 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:55:27.991075 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:55:28.015119 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 886/1772] 10.222.0.57 () {58 vars in 958 bytes} [Fri Sep 16 07:55:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 07:55:28.021518 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b441af16-a237-4964-be2b-089a1405db9c None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:55:28.048011 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b441af16-a237-4964-be2b-089a1405db9c None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:55:28.056016 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822b78d9-d8b4-49c7-a5fe-1cb9a0e2e43b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:55:28.056741 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822b78d9-d8b4-49c7-a5fe-1cb9a0e2e43b admin admin] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:28.057020 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822b78d9-d8b4-49c7-a5fe-1cb9a0e2e43b admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:28.058138 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822b78d9-d8b4-49c7-a5fe-1cb9a0e2e43b admin admin] PATH_INFO: `/v3/users` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:28.059392 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822b78d9-d8b4-49c7-a5fe-1cb9a0e2e43b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:55:28.069019 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822b78d9-d8b4-49c7-a5fe-1cb9a0e2e43b admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:55:28.085535 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ab6918-d748-47bf-8cdb-25f93ffb1339 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:55:28.086293 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ab6918-d748-47bf-8cdb-25f93ffb1339 admin admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:28.086574 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ab6918-d748-47bf-8cdb-25f93ffb1339 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:28.086850 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ab6918-d748-47bf-8cdb-25f93ffb1339 admin admin] PATH_INFO: `/v3/roles` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:28.087551 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ab6918-d748-47bf-8cdb-25f93ffb1339 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:55:28.090603 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ab6918-d748-47bf-8cdb-25f93ffb1339 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:55:28.119857 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 887/1773] 10.222.0.57 () {58 vars in 1122 bytes} [Fri Sep 16 07:55:27 2022] GET /identity/v3/roles => generated 1420 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 07:55:28.122896 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e870648d-bebc-4892-a9e2-d49b18bee4ac None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:28.124456 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e870648d-bebc-4892-a9e2-d49b18bee4ac None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:28.125272 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e870648d-bebc-4892-a9e2-d49b18bee4ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:28.137072 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 887/1774] 10.222.0.57 () {60 vars in 1144 bytes} [Fri Sep 16 07:55:28 2022] POST /identity/v3/users => generated 282 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 07:55:28.137931 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822b78d9-d8b4-49c7-a5fe-1cb9a0e2e43b admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:55:28.203659 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-e870648d-bebc-4892-a9e2-d49b18bee4ac None None] MFA Rules not processed for user `2bbd4d4f0620449a913f2e08f09d9266`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:55:28.205246 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-e870648d-bebc-4892-a9e2-d49b18bee4ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:55:28.368185 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822b78d9-d8b4-49c7-a5fe-1cb9a0e2e43b admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:55:28.380747 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40259425-3575-4da0-b59a-63b278805a4f tempest-VolumeQuotaClassesTest-870281530 tempest-VolumeQuotaClassesTest-870281530-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22b4322dca794f6faeda69128ec358db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '807f63ac6d19461cb60db5e71a33fee8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:55:28.381776 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40259425-3575-4da0-b59a-63b278805a4f tempest-VolumeQuotaClassesTest-870281530 tempest-VolumeQuotaClassesTest-870281530-project-admin] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:28.382282 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40259425-3575-4da0-b59a-63b278805a4f tempest-VolumeQuotaClassesTest-870281530 tempest-VolumeQuotaClassesTest-870281530-project-admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:28.382716 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40259425-3575-4da0-b59a-63b278805a4f tempest-VolumeQuotaClassesTest-870281530 tempest-VolumeQuotaClassesTest-870281530-project-admin] PATH_INFO: `/v3/projects` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:28.383514 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40259425-3575-4da0-b59a-63b278805a4f tempest-VolumeQuotaClassesTest-870281530 tempest-VolumeQuotaClassesTest-870281530-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:55:28.386271 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40259425-3575-4da0-b59a-63b278805a4f tempest-VolumeQuotaClassesTest-870281530 tempest-VolumeQuotaClassesTest-870281530-project-admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:55:28.428504 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 888/1775] 10.222.0.57 () {58 vars in 958 bytes} [Fri Sep 16 07:55:28 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 308 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 07:55:28.430620 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e870648d-bebc-4892-a9e2-d49b18bee4ac None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:55:28.436014 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-e870648d-bebc-4892-a9e2-d49b18bee4ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:55:28.452814 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 888/1776] 10.222.0.57 () {60 vars in 1153 bytes} [Fri Sep 16 07:55:28 2022] POST /identity/v3/projects => generated 355 bytes in 315 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 07:55:28.470200 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40259425-3575-4da0-b59a-63b278805a4f tempest-VolumeQuotaClassesTest-870281530 tempest-VolumeQuotaClassesTest-870281530-project-admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:55:28.653511 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40259425-3575-4da0-b59a-63b278805a4f tempest-VolumeQuotaClassesTest-870281530 tempest-VolumeQuotaClassesTest-870281530-project-admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:55:28.661522 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f59e3f1-0f0b-4a53-882d-7b7b95482d66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:55:28.662278 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f59e3f1-0f0b-4a53-882d-7b7b95482d66 admin admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:28.662630 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f59e3f1-0f0b-4a53-882d-7b7b95482d66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:28.662829 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f59e3f1-0f0b-4a53-882d-7b7b95482d66 admin admin] PATH_INFO: `/v3/roles` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:28.663493 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f59e3f1-0f0b-4a53-882d-7b7b95482d66 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:55:28.665106 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f59e3f1-0f0b-4a53-882d-7b7b95482d66 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:55:28.665520 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e870648d-bebc-4892-a9e2-d49b18bee4ac None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:55:28.703717 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 889/1777] 10.222.0.57 () {58 vars in 1122 bytes} [Fri Sep 16 07:55:28 2022] GET /identity/v3/roles => generated 1420 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 07:55:28.704744 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f59e3f1-0f0b-4a53-882d-7b7b95482d66 admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:55:28.720308 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f59e3f1-0f0b-4a53-882d-7b7b95482d66 admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:55:28.733021 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d893ffaf-28c7-4d8e-be11-8c6b74188377 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:55:28.733830 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d893ffaf-28c7-4d8e-be11-8c6b74188377 admin admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:28.734123 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d893ffaf-28c7-4d8e-be11-8c6b74188377 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:28.734403 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d893ffaf-28c7-4d8e-be11-8c6b74188377 admin admin] PATH_INFO: `/v3/roles` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:28.735101 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d893ffaf-28c7-4d8e-be11-8c6b74188377 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:55:28.737419 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d893ffaf-28c7-4d8e-be11-8c6b74188377 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:55:28.749607 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 890/1778] 10.222.0.57 () {58 vars in 1122 bytes} [Fri Sep 16 07:55:28 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 07:55:28.750724 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d893ffaf-28c7-4d8e-be11-8c6b74188377 admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:55:28.752808 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-d893ffaf-28c7-4d8e-be11-8c6b74188377 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:55:28.831879 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e6bf4d-455c-434d-8a54-91b95b7a6a93 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1062e457207a41e4ba4f0a0c4bf36f1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4735f453c0c24cc4a1c14e9ac84a0b46', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:55:28.832506 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e6bf4d-455c-434d-8a54-91b95b7a6a93 service neutron] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:28.833012 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e6bf4d-455c-434d-8a54-91b95b7a6a93 service neutron] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:28.833297 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e6bf4d-455c-434d-8a54-91b95b7a6a93 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:28.862387 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e6bf4d-455c-434d-8a54-91b95b7a6a93 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:55:28.864930 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e6bf4d-455c-434d-8a54-91b95b7a6a93 service neutron] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:55:28.908477 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:55:28.943971 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 889/1779] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Sep 16 07:55:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 515 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 07:55:28.945071 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e6bf4d-455c-434d-8a54-91b95b7a6a93 service neutron] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:55:28.987959 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d893ffaf-28c7-4d8e-be11-8c6b74188377 admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:55:28.989788 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:55:29.008513 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88dd4cc7-ce45-4d1a-97ea-8b12f7249244 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544bf6be4c24454a013ca110c43cef2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4735f453c0c24cc4a1c14e9ac84a0b46', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:55:29.009806 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dd4cc7-ce45-4d1a-97ea-8b12f7249244 service cinder] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:29.010113 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dd4cc7-ce45-4d1a-97ea-8b12f7249244 service cinder] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:29.013074 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dd4cc7-ce45-4d1a-97ea-8b12f7249244 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:29.115260 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e6bf4d-455c-434d-8a54-91b95b7a6a93 service neutron] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:55:29.145089 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84aa871f-3f1d-4eee-8d21-8ae44ea01e92 tempest-VolumeQuotaClassesTest-870281530 tempest-VolumeQuotaClassesTest-870281530-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22b4322dca794f6faeda69128ec358db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '807f63ac6d19461cb60db5e71a33fee8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:55:29.146006 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84aa871f-3f1d-4eee-8d21-8ae44ea01e92 tempest-VolumeQuotaClassesTest-870281530 tempest-VolumeQuotaClassesTest-870281530-project-admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:29.146491 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84aa871f-3f1d-4eee-8d21-8ae44ea01e92 tempest-VolumeQuotaClassesTest-870281530 tempest-VolumeQuotaClassesTest-870281530-project-admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:29.147016 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84aa871f-3f1d-4eee-8d21-8ae44ea01e92 tempest-VolumeQuotaClassesTest-870281530 tempest-VolumeQuotaClassesTest-870281530-project-admin] PATH_INFO: `/v3/domains` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:29.149528 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84aa871f-3f1d-4eee-8d21-8ae44ea01e92 tempest-VolumeQuotaClassesTest-870281530 tempest-VolumeQuotaClassesTest-870281530-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:55:29.151523 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84aa871f-3f1d-4eee-8d21-8ae44ea01e92 tempest-VolumeQuotaClassesTest-870281530 tempest-VolumeQuotaClassesTest-870281530-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:55:29.155206 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84aa871f-3f1d-4eee-8d21-8ae44ea01e92 tempest-VolumeQuotaClassesTest-870281530 tempest-VolumeQuotaClassesTest-870281530-project-admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:55:29.179702 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 890/1780] 10.222.0.57 () {58 vars in 1153 bytes} [Fri Sep 16 07:55:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:55:29.182628 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84aa871f-3f1d-4eee-8d21-8ae44ea01e92 tempest-VolumeQuotaClassesTest-870281530 tempest-VolumeQuotaClassesTest-870281530-project-admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:55:29.206504 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84aa871f-3f1d-4eee-8d21-8ae44ea01e92 tempest-VolumeQuotaClassesTest-870281530 tempest-VolumeQuotaClassesTest-870281530-project-admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:55:29.223186 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88dd4cc7-ce45-4d1a-97ea-8b12f7249244 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:55:29.228809 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88dd4cc7-ce45-4d1a-97ea-8b12f7249244 service cinder] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:55:29.229034 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc34e8a9-5cef-449c-a17e-3ea13f6019a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:55:29.231066 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc34e8a9-5cef-449c-a17e-3ea13f6019a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:29.234944 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc34e8a9-5cef-449c-a17e-3ea13f6019a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:29.238117 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc34e8a9-5cef-449c-a17e-3ea13f6019a5 admin admin] PATH_INFO: `/v3/projects/ba78359a0aff4be59da152976a6bb0e0/users/9cbcc90866de4a1da7eafdaa2c41c2a6/roles/4818d38cf2564825b312e66c9eb24762` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:29.262618 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 891/1781] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Sep 16 07:55:28 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 512 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 07:55:29.263614 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88dd4cc7-ce45-4d1a-97ea-8b12f7249244 service cinder] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:55:29.276775 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc34e8a9-5cef-449c-a17e-3ea13f6019a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba78359a0aff4be59da152976a6bb0e0, user_id=9cbcc90866de4a1da7eafdaa2c41c2a6, role_id=4818d38cf2564825b312e66c9eb24762)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:55:29.281200 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc34e8a9-5cef-449c-a17e-3ea13f6019a5 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:55:29.293541 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88dd4cc7-ce45-4d1a-97ea-8b12f7249244 service cinder] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:55:29.323658 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 891/1782] 10.222.0.57 () {60 vars in 1483 bytes} [Fri Sep 16 07:55:29 2022] PUT /identity/v3/projects/ba78359a0aff4be59da152976a6bb0e0/users/9cbcc90866de4a1da7eafdaa2c41c2a6/roles/4818d38cf2564825b312e66c9eb24762 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 07:55:29.327854 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc34e8a9-5cef-449c-a17e-3ea13f6019a5 admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:55:29.430234 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d22169a-1eb5-4525-8e9e-7b5bf367ee7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:55:29.430981 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d22169a-1eb5-4525-8e9e-7b5bf367ee7b admin admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:29.431331 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d22169a-1eb5-4525-8e9e-7b5bf367ee7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:29.431680 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d22169a-1eb5-4525-8e9e-7b5bf367ee7b admin admin] PATH_INFO: `/v3/roles` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:29.432405 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d22169a-1eb5-4525-8e9e-7b5bf367ee7b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:55:29.434166 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d22169a-1eb5-4525-8e9e-7b5bf367ee7b admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:55:29.479567 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 892/1783] 10.222.0.57 () {58 vars in 1122 bytes} [Fri Sep 16 07:55:29 2022] GET /identity/v3/roles => generated 1420 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 07:55:29.481082 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06deb649-5300-4004-9dcb-9b33cbda6997 None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:29.481375 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06deb649-5300-4004-9dcb-9b33cbda6997 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:29.481647 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06deb649-5300-4004-9dcb-9b33cbda6997 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:29.514341 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-06deb649-5300-4004-9dcb-9b33cbda6997 None None] MFA Rules not processed for user `9cbcc90866de4a1da7eafdaa2c41c2a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:55:29.516459 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-06deb649-5300-4004-9dcb-9b33cbda6997 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:55:29.547486 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc34e8a9-5cef-449c-a17e-3ea13f6019a5 admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:55:29.562635 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a799f8-d133-4272-ac7b-f8dfb57b2c93 tempest-VolumeQuotaClassesTest-870281530 tempest-VolumeQuotaClassesTest-870281530-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22b4322dca794f6faeda69128ec358db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '807f63ac6d19461cb60db5e71a33fee8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:55:29.563541 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a799f8-d133-4272-ac7b-f8dfb57b2c93 tempest-VolumeQuotaClassesTest-870281530 tempest-VolumeQuotaClassesTest-870281530-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:29.563878 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a799f8-d133-4272-ac7b-f8dfb57b2c93 tempest-VolumeQuotaClassesTest-870281530 tempest-VolumeQuotaClassesTest-870281530-project-admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:29.564222 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a799f8-d133-4272-ac7b-f8dfb57b2c93 tempest-VolumeQuotaClassesTest-870281530 tempest-VolumeQuotaClassesTest-870281530-project-admin] PATH_INFO: `/v3/projects/3f9e151a145341e392248fed70e9c1db` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:29.568635 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a799f8-d133-4272-ac7b-f8dfb57b2c93 tempest-VolumeQuotaClassesTest-870281530 tempest-VolumeQuotaClassesTest-870281530-project-admin] RBAC: Authorizing `identity:delete_project(project_id=3f9e151a145341e392248fed70e9c1db)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:55:29.570772 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a799f8-d133-4272-ac7b-f8dfb57b2c93 tempest-VolumeQuotaClassesTest-870281530 tempest-VolumeQuotaClassesTest-870281530-project-admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:55:29.679573 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 893/1784] 10.222.0.57 () {58 vars in 958 bytes} [Fri Sep 16 07:55:29 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 07:55:29.679573 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06deb649-5300-4004-9dcb-9b33cbda6997 None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:55:29.700169 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:55:29.751122 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-07a799f8-d133-4272-ac7b-f8dfb57b2c93 tempest-VolumeQuotaClassesTest-870281530 tempest-VolumeQuotaClassesTest-870281530-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3f9e151a145341e392248fed70e9c1db', 'request_id': 'req-07a799f8-d133-4272-ac7b-f8dfb57b2c93'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:55:29.772061 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-07a799f8-d133-4272-ac7b-f8dfb57b2c93 tempest-VolumeQuotaClassesTest-870281530 tempest-VolumeQuotaClassesTest-870281530-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3f9e151a145341e392248fed70e9c1db', 'request_id': 'req-07a799f8-d133-4272-ac7b-f8dfb57b2c93'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:55:29.800240 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-07a799f8-d133-4272-ac7b-f8dfb57b2c93 tempest-VolumeQuotaClassesTest-870281530 tempest-VolumeQuotaClassesTest-870281530-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3f9e151a145341e392248fed70e9c1db', 'request_id': 'req-07a799f8-d133-4272-ac7b-f8dfb57b2c93'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:55:29.807050 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06deb649-5300-4004-9dcb-9b33cbda6997 None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:55:29.832676 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-07a799f8-d133-4272-ac7b-f8dfb57b2c93 tempest-VolumeQuotaClassesTest-870281530 tempest-VolumeQuotaClassesTest-870281530-project-admin] The token cache is being invalidate because project 3f9e151a145341e392248fed70e9c1db was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81431) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 07:55:29.832982 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-07a799f8-d133-4272-ac7b-f8dfb57b2c93 tempest-VolumeQuotaClassesTest-870281530 tempest-VolumeQuotaClassesTest-870281530-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:55:29.841505 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-07a799f8-d133-4272-ac7b-f8dfb57b2c93 tempest-VolumeQuotaClassesTest-870281530 tempest-VolumeQuotaClassesTest-870281530-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:55:29.845054 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 892/1785] 10.222.0.57 () {58 vars in 1233 bytes} [Fri Sep 16 07:55:29 2022] DELETE /identity/v3/projects/3f9e151a145341e392248fed70e9c1db => generated 0 bytes in 518 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 07:55:29.845853 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a799f8-d133-4272-ac7b-f8dfb57b2c93 tempest-VolumeQuotaClassesTest-870281530 tempest-VolumeQuotaClassesTest-870281530-project-admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:55:29.850518 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-07a799f8-d133-4272-ac7b-f8dfb57b2c93 tempest-VolumeQuotaClassesTest-870281530 tempest-VolumeQuotaClassesTest-870281530-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:55:29.891043 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:55:29.919251 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2683c9-b1a5-4424-a684-6b1de56c6376 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544bf6be4c24454a013ca110c43cef2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4735f453c0c24cc4a1c14e9ac84a0b46', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:55:29.921942 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2683c9-b1a5-4424-a684-6b1de56c6376 service cinder] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:29.922243 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2683c9-b1a5-4424-a684-6b1de56c6376 service cinder] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:29.922520 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2683c9-b1a5-4424-a684-6b1de56c6376 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:29.932886 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-1b2683c9-b1a5-4424-a684-6b1de56c6376 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:55:30.070597 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a799f8-d133-4272-ac7b-f8dfb57b2c93 tempest-VolumeQuotaClassesTest-870281530 tempest-VolumeQuotaClassesTest-870281530-project-admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:55:30.074843 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2683c9-b1a5-4424-a684-6b1de56c6376 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:55:30.079687 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2683c9-b1a5-4424-a684-6b1de56c6376 service cinder] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:55:30.085553 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24528c25-c01e-4598-b3eb-19fcf54e9a21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:55:30.086619 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24528c25-c01e-4598-b3eb-19fcf54e9a21 admin admin] REQUEST_METHOD: `PUT` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:30.087514 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24528c25-c01e-4598-b3eb-19fcf54e9a21 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:30.087804 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24528c25-c01e-4598-b3eb-19fcf54e9a21 admin admin] PATH_INFO: `/v3/projects/b5770190b9a94317bbfc71518d6d2db5/users/c3947510fc3d4c11a007cbf572844c6b/roles/4818d38cf2564825b312e66c9eb24762` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:30.093938 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 894/1786] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Sep 16 07:55:29 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 07:55:30.095298 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2683c9-b1a5-4424-a684-6b1de56c6376 service cinder] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:55:30.098007 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-1b2683c9-b1a5-4424-a684-6b1de56c6376 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:55:30.120016 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24528c25-c01e-4598-b3eb-19fcf54e9a21 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b5770190b9a94317bbfc71518d6d2db5, user_id=c3947510fc3d4c11a007cbf572844c6b, role_id=4818d38cf2564825b312e66c9eb24762)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:55:30.125232 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24528c25-c01e-4598-b3eb-19fcf54e9a21 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:55:30.125641 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2683c9-b1a5-4424-a684-6b1de56c6376 service cinder] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:55:30.139610 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f2dae2-43bb-4b31-bbf3-4edfcb08be1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:55:30.140124 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f2dae2-43bb-4b31-bbf3-4edfcb08be1e admin admin] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:30.140398 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f2dae2-43bb-4b31-bbf3-4edfcb08be1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:30.140673 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f2dae2-43bb-4b31-bbf3-4edfcb08be1e admin admin] PATH_INFO: `/v3/projects` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:30.141318 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f2dae2-43bb-4b31-bbf3-4edfcb08be1e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:55:30.143781 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f2dae2-43bb-4b31-bbf3-4edfcb08be1e admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:55:30.148752 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 893/1787] 10.222.0.57 () {60 vars in 1483 bytes} [Fri Sep 16 07:55:29 2022] PUT /identity/v3/projects/b5770190b9a94317bbfc71518d6d2db5/users/c3947510fc3d4c11a007cbf572844c6b/roles/4818d38cf2564825b312e66c9eb24762 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 07:55:30.168586 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c54d139-de1c-410c-bf44-891d88a942a7 None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:30.168907 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c54d139-de1c-410c-bf44-891d88a942a7 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:30.182818 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c54d139-de1c-410c-bf44-891d88a942a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:30.243323 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 895/1788] 10.222.0.57 () {60 vars in 1153 bytes} [Fri Sep 16 07:55:30 2022] POST /identity/v3/projects => generated 375 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 07:55:30.244642 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f2dae2-43bb-4b31-bbf3-4edfcb08be1e admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:55:30.250034 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-5c54d139-de1c-410c-bf44-891d88a942a7 None None] MFA Rules not processed for user `c3947510fc3d4c11a007cbf572844c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:55:30.253428 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-5c54d139-de1c-410c-bf44-891d88a942a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:55:30.401089 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f2dae2-43bb-4b31-bbf3-4edfcb08be1e admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:55:30.408466 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 894/1789] 10.222.0.57 () {58 vars in 958 bytes} [Fri Sep 16 07:55:30 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 07:55:30.408466 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c54d139-de1c-410c-bf44-891d88a942a7 None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:55:30.408777 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a00554-9318-4c01-bdb0-f571886c4160 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:55:30.409427 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-5c54d139-de1c-410c-bf44-891d88a942a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:55:30.409508 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a00554-9318-4c01-bdb0-f571886c4160 admin admin] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:30.409508 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a00554-9318-4c01-bdb0-f571886c4160 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:30.409508 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a00554-9318-4c01-bdb0-f571886c4160 admin admin] PATH_INFO: `/v3/users` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:30.410579 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a00554-9318-4c01-bdb0-f571886c4160 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:55:30.413691 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a00554-9318-4c01-bdb0-f571886c4160 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:55:30.450921 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c54d139-de1c-410c-bf44-891d88a942a7 None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:55:30.451640 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:55:30.458086 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a011772f-5157-4896-a7fb-7e46fe74d2ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:55:30.459060 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a011772f-5157-4896-a7fb-7e46fe74d2ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:30.459472 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a011772f-5157-4896-a7fb-7e46fe74d2ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:30.460272 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a011772f-5157-4896-a7fb-7e46fe74d2ea admin admin] PATH_INFO: `/v3/users/5f9a1ff4c32040cf9dce821c0a7404fd` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:30.461805 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a011772f-5157-4896-a7fb-7e46fe74d2ea admin admin] RBAC: Authorizing `identity:delete_user(user_id=5f9a1ff4c32040cf9dce821c0a7404fd)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:55:30.464895 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a011772f-5157-4896-a7fb-7e46fe74d2ea admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:55:30.509457 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 896/1790] 10.222.0.57 () {60 vars in 1144 bytes} [Fri Sep 16 07:55:30 2022] POST /identity/v3/users => generated 294 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 07:55:30.510108 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a00554-9318-4c01-bdb0-f571886c4160 admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:55:30.544118 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a00554-9318-4c01-bdb0-f571886c4160 admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:55:30.566627 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addcf5f2-d04f-4dc5-bdd7-2f872d5ee6b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:55:30.567327 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addcf5f2-d04f-4dc5-bdd7-2f872d5ee6b0 admin admin] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:30.567637 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addcf5f2-d04f-4dc5-bdd7-2f872d5ee6b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:30.567942 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addcf5f2-d04f-4dc5-bdd7-2f872d5ee6b0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:30.574927 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addcf5f2-d04f-4dc5-bdd7-2f872d5ee6b0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:55:30.576978 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addcf5f2-d04f-4dc5-bdd7-2f872d5ee6b0 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:55:30.623276 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-a011772f-5157-4896-a7fb-7e46fe74d2ea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5f9a1ff4c32040cf9dce821c0a7404fd'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:55:30.664020 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 897/1791] 10.222.0.57 () {60 vars in 1153 bytes} [Fri Sep 16 07:55:30 2022] POST /identity/v3/projects => generated 363 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 07:55:30.665044 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addcf5f2-d04f-4dc5-bdd7-2f872d5ee6b0 admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:55:30.668231 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-a011772f-5157-4896-a7fb-7e46fe74d2ea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5f9a1ff4c32040cf9dce821c0a7404fd'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:55:30.669177 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-a011772f-5157-4896-a7fb-7e46fe74d2ea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5f9a1ff4c32040cf9dce821c0a7404fd'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:55:30.681510 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-a011772f-5157-4896-a7fb-7e46fe74d2ea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5f9a1ff4c32040cf9dce821c0a7404fd'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:55:30.689832 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:55:30.693404 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-a011772f-5157-4896-a7fb-7e46fe74d2ea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5f9a1ff4c32040cf9dce821c0a7404fd'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:55:30.706118 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 895/1792] 10.222.0.57 () {58 vars in 1224 bytes} [Fri Sep 16 07:55:30 2022] DELETE /identity/v3/users/5f9a1ff4c32040cf9dce821c0a7404fd => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 07:55:30.708815 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a42fc91-043a-48ca-83f7-cc1ab2d03cbf None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:30.709353 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a42fc91-043a-48ca-83f7-cc1ab2d03cbf None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:30.710249 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a42fc91-043a-48ca-83f7-cc1ab2d03cbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:30.767191 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addcf5f2-d04f-4dc5-bdd7-2f872d5ee6b0 admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:55:30.783563 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-0a42fc91-043a-48ca-83f7-cc1ab2d03cbf None None] MFA Rules not processed for user `56eb9bbabb65436bb095952159df184c`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:55:30.785683 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-0a42fc91-043a-48ca-83f7-cc1ab2d03cbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:55:30.840735 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9d7b29-3282-4aed-b4d7-4536ad6404c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:55:30.841354 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9d7b29-3282-4aed-b4d7-4536ad6404c3 admin admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:30.841642 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9d7b29-3282-4aed-b4d7-4536ad6404c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:30.841940 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9d7b29-3282-4aed-b4d7-4536ad6404c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:30.842601 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9d7b29-3282-4aed-b4d7-4536ad6404c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:55:30.844198 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9d7b29-3282-4aed-b4d7-4536ad6404c3 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:55:30.855405 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 898/1793] 10.222.0.57 () {58 vars in 1122 bytes} [Fri Sep 16 07:55:30 2022] GET /identity/v3/roles => generated 1420 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 07:55:30.856355 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9d7b29-3282-4aed-b4d7-4536ad6404c3 admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:55:30.859903 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-2f9d7b29-3282-4aed-b4d7-4536ad6404c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:55:30.865309 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 896/1794] 10.222.0.57 () {58 vars in 1009 bytes} [Fri Sep 16 07:55:30 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 07:55:30.866985 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73e8bda-c8d5-469f-b34e-ab2adb191e55 None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:30.867523 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73e8bda-c8d5-469f-b34e-ab2adb191e55 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:30.868039 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73e8bda-c8d5-469f-b34e-ab2adb191e55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:30.874687 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9d7b29-3282-4aed-b4d7-4536ad6404c3 admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:55:30.880767 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d44710-1c6f-4852-9c0b-6126fc88e20f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:55:30.881381 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d44710-1c6f-4852-9c0b-6126fc88e20f admin admin] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:30.882772 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d44710-1c6f-4852-9c0b-6126fc88e20f admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:30.883068 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d44710-1c6f-4852-9c0b-6126fc88e20f admin admin] PATH_INFO: `/v3/users` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:30.883721 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d44710-1c6f-4852-9c0b-6126fc88e20f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:55:30.887340 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d44710-1c6f-4852-9c0b-6126fc88e20f admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:55:30.920694 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 899/1795] 10.222.0.57 () {60 vars in 1144 bytes} [Fri Sep 16 07:55:30 2022] POST /identity/v3/users => generated 288 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 07:55:30.921567 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d44710-1c6f-4852-9c0b-6126fc88e20f admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:55:30.925894 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-e73e8bda-c8d5-469f-b34e-ab2adb191e55 None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:55:30.927598 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-73d44710-1c6f-4852-9c0b-6126fc88e20f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:55:30.932219 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-e73e8bda-c8d5-469f-b34e-ab2adb191e55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:55:30.946799 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d44710-1c6f-4852-9c0b-6126fc88e20f admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:55:30.951636 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 897/1796] 10.222.0.57 () {58 vars in 958 bytes} [Fri Sep 16 07:55:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 07:55:30.952904 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73e8bda-c8d5-469f-b34e-ab2adb191e55 None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:55:30.965483 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73e8bda-c8d5-469f-b34e-ab2adb191e55 None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:55:30.972896 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65dbd72-b4a8-4701-b5f2-952d07d683b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:55:30.974182 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65dbd72-b4a8-4701-b5f2-952d07d683b8 admin admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:30.974303 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449c61ae-a651-4a97-aadf-f0b22d1b6495 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:55:30.974960 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449c61ae-a651-4a97-aadf-f0b22d1b6495 admin admin] REQUEST_METHOD: `PUT` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:30.975170 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65dbd72-b4a8-4701-b5f2-952d07d683b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:30.975274 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449c61ae-a651-4a97-aadf-f0b22d1b6495 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:30.975716 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449c61ae-a651-4a97-aadf-f0b22d1b6495 admin admin] PATH_INFO: `/v3/projects/e213128b05864ee8b2358ecb4c9677f7/users/0f640bf716a04900a4590d84581da2fc/roles/567db03c91854ad9af1e9a87ec1bd275` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:30.976466 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65dbd72-b4a8-4701-b5f2-952d07d683b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:30.978422 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65dbd72-b4a8-4701-b5f2-952d07d683b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:55:30.991421 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65dbd72-b4a8-4701-b5f2-952d07d683b8 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:55:31.010815 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 898/1797] 10.222.0.57 () {58 vars in 1122 bytes} [Fri Sep 16 07:55:30 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 07:55:31.012004 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65dbd72-b4a8-4701-b5f2-952d07d683b8 admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:55:31.014017 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-f65dbd72-b4a8-4701-b5f2-952d07d683b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:55:31.039899 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449c61ae-a651-4a97-aadf-f0b22d1b6495 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e213128b05864ee8b2358ecb4c9677f7, user_id=0f640bf716a04900a4590d84581da2fc, role_id=567db03c91854ad9af1e9a87ec1bd275)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:55:31.043644 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449c61ae-a651-4a97-aadf-f0b22d1b6495 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:55:31.080992 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 900/1798] 10.222.0.57 () {60 vars in 1483 bytes} [Fri Sep 16 07:55:30 2022] PUT /identity/v3/projects/e213128b05864ee8b2358ecb4c9677f7/users/0f640bf716a04900a4590d84581da2fc/roles/567db03c91854ad9af1e9a87ec1bd275 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 07:55:31.083423 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449c61ae-a651-4a97-aadf-f0b22d1b6495 admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:55:31.151654 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65dbd72-b4a8-4701-b5f2-952d07d683b8 admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:55:31.160216 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:INSERT=8,keystone:SELECT=92 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:55:31.225651 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449c61ae-a651-4a97-aadf-f0b22d1b6495 admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:55:31.233348 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf566e36-f5fa-47e7-a435-835a010b3950 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:55:31.234320 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf566e36-f5fa-47e7-a435-835a010b3950 admin admin] REQUEST_METHOD: `PUT` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:31.234812 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf566e36-f5fa-47e7-a435-835a010b3950 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:31.235257 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf566e36-f5fa-47e7-a435-835a010b3950 admin admin] PATH_INFO: `/v3/projects/ee8a6b0583074c7884b0ef624f7c5654/users/bc8d8a66ec794bc0bebb4021aedce4b7/roles/567db03c91854ad9af1e9a87ec1bd275` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:31.267400 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf566e36-f5fa-47e7-a435-835a010b3950 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee8a6b0583074c7884b0ef624f7c5654, user_id=bc8d8a66ec794bc0bebb4021aedce4b7, role_id=567db03c91854ad9af1e9a87ec1bd275)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:55:31.274532 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf566e36-f5fa-47e7-a435-835a010b3950 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:55:31.295919 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f10d33e-1bfe-405f-b745-2dbb1c572342 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1062e457207a41e4ba4f0a0c4bf36f1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4735f453c0c24cc4a1c14e9ac84a0b46', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:55:31.298131 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f10d33e-1bfe-405f-b745-2dbb1c572342 service neutron] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:31.299334 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f10d33e-1bfe-405f-b745-2dbb1c572342 service neutron] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:31.301616 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f10d33e-1bfe-405f-b745-2dbb1c572342 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:31.303697 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 901/1799] 10.222.0.57 () {60 vars in 1483 bytes} [Fri Sep 16 07:55:31 2022] PUT /identity/v3/projects/ee8a6b0583074c7884b0ef624f7c5654/users/bc8d8a66ec794bc0bebb4021aedce4b7/roles/567db03c91854ad9af1e9a87ec1bd275 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 07:55:31.304655 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf566e36-f5fa-47e7-a435-835a010b3950 admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:55:31.318750 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f10d33e-1bfe-405f-b745-2dbb1c572342 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:55:31.329294 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f10d33e-1bfe-405f-b745-2dbb1c572342 service neutron] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:55:31.348650 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 899/1800] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Sep 16 07:55:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 07:55:31.349696 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f10d33e-1bfe-405f-b745-2dbb1c572342 service neutron] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:55:31.351408 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-3f10d33e-1bfe-405f-b745-2dbb1c572342 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:55:31.369076 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:55:31.457803 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf566e36-f5fa-47e7-a435-835a010b3950 admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:55:31.469444 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5d4e7f-b983-4c5e-8a66-0872fed6eafd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:55:31.470250 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5d4e7f-b983-4c5e-8a66-0872fed6eafd admin admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:31.470539 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5d4e7f-b983-4c5e-8a66-0872fed6eafd admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:31.470820 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5d4e7f-b983-4c5e-8a66-0872fed6eafd admin admin] PATH_INFO: `/v3/roles` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:31.471541 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5d4e7f-b983-4c5e-8a66-0872fed6eafd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:55:31.473301 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5d4e7f-b983-4c5e-8a66-0872fed6eafd admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:55:31.510478 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 902/1801] 10.222.0.57 () {58 vars in 1122 bytes} [Fri Sep 16 07:55:31 2022] GET /identity/v3/roles => generated 1420 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 07:55:31.511621 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5d4e7f-b983-4c5e-8a66-0872fed6eafd admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:55:31.538666 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5d4e7f-b983-4c5e-8a66-0872fed6eafd admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:55:31.539492 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f10d33e-1bfe-405f-b745-2dbb1c572342 service neutron] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:55:31.548817 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b99049-e121-4316-80b7-eadef758d56f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:55:31.550235 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b99049-e121-4316-80b7-eadef758d56f admin admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:31.550795 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b99049-e121-4316-80b7-eadef758d56f admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:31.551244 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b99049-e121-4316-80b7-eadef758d56f admin admin] PATH_INFO: `/v3/roles` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:31.551552 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b99049-e121-4316-80b7-eadef758d56f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:55:31.557794 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b99049-e121-4316-80b7-eadef758d56f admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:55:31.582495 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 903/1802] 10.222.0.57 () {58 vars in 1122 bytes} [Fri Sep 16 07:55:31 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 07:55:31.583357 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b99049-e121-4316-80b7-eadef758d56f admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:55:31.610464 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b99049-e121-4316-80b7-eadef758d56f admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:55:31.623146 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22adcc86-9dd7-4404-ae85-230180b80dd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:55:31.623761 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22adcc86-9dd7-4404-ae85-230180b80dd3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:31.624043 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22adcc86-9dd7-4404-ae85-230180b80dd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:31.624411 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22adcc86-9dd7-4404-ae85-230180b80dd3 admin admin] PATH_INFO: `/v3/projects/e213128b05864ee8b2358ecb4c9677f7/users/0f640bf716a04900a4590d84581da2fc/roles/567db03c91854ad9af1e9a87ec1bd275` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:31.627657 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22adcc86-9dd7-4404-ae85-230180b80dd3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e213128b05864ee8b2358ecb4c9677f7, user_id=0f640bf716a04900a4590d84581da2fc, role_id=567db03c91854ad9af1e9a87ec1bd275)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:55:31.631999 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22adcc86-9dd7-4404-ae85-230180b80dd3 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:55:31.648117 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 904/1803] 10.222.0.57 () {60 vars in 1483 bytes} [Fri Sep 16 07:55:31 2022] PUT /identity/v3/projects/e213128b05864ee8b2358ecb4c9677f7/users/0f640bf716a04900a4590d84581da2fc/roles/567db03c91854ad9af1e9a87ec1bd275 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 07:55:31.653425 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2b1433-3aa2-4579-8edc-60d9810a5800 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38abb0283b41449d8183b88912f2574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4735f453c0c24cc4a1c14e9ac84a0b46', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:55:31.654299 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2b1433-3aa2-4579-8edc-60d9810a5800 service swift] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:31.654722 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2b1433-3aa2-4579-8edc-60d9810a5800 service swift] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:31.655129 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2b1433-3aa2-4579-8edc-60d9810a5800 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:31.663083 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22adcc86-9dd7-4404-ae85-230180b80dd3 admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:55:31.814777 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2b1433-3aa2-4579-8edc-60d9810a5800 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:55:31.819756 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2b1433-3aa2-4579-8edc-60d9810a5800 service swift] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:55:31.851367 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 900/1804] 10.222.0.57 () {60 vars in 1384 bytes} [Fri Sep 16 07:55:31 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 502 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 16 07:55:31.852859 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a21712b-7951-48b8-9554-9a6462e30ee4 None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:31.853145 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a21712b-7951-48b8-9554-9a6462e30ee4 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:31.853417 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a21712b-7951-48b8-9554-9a6462e30ee4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:31.897650 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22adcc86-9dd7-4404-ae85-230180b80dd3 admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:55:31.934608 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e627b963-43c9-48b1-b30f-491ab01a09bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:55:31.936533 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e627b963-43c9-48b1-b30f-491ab01a09bf admin admin] REQUEST_METHOD: `PUT` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:31.936851 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e627b963-43c9-48b1-b30f-491ab01a09bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:31.939725 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e627b963-43c9-48b1-b30f-491ab01a09bf admin admin] PATH_INFO: `/v3/projects/ee8a6b0583074c7884b0ef624f7c5654/users/bc8d8a66ec794bc0bebb4021aedce4b7/roles/567db03c91854ad9af1e9a87ec1bd275` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:31.950870 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e627b963-43c9-48b1-b30f-491ab01a09bf admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee8a6b0583074c7884b0ef624f7c5654, user_id=bc8d8a66ec794bc0bebb4021aedce4b7, role_id=567db03c91854ad9af1e9a87ec1bd275)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:55:31.964796 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e627b963-43c9-48b1-b30f-491ab01a09bf admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:55:32.006356 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 905/1805] 10.222.0.57 () {60 vars in 1483 bytes} [Fri Sep 16 07:55:31 2022] PUT /identity/v3/projects/ee8a6b0583074c7884b0ef624f7c5654/users/bc8d8a66ec794bc0bebb4021aedce4b7/roles/567db03c91854ad9af1e9a87ec1bd275 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 07:55:32.010143 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75189b18-403c-49d2-bb4d-ca1683398433 None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:32.010438 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75189b18-403c-49d2-bb4d-ca1683398433 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:32.010722 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75189b18-403c-49d2-bb4d-ca1683398433 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:32.013158 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-3a21712b-7951-48b8-9554-9a6462e30ee4 None None] MFA Rules not processed for user `0f640bf716a04900a4590d84581da2fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:55:32.014473 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-3a21712b-7951-48b8-9554-9a6462e30ee4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:55:32.098500 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:55:32.126039 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-75189b18-403c-49d2-bb4d-ca1683398433 None None] MFA Rules not processed for user `1c7a0339a9644455940a4975dce12a6a`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:55:32.127967 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-75189b18-403c-49d2-bb4d-ca1683398433 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:55:32.138651 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:55:32.256150 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 901/1806] 10.222.0.57 () {58 vars in 958 bytes} [Fri Sep 16 07:55:31 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 404 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 07:55:32.257457 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda489d3-6824-46c3-8b1e-7623bfd3313d None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:32.257747 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda489d3-6824-46c3-8b1e-7623bfd3313d None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:32.258022 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda489d3-6824-46c3-8b1e-7623bfd3313d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:32.321259 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 906/1807] 10.222.0.57 () {58 vars in 958 bytes} [Fri Sep 16 07:55:32 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 313 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 07:55:32.321849 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-bda489d3-6824-46c3-8b1e-7623bfd3313d None None] MFA Rules not processed for user `bc8d8a66ec794bc0bebb4021aedce4b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:55:32.322532 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75189b18-403c-49d2-bb4d-ca1683398433 None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:55:32.323643 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-bda489d3-6824-46c3-8b1e-7623bfd3313d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:55:32.324338 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-75189b18-403c-49d2-bb4d-ca1683398433 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:55:32.512733 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75189b18-403c-49d2-bb4d-ca1683398433 None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:55:32.522944 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030d081e-1b8f-47c8-9d75-bb02522f526d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544bf6be4c24454a013ca110c43cef2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4735f453c0c24cc4a1c14e9ac84a0b46', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:55:32.523590 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030d081e-1b8f-47c8-9d75-bb02522f526d service cinder] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:32.523880 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030d081e-1b8f-47c8-9d75-bb02522f526d service cinder] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:32.524154 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030d081e-1b8f-47c8-9d75-bb02522f526d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:32.531194 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-030d081e-1b8f-47c8-9d75-bb02522f526d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:55:32.652844 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 902/1808] 10.222.0.57 () {58 vars in 958 bytes} [Fri Sep 16 07:55:32 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 396 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 07:55:32.654858 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda489d3-6824-46c3-8b1e-7623bfd3313d None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:55:32.665170 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-bda489d3-6824-46c3-8b1e-7623bfd3313d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:55:32.791627 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030d081e-1b8f-47c8-9d75-bb02522f526d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:55:32.803161 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030d081e-1b8f-47c8-9d75-bb02522f526d service cinder] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:55:32.864078 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 907/1809] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Sep 16 07:55:32 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 539 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 07:55:32.868969 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030d081e-1b8f-47c8-9d75-bb02522f526d service cinder] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:55:32.872948 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-030d081e-1b8f-47c8-9d75-bb02522f526d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:55:32.913188 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda489d3-6824-46c3-8b1e-7623bfd3313d None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:55:32.920814 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18724a8-23b1-44eb-86f5-5d87044e8543 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:55:32.922031 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18724a8-23b1-44eb-86f5-5d87044e8543 admin admin] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:32.922636 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18724a8-23b1-44eb-86f5-5d87044e8543 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:32.923125 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18724a8-23b1-44eb-86f5-5d87044e8543 admin admin] PATH_INFO: `/v3/projects` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:32.925787 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18724a8-23b1-44eb-86f5-5d87044e8543 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:55:32.927778 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030d081e-1b8f-47c8-9d75-bb02522f526d service cinder] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:55:32.928325 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18724a8-23b1-44eb-86f5-5d87044e8543 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:55:32.952005 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b293788-8137-4cba-8e86-97cc38fb7a9b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544bf6be4c24454a013ca110c43cef2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4735f453c0c24cc4a1c14e9ac84a0b46', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:55:32.952656 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b293788-8137-4cba-8e86-97cc38fb7a9b service cinder] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:32.952929 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b293788-8137-4cba-8e86-97cc38fb7a9b service cinder] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:32.953215 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b293788-8137-4cba-8e86-97cc38fb7a9b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:32.992460 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b293788-8137-4cba-8e86-97cc38fb7a9b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:55:32.994354 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b293788-8137-4cba-8e86-97cc38fb7a9b service cinder] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:55:33.009958 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 903/1810] 10.222.0.57 () {60 vars in 1153 bytes} [Fri Sep 16 07:55:32 2022] POST /identity/v3/projects => generated 373 bytes in 356 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 07:55:33.010904 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18724a8-23b1-44eb-86f5-5d87044e8543 admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:55:33.023624 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 908/1811] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Sep 16 07:55:32 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 07:55:33.134514 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:55:33.222912 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b293788-8137-4cba-8e86-97cc38fb7a9b service cinder] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:55:33.241009 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b293788-8137-4cba-8e86-97cc38fb7a9b service cinder] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:55:33.260845 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18724a8-23b1-44eb-86f5-5d87044e8543 admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:55:33.287498 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c33f4a2-0fbf-4643-96cf-c52f73294132 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:55:33.291172 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c33f4a2-0fbf-4643-96cf-c52f73294132 admin admin] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:33.291813 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c33f4a2-0fbf-4643-96cf-c52f73294132 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:33.293687 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c33f4a2-0fbf-4643-96cf-c52f73294132 admin admin] PATH_INFO: `/v3/users` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:33.296590 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c33f4a2-0fbf-4643-96cf-c52f73294132 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:55:33.302869 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c33f4a2-0fbf-4643-96cf-c52f73294132 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:55:33.385028 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 904/1812] 10.222.0.57 () {60 vars in 1144 bytes} [Fri Sep 16 07:55:33 2022] POST /identity/v3/users => generated 293 bytes in 374 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 07:55:33.389919 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c33f4a2-0fbf-4643-96cf-c52f73294132 admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:55:33.412756 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:55:33.431344 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c33f4a2-0fbf-4643-96cf-c52f73294132 admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:55:33.432124 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a91f4a0-2246-4521-8965-2da1366c0122 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544bf6be4c24454a013ca110c43cef2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4735f453c0c24cc4a1c14e9ac84a0b46', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:55:33.432854 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a91f4a0-2246-4521-8965-2da1366c0122 service cinder] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:33.433214 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a91f4a0-2246-4521-8965-2da1366c0122 service cinder] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:33.433595 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a91f4a0-2246-4521-8965-2da1366c0122 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:33.435959 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-0a91f4a0-2246-4521-8965-2da1366c0122 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:55:33.439699 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd5547c-dfe1-45cf-a72f-bcb79881ed8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:55:33.442052 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd5547c-dfe1-45cf-a72f-bcb79881ed8e admin admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:33.442340 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd5547c-dfe1-45cf-a72f-bcb79881ed8e admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:33.442679 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd5547c-dfe1-45cf-a72f-bcb79881ed8e admin admin] PATH_INFO: `/v3/roles` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:33.444624 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd5547c-dfe1-45cf-a72f-bcb79881ed8e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:55:33.448427 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd5547c-dfe1-45cf-a72f-bcb79881ed8e admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:55:33.466588 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 905/1813] 10.222.0.57 () {58 vars in 1122 bytes} [Fri Sep 16 07:55:33 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 07:55:33.467784 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd5547c-dfe1-45cf-a72f-bcb79881ed8e admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:55:33.480895 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd5547c-dfe1-45cf-a72f-bcb79881ed8e admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:55:33.491242 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289d0203-a35b-4709-8d45-264c4ff9122c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:55:33.493350 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289d0203-a35b-4709-8d45-264c4ff9122c admin admin] REQUEST_METHOD: `PUT` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:33.494126 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289d0203-a35b-4709-8d45-264c4ff9122c admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:33.494677 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289d0203-a35b-4709-8d45-264c4ff9122c admin admin] PATH_INFO: `/v3/projects/9edac413df104f50af6e52d3cae79add/users/f2be0ddc02d34db0b878592f58fff8d9/roles/567db03c91854ad9af1e9a87ec1bd275` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:33.620856 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289d0203-a35b-4709-8d45-264c4ff9122c admin admin] RBAC: Authorizing `identity:create_grant(project_id=9edac413df104f50af6e52d3cae79add, user_id=f2be0ddc02d34db0b878592f58fff8d9, role_id=567db03c91854ad9af1e9a87ec1bd275)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:55:33.637609 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289d0203-a35b-4709-8d45-264c4ff9122c admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:55:33.639315 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a91f4a0-2246-4521-8965-2da1366c0122 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:55:33.641017 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a91f4a0-2246-4521-8965-2da1366c0122 service cinder] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:55:33.696576 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 909/1814] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Sep 16 07:55:33 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 471 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 16 07:55:33.707553 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25597c9-9ab6-4e7d-ae33-ad43b30ecc3d None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:33.708048 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25597c9-9ab6-4e7d-ae33-ad43b30ecc3d None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:33.708552 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25597c9-9ab6-4e7d-ae33-ad43b30ecc3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:33.717808 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 906/1815] 10.222.0.57 () {60 vars in 1483 bytes} [Fri Sep 16 07:55:33 2022] PUT /identity/v3/projects/9edac413df104f50af6e52d3cae79add/users/f2be0ddc02d34db0b878592f58fff8d9/roles/567db03c91854ad9af1e9a87ec1bd275 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 07:55:33.719435 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289d0203-a35b-4709-8d45-264c4ff9122c admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:55:33.844719 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-d25597c9-9ab6-4e7d-ae33-ad43b30ecc3d None None] MFA Rules not processed for user `1062e457207a41e4ba4f0a0c4bf36f1d`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:55:33.855323 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-d25597c9-9ab6-4e7d-ae33-ad43b30ecc3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:55:34.046423 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289d0203-a35b-4709-8d45-264c4ff9122c admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:55:34.070999 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbefd5b2-c7f4-47a2-911f-38f96613774b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:55:34.071705 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbefd5b2-c7f4-47a2-911f-38f96613774b admin admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:34.072077 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbefd5b2-c7f4-47a2-911f-38f96613774b admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:34.072469 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbefd5b2-c7f4-47a2-911f-38f96613774b admin admin] PATH_INFO: `/v3/roles` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:34.073264 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbefd5b2-c7f4-47a2-911f-38f96613774b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:55:34.075422 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbefd5b2-c7f4-47a2-911f-38f96613774b admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:55:34.078836 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 910/1816] 10.222.0.33 () {58 vars in 1015 bytes} [Fri Sep 16 07:55:33 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 382 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 07:55:34.084664 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25597c9-9ab6-4e7d-ae33-ad43b30ecc3d None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:55:34.094375 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-d25597c9-9ab6-4e7d-ae33-ad43b30ecc3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:55:34.163930 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 907/1817] 10.222.0.57 () {58 vars in 1122 bytes} [Fri Sep 16 07:55:33 2022] GET /identity/v3/roles => generated 1420 bytes in 445 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 07:55:34.164964 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbefd5b2-c7f4-47a2-911f-38f96613774b admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:55:34.178979 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-bbefd5b2-c7f4-47a2-911f-38f96613774b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:55:34.182592 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25597c9-9ab6-4e7d-ae33-ad43b30ecc3d None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:55:34.215009 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f56543-4df0-416b-81b4-219b4f5d441f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:55:34.217529 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f56543-4df0-416b-81b4-219b4f5d441f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:34.218970 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f56543-4df0-416b-81b4-219b4f5d441f admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:34.220016 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f56543-4df0-416b-81b4-219b4f5d441f admin admin] PATH_INFO: `/v3/projects/c45ffe1cdc124fb0a858d09fff2f1018` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:34.239994 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f56543-4df0-416b-81b4-219b4f5d441f admin admin] RBAC: Authorizing `identity:delete_project(project_id=c45ffe1cdc124fb0a858d09fff2f1018)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:55:34.241133 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbefd5b2-c7f4-47a2-911f-38f96613774b admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:55:34.244764 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f56543-4df0-416b-81b4-219b4f5d441f admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:55:34.255267 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b00c65-cf0d-4fcc-9301-645ea5a08b04 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1062e457207a41e4ba4f0a0c4bf36f1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4735f453c0c24cc4a1c14e9ac84a0b46', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:55:34.255912 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b00c65-cf0d-4fcc-9301-645ea5a08b04 service neutron] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:34.263994 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b00c65-cf0d-4fcc-9301-645ea5a08b04 service neutron] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:34.263994 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b00c65-cf0d-4fcc-9301-645ea5a08b04 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:34.304346 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b00c65-cf0d-4fcc-9301-645ea5a08b04 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:55:34.305937 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b00c65-cf0d-4fcc-9301-645ea5a08b04 service neutron] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:55:34.341749 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 908/1818] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Sep 16 07:55:34 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 07:55:34.342750 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b00c65-cf0d-4fcc-9301-645ea5a08b04 service neutron] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:55:34.382801 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-52f56543-4df0-416b-81b4-219b4f5d441f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c45ffe1cdc124fb0a858d09fff2f1018', 'request_id': 'req-52f56543-4df0-416b-81b4-219b4f5d441f'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:55:34.388951 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b00c65-cf0d-4fcc-9301-645ea5a08b04 service neutron] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:55:34.400498 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-52f56543-4df0-416b-81b4-219b4f5d441f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c45ffe1cdc124fb0a858d09fff2f1018', 'request_id': 'req-52f56543-4df0-416b-81b4-219b4f5d441f'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:55:34.423084 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-52f56543-4df0-416b-81b4-219b4f5d441f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c45ffe1cdc124fb0a858d09fff2f1018', 'request_id': 'req-52f56543-4df0-416b-81b4-219b4f5d441f'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:55:34.445986 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-52f56543-4df0-416b-81b4-219b4f5d441f admin admin] The token cache is being invalidate because project c45ffe1cdc124fb0a858d09fff2f1018 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81430) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 07:55:34.446748 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-52f56543-4df0-416b-81b4-219b4f5d441f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:55:34.452205 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-52f56543-4df0-416b-81b4-219b4f5d441f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:55:34.469166 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 911/1819] 10.222.0.57 () {58 vars in 1233 bytes} [Fri Sep 16 07:55:34 2022] DELETE /identity/v3/projects/c45ffe1cdc124fb0a858d09fff2f1018 => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 07:55:34.473529 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f56543-4df0-416b-81b4-219b4f5d441f admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:55:34.479483 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-52f56543-4df0-416b-81b4-219b4f5d441f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:55:34.595294 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eff8794-e87b-4b65-8c0d-e3a2532ee3b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:55:34.596721 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eff8794-e87b-4b65-8c0d-e3a2532ee3b1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:34.609845 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eff8794-e87b-4b65-8c0d-e3a2532ee3b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:34.610293 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eff8794-e87b-4b65-8c0d-e3a2532ee3b1 admin admin] PATH_INFO: `/v3/projects/9edac413df104f50af6e52d3cae79add/users/f2be0ddc02d34db0b878592f58fff8d9/roles/567db03c91854ad9af1e9a87ec1bd275` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:34.610437 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:55:34.613145 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eff8794-e87b-4b65-8c0d-e3a2532ee3b1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9edac413df104f50af6e52d3cae79add, user_id=f2be0ddc02d34db0b878592f58fff8d9, role_id=567db03c91854ad9af1e9a87ec1bd275)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:55:34.615979 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eff8794-e87b-4b65-8c0d-e3a2532ee3b1 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:55:34.634054 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:55:34.658135 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 909/1820] 10.222.0.57 () {60 vars in 1483 bytes} [Fri Sep 16 07:55:34 2022] PUT /identity/v3/projects/9edac413df104f50af6e52d3cae79add/users/f2be0ddc02d34db0b878592f58fff8d9/roles/567db03c91854ad9af1e9a87ec1bd275 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 07:55:34.662079 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eff8794-e87b-4b65-8c0d-e3a2532ee3b1 admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:55:34.671830 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-8eff8794-e87b-4b65-8c0d-e3a2532ee3b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:55:34.683732 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f56543-4df0-416b-81b4-219b4f5d441f admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:55:34.874907 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eff8794-e87b-4b65-8c0d-e3a2532ee3b1 admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:55:34.899397 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9077f0fa-3633-4813-b747-d5697491a04d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:55:34.900088 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9077f0fa-3633-4813-b747-d5697491a04d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:34.900388 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9077f0fa-3633-4813-b747-d5697491a04d admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:34.908292 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9077f0fa-3633-4813-b747-d5697491a04d admin admin] PATH_INFO: `/v3/users/22b4322dca794f6faeda69128ec358db` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:34.910854 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9077f0fa-3633-4813-b747-d5697491a04d admin admin] RBAC: Authorizing `identity:delete_user(user_id=22b4322dca794f6faeda69128ec358db)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:55:34.912893 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9077f0fa-3633-4813-b747-d5697491a04d admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:55:34.970532 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abe702b-df3d-42b4-a55d-dacb18c04d1c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1062e457207a41e4ba4f0a0c4bf36f1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4735f453c0c24cc4a1c14e9ac84a0b46', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:55:34.974701 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abe702b-df3d-42b4-a55d-dacb18c04d1c service neutron] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:34.976825 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abe702b-df3d-42b4-a55d-dacb18c04d1c service neutron] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:34.977271 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abe702b-df3d-42b4-a55d-dacb18c04d1c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:34.981793 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-7abe702b-df3d-42b4-a55d-dacb18c04d1c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:55:35.014566 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abe702b-df3d-42b4-a55d-dacb18c04d1c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:55:35.019614 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abe702b-df3d-42b4-a55d-dacb18c04d1c service neutron] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:55:35.068200 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-9077f0fa-3633-4813-b747-d5697491a04d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '22b4322dca794f6faeda69128ec358db'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:55:35.070067 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 912/1821] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Sep 16 07:55:34 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 600 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 07:55:35.115299 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-9077f0fa-3633-4813-b747-d5697491a04d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '22b4322dca794f6faeda69128ec358db'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:55:35.116232 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-9077f0fa-3633-4813-b747-d5697491a04d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '22b4322dca794f6faeda69128ec358db'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:55:35.133802 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-9077f0fa-3633-4813-b747-d5697491a04d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '22b4322dca794f6faeda69128ec358db'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:55:35.147555 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-9077f0fa-3633-4813-b747-d5697491a04d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '22b4322dca794f6faeda69128ec358db'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:55:35.167218 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 910/1822] 10.222.0.57 () {58 vars in 1224 bytes} [Fri Sep 16 07:55:34 2022] DELETE /identity/v3/users/22b4322dca794f6faeda69128ec358db => generated 0 bytes in 508 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 07:55:36.399619 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abe702b-df3d-42b4-a55d-dacb18c04d1c service neutron] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:55:36.401061 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-7abe702b-df3d-42b4-a55d-dacb18c04d1c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:55:36.603545 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abe702b-df3d-42b4-a55d-dacb18c04d1c service neutron] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:55:36.777181 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b885323-870b-46f4-9552-58aea77804fb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544bf6be4c24454a013ca110c43cef2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4735f453c0c24cc4a1c14e9ac84a0b46', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:55:36.789714 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b885323-870b-46f4-9552-58aea77804fb service cinder] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:36.789714 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b885323-870b-46f4-9552-58aea77804fb service cinder] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:36.791412 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b885323-870b-46f4-9552-58aea77804fb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:36.807335 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-2b885323-870b-46f4-9552-58aea77804fb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:55:36.989563 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b885323-870b-46f4-9552-58aea77804fb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:55:36.997429 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b885323-870b-46f4-9552-58aea77804fb service cinder] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:55:37.031205 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:55:37.060256 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 913/1823] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Sep 16 07:55:36 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 661 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 16 07:55:37.654190 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ce8ab5-04a1-4e02-a9cd-6b4d1f8d4f0f None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:37.655239 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ce8ab5-04a1-4e02-a9cd-6b4d1f8d4f0f None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:37.655726 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ce8ab5-04a1-4e02-a9cd-6b4d1f8d4f0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:37.772929 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-45ce8ab5-04a1-4e02-a9cd-6b4d1f8d4f0f None None] MFA Rules not processed for user `f2be0ddc02d34db0b878592f58fff8d9`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:55:37.778408 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-45ce8ab5-04a1-4e02-a9cd-6b4d1f8d4f0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:55:38.005920 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 911/1824] 10.222.0.57 () {58 vars in 958 bytes} [Fri Sep 16 07:55:37 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 353 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 07:55:38.007147 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f5ee47-1a52-48db-afb4-e140ca24e439 None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:38.008318 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f5ee47-1a52-48db-afb4-e140ca24e439 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:38.012311 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f5ee47-1a52-48db-afb4-e140ca24e439 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:38.029682 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ce8ab5-04a1-4e02-a9cd-6b4d1f8d4f0f None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:55:38.031468 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-45ce8ab5-04a1-4e02-a9cd-6b4d1f8d4f0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:55:38.041941 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:55:38.094294 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-72f5ee47-1a52-48db-afb4-e140ca24e439 None None] MFA Rules not processed for user `1c7a0339a9644455940a4975dce12a6a`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:55:38.095446 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-72f5ee47-1a52-48db-afb4-e140ca24e439 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:55:38.253651 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ce8ab5-04a1-4e02-a9cd-6b4d1f8d4f0f None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:55:38.266596 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c80e3f-cea9-49a1-92ab-d2c126c97257 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:55:38.269747 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c80e3f-cea9-49a1-92ab-d2c126c97257 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:38.269747 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c80e3f-cea9-49a1-92ab-d2c126c97257 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:38.269747 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c80e3f-cea9-49a1-92ab-d2c126c97257 admin admin] PATH_INFO: `/v3/users/c3947510fc3d4c11a007cbf572844c6b` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:38.273213 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c80e3f-cea9-49a1-92ab-d2c126c97257 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c3947510fc3d4c11a007cbf572844c6b)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:55:38.282431 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c80e3f-cea9-49a1-92ab-d2c126c97257 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:55:38.304156 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 914/1825] 10.222.0.57 () {58 vars in 958 bytes} [Fri Sep 16 07:55:38 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 299 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 07:55:38.432097 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-84c80e3f-cea9-49a1-92ab-d2c126c97257 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c3947510fc3d4c11a007cbf572844c6b'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:55:38.485547 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-84c80e3f-cea9-49a1-92ab-d2c126c97257 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c3947510fc3d4c11a007cbf572844c6b'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:55:38.487405 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-84c80e3f-cea9-49a1-92ab-d2c126c97257 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c3947510fc3d4c11a007cbf572844c6b'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:55:38.509097 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-84c80e3f-cea9-49a1-92ab-d2c126c97257 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c3947510fc3d4c11a007cbf572844c6b'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:55:38.509251 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f5ee47-1a52-48db-afb4-e140ca24e439 None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:55:38.510881 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-72f5ee47-1a52-48db-afb4-e140ca24e439 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:55:38.526337 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-84c80e3f-cea9-49a1-92ab-d2c126c97257 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c3947510fc3d4c11a007cbf572844c6b'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:55:38.538434 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 912/1826] 10.222.0.57 () {58 vars in 1224 bytes} [Fri Sep 16 07:55:38 2022] DELETE /identity/v3/users/c3947510fc3d4c11a007cbf572844c6b => generated 0 bytes in 509 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 07:55:38.542601 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f5ee47-1a52-48db-afb4-e140ca24e439 None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:55:38.543475 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e9860b-918c-4808-8b23-e13d0edf8824 None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:38.544176 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e9860b-918c-4808-8b23-e13d0edf8824 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:38.544781 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e9860b-918c-4808-8b23-e13d0edf8824 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:38.586555 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-a6e9860b-918c-4808-8b23-e13d0edf8824 None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:55:38.589111 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-a6e9860b-918c-4808-8b23-e13d0edf8824 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:55:38.664901 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448c99dc-0e9d-4ab1-8feb-bb94cc437ccc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:55:38.665602 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448c99dc-0e9d-4ab1-8feb-bb94cc437ccc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:38.665863 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448c99dc-0e9d-4ab1-8feb-bb94cc437ccc admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:38.666142 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448c99dc-0e9d-4ab1-8feb-bb94cc437ccc admin admin] PATH_INFO: `/v3/projects/807f63ac6d19461cb60db5e71a33fee8` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:38.675497 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448c99dc-0e9d-4ab1-8feb-bb94cc437ccc admin admin] RBAC: Authorizing `identity:delete_project(project_id=807f63ac6d19461cb60db5e71a33fee8)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:55:38.677875 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448c99dc-0e9d-4ab1-8feb-bb94cc437ccc admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:55:38.710891 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 913/1827] 10.222.0.57 () {58 vars in 958 bytes} [Fri Sep 16 07:55:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 16 07:55:38.770914 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e9860b-918c-4808-8b23-e13d0edf8824 None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:55:38.773082 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-a6e9860b-918c-4808-8b23-e13d0edf8824 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:55:38.804610 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-448c99dc-0e9d-4ab1-8feb-bb94cc437ccc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '807f63ac6d19461cb60db5e71a33fee8', 'request_id': 'req-448c99dc-0e9d-4ab1-8feb-bb94cc437ccc'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:55:38.837741 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-448c99dc-0e9d-4ab1-8feb-bb94cc437ccc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '807f63ac6d19461cb60db5e71a33fee8', 'request_id': 'req-448c99dc-0e9d-4ab1-8feb-bb94cc437ccc'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:55:38.860816 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-448c99dc-0e9d-4ab1-8feb-bb94cc437ccc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '807f63ac6d19461cb60db5e71a33fee8', 'request_id': 'req-448c99dc-0e9d-4ab1-8feb-bb94cc437ccc'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:55:38.886361 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:55:38.889293 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-448c99dc-0e9d-4ab1-8feb-bb94cc437ccc admin admin] The token cache is being invalidate because project 807f63ac6d19461cb60db5e71a33fee8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81430) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 07:55:38.889560 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-448c99dc-0e9d-4ab1-8feb-bb94cc437ccc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:55:38.891802 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-448c99dc-0e9d-4ab1-8feb-bb94cc437ccc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:55:38.898336 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 915/1828] 10.222.0.57 () {58 vars in 1233 bytes} [Fri Sep 16 07:55:38 2022] DELETE /identity/v3/projects/807f63ac6d19461cb60db5e71a33fee8 => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 07:55:38.912681 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f577c2-cd74-4da2-940b-fbbff7bd2715 None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:38.914146 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f577c2-cd74-4da2-940b-fbbff7bd2715 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:38.914567 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f577c2-cd74-4da2-940b-fbbff7bd2715 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:38.963452 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-09f577c2-cd74-4da2-940b-fbbff7bd2715 None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:55:38.965604 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-09f577c2-cd74-4da2-940b-fbbff7bd2715 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:55:38.976521 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e9860b-918c-4808-8b23-e13d0edf8824 None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:55:39.065595 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:55:39.135476 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b286eda0-7c7c-44db-b8e4-7c453c69182b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1062e457207a41e4ba4f0a0c4bf36f1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4735f453c0c24cc4a1c14e9ac84a0b46', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:55:39.138242 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b286eda0-7c7c-44db-b8e4-7c453c69182b service neutron] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:39.141524 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b286eda0-7c7c-44db-b8e4-7c453c69182b service neutron] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:39.142454 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b286eda0-7c7c-44db-b8e4-7c453c69182b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:39.151021 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 916/1829] 10.222.0.57 () {58 vars in 958 bytes} [Fri Sep 16 07:55:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 07:55:39.151508 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-b286eda0-7c7c-44db-b8e4-7c453c69182b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:55:39.152872 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f577c2-cd74-4da2-940b-fbbff7bd2715 None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:55:39.190868 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-09f577c2-cd74-4da2-940b-fbbff7bd2715 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:55:39.208330 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b286eda0-7c7c-44db-b8e4-7c453c69182b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:55:39.208330 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b286eda0-7c7c-44db-b8e4-7c453c69182b service neutron] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:55:39.241505 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 914/1830] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Sep 16 07:55:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 474 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 07:55:39.247944 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f64b33f-5f61-4201-bf34-96bf3ffd6b17 None None] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:39.248234 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f64b33f-5f61-4201-bf34-96bf3ffd6b17 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:39.248509 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f64b33f-5f61-4201-bf34-96bf3ffd6b17 None None] PATH_INFO: `/` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:39.261458 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 915/1831] 10.222.0.57 () {54 vars in 921 bytes} [Fri Sep 16 07:55:39 2022] GET /identity => generated 270 bytes in 19 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 07:55:39.264635 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df200dea-fa68-4bdf-b63e-f0f8415d4ba6 None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:39.264982 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df200dea-fa68-4bdf-b63e-f0f8415d4ba6 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:39.265197 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df200dea-fa68-4bdf-b63e-f0f8415d4ba6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:39.348202 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-df200dea-fa68-4bdf-b63e-f0f8415d4ba6 None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:55:39.349465 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-df200dea-fa68-4bdf-b63e-f0f8415d4ba6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:55:39.382912 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 916/1832] 10.222.0.57 () {58 vars in 958 bytes} [Fri Sep 16 07:55:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 07:55:39.383934 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df200dea-fa68-4bdf-b63e-f0f8415d4ba6 None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:55:39.400716 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f577c2-cd74-4da2-940b-fbbff7bd2715 None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:55:39.412951 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df200dea-fa68-4bdf-b63e-f0f8415d4ba6 None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:55:39.419628 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e951347b-db19-4108-9141-b95e4cde42d4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bec4d9b08514461a1bf63c6b88f53b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4735f453c0c24cc4a1c14e9ac84a0b46', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:55:39.422357 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e951347b-db19-4108-9141-b95e4cde42d4 service nova] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:39.424853 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e951347b-db19-4108-9141-b95e4cde42d4 service nova] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:39.425284 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e951347b-db19-4108-9141-b95e4cde42d4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:39.430056 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-e951347b-db19-4108-9141-b95e4cde42d4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:55:39.431954 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967a24f8-00f5-461b-9b60-cf1d5115f1d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:55:39.434084 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967a24f8-00f5-461b-9b60-cf1d5115f1d0 admin admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:39.435216 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967a24f8-00f5-461b-9b60-cf1d5115f1d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:39.435711 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967a24f8-00f5-461b-9b60-cf1d5115f1d0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:39.438467 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967a24f8-00f5-461b-9b60-cf1d5115f1d0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:55:39.439016 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967a24f8-00f5-461b-9b60-cf1d5115f1d0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:55:39.444864 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967a24f8-00f5-461b-9b60-cf1d5115f1d0 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:55:39.491666 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 917/1833] 10.222.0.57 () {58 vars in 1153 bytes} [Fri Sep 16 07:55:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:55:39.496999 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e0c29f-4783-4c18-8c8a-70c6d60fba31 None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:39.497392 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e0c29f-4783-4c18-8c8a-70c6d60fba31 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:39.500921 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e0c29f-4783-4c18-8c8a-70c6d60fba31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:39.543111 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-42e0c29f-4783-4c18-8c8a-70c6d60fba31 None None] MFA Rules not processed for user `9bec4d9b08514461a1bf63c6b88f53b2`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:55:39.544549 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-42e0c29f-4783-4c18-8c8a-70c6d60fba31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:55:39.567693 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 918/1834] 10.222.0.57 () {58 vars in 1018 bytes} [Fri Sep 16 07:55:39 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 07:55:39.569905 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e0c29f-4783-4c18-8c8a-70c6d60fba31 None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:55:39.600735 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e951347b-db19-4108-9141-b95e4cde42d4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:55:39.602535 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e951347b-db19-4108-9141-b95e4cde42d4 service nova] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:55:39.632775 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e0c29f-4783-4c18-8c8a-70c6d60fba31 None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:55:39.636431 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 917/1835] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Sep 16 07:55:39 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 484 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 07:55:39.664680 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d2557c-817a-4d8d-9242-283c725b9614 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:55:39.664680 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d2557c-817a-4d8d-9242-283c725b9614 admin admin] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:39.667501 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d2557c-817a-4d8d-9242-283c725b9614 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:39.667810 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d2557c-817a-4d8d-9242-283c725b9614 admin admin] PATH_INFO: `/v3/projects` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:39.670858 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d2557c-817a-4d8d-9242-283c725b9614 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:55:39.680973 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d2557c-817a-4d8d-9242-283c725b9614 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:55:39.724980 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e951347b-db19-4108-9141-b95e4cde42d4 service nova] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:55:39.726997 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-e951347b-db19-4108-9141-b95e4cde42d4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:55:39.753589 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e951347b-db19-4108-9141-b95e4cde42d4 service nova] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:55:39.767444 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea153d5-7272-41e6-855c-119c94920198 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:55:39.768466 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea153d5-7272-41e6-855c-119c94920198 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:39.768801 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea153d5-7272-41e6-855c-119c94920198 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:39.769083 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea153d5-7272-41e6-855c-119c94920198 admin admin] PATH_INFO: `/v3/users/e84500b1b4b241c99cec8d6eba7c4774` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:39.773784 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea153d5-7272-41e6-855c-119c94920198 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e84500b1b4b241c99cec8d6eba7c4774)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:55:39.775882 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea153d5-7272-41e6-855c-119c94920198 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:55:39.809925 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 919/1836] 10.222.0.57 () {60 vars in 1153 bytes} [Fri Sep 16 07:55:39 2022] POST /identity/v3/projects => generated 409 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 07:55:39.819961 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d2557c-817a-4d8d-9242-283c725b9614 admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:55:39.905027 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-1ea153d5-7272-41e6-855c-119c94920198 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e84500b1b4b241c99cec8d6eba7c4774'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:55:39.905983 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-1ea153d5-7272-41e6-855c-119c94920198 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e84500b1b4b241c99cec8d6eba7c4774'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:55:39.921666 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-1ea153d5-7272-41e6-855c-119c94920198 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e84500b1b4b241c99cec8d6eba7c4774'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:55:39.950081 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:55:39.954991 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-1ea153d5-7272-41e6-855c-119c94920198 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e84500b1b4b241c99cec8d6eba7c4774'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:55:39.975042 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-1ea153d5-7272-41e6-855c-119c94920198 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e84500b1b4b241c99cec8d6eba7c4774'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:55:39.992258 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 918/1837] 10.222.0.57 () {58 vars in 1224 bytes} [Fri Sep 16 07:55:39 2022] DELETE /identity/v3/users/e84500b1b4b241c99cec8d6eba7c4774 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 16 07:55:39.996571 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63fa92d-5a5c-46ab-aae6-ddf9bbf036cc None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:39.996869 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63fa92d-5a5c-46ab-aae6-ddf9bbf036cc None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:39.997147 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63fa92d-5a5c-46ab-aae6-ddf9bbf036cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:40.043948 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-b63fa92d-5a5c-46ab-aae6-ddf9bbf036cc None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:55:40.045772 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-b63fa92d-5a5c-46ab-aae6-ddf9bbf036cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:55:40.049032 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d2557c-817a-4d8d-9242-283c725b9614 admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:55:40.168551 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:55:40.200056 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 919/1838] 10.222.0.57 () {58 vars in 958 bytes} [Fri Sep 16 07:55:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 16 07:55:40.201573 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63fa92d-5a5c-46ab-aae6-ddf9bbf036cc None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:55:40.203288 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-b63fa92d-5a5c-46ab-aae6-ddf9bbf036cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:55:40.215376 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e040956f-1fac-497e-b599-fd856f635db2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:55:40.216113 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e040956f-1fac-497e-b599-fd856f635db2 admin admin] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:40.216397 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e040956f-1fac-497e-b599-fd856f635db2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:40.216684 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e040956f-1fac-497e-b599-fd856f635db2 admin admin] PATH_INFO: `/v3/users` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:40.217417 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e040956f-1fac-497e-b599-fd856f635db2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:55:40.219578 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e040956f-1fac-497e-b599-fd856f635db2 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:55:40.286860 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 920/1839] 10.222.0.57 () {60 vars in 1144 bytes} [Fri Sep 16 07:55:39 2022] POST /identity/v3/users => generated 305 bytes in 464 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 07:55:40.286860 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e040956f-1fac-497e-b599-fd856f635db2 admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:55:40.294244 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-e040956f-1fac-497e-b599-fd856f635db2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:55:40.463717 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63fa92d-5a5c-46ab-aae6-ddf9bbf036cc None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:55:40.475493 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e040956f-1fac-497e-b599-fd856f635db2 admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:55:40.479540 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3db430-6e39-468c-920f-26882acfb9e6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1062e457207a41e4ba4f0a0c4bf36f1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4735f453c0c24cc4a1c14e9ac84a0b46', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:55:40.479844 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df15792f-d1b6-43b5-bfe9-dd2e9eb3d902 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bec4d9b08514461a1bf63c6b88f53b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4735f453c0c24cc4a1c14e9ac84a0b46', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:55:40.480399 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3db430-6e39-468c-920f-26882acfb9e6 service neutron] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:40.480567 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df15792f-d1b6-43b5-bfe9-dd2e9eb3d902 service nova] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:40.480859 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3db430-6e39-468c-920f-26882acfb9e6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:40.481032 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df15792f-d1b6-43b5-bfe9-dd2e9eb3d902 service nova] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:40.481286 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df15792f-d1b6-43b5-bfe9-dd2e9eb3d902 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:40.481393 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3db430-6e39-468c-920f-26882acfb9e6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:40.492601 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-df15792f-d1b6-43b5-bfe9-dd2e9eb3d902 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:55:40.504211 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3db430-6e39-468c-920f-26882acfb9e6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:55:40.505791 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3db430-6e39-468c-920f-26882acfb9e6 service neutron] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:55:40.528490 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 921/1840] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Sep 16 07:55:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 07:55:40.528743 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df15792f-d1b6-43b5-bfe9-dd2e9eb3d902 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:55:40.530459 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df15792f-d1b6-43b5-bfe9-dd2e9eb3d902 service nova] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:55:40.530700 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3db430-6e39-468c-920f-26882acfb9e6 service neutron] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:55:40.543405 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-9e3db430-6e39-468c-920f-26882acfb9e6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:55:40.549975 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 920/1841] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Sep 16 07:55:40 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 07:55:40.586297 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3db430-6e39-468c-920f-26882acfb9e6 service neutron] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:55:40.605414 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a65352-af21-456e-b0e5-d0fd26e35ae2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:55:40.606188 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a65352-af21-456e-b0e5-d0fd26e35ae2 admin admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:40.606544 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a65352-af21-456e-b0e5-d0fd26e35ae2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:40.609842 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a65352-af21-456e-b0e5-d0fd26e35ae2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:40.610709 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a65352-af21-456e-b0e5-d0fd26e35ae2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:55:40.613315 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a65352-af21-456e-b0e5-d0fd26e35ae2 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:55:40.649814 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 922/1842] 10.222.0.57 () {58 vars in 1122 bytes} [Fri Sep 16 07:55:40 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 07:55:40.655176 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df15792f-d1b6-43b5-bfe9-dd2e9eb3d902 service nova] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:55:40.696347 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df15792f-d1b6-43b5-bfe9-dd2e9eb3d902 service nova] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:55:40.715338 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1ec5f7-833c-4ec9-b63d-b1fc2ca88803 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:55:40.720037 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1ec5f7-833c-4ec9-b63d-b1fc2ca88803 admin admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:40.720037 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1ec5f7-833c-4ec9-b63d-b1fc2ca88803 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:40.721595 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1ec5f7-833c-4ec9-b63d-b1fc2ca88803 admin admin] PATH_INFO: `/v3/roles` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:40.723424 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1ec5f7-833c-4ec9-b63d-b1fc2ca88803 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:55:40.729422 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1ec5f7-833c-4ec9-b63d-b1fc2ca88803 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:55:40.742409 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab621041-1f82-4c8f-871e-a0f1e9f19bc6 None None] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:40.742857 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab621041-1f82-4c8f-871e-a0f1e9f19bc6 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:40.743203 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab621041-1f82-4c8f-871e-a0f1e9f19bc6 None None] PATH_INFO: `/` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:40.745165 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 923/1843] 10.222.0.57 () {54 vars in 921 bytes} [Fri Sep 16 07:55:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 07:55:40.771420 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab621041-1f82-4c8f-871e-a0f1e9f19bc6 None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:55:40.771975 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 921/1844] 10.222.0.57 () {58 vars in 1122 bytes} [Fri Sep 16 07:55:40 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 07:55:40.818913 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab621041-1f82-4c8f-871e-a0f1e9f19bc6 None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:55:40.840234 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d7829f-c65d-4a0c-b20e-69ba5397863f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:55:40.841227 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d7829f-c65d-4a0c-b20e-69ba5397863f admin admin] REQUEST_METHOD: `PUT` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:40.841513 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d7829f-c65d-4a0c-b20e-69ba5397863f admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:40.841886 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d7829f-c65d-4a0c-b20e-69ba5397863f admin admin] PATH_INFO: `/v3/projects/787164464e42427cbf2a912d3a1c4812/users/d15cbda643da4046be92fde98900736b/roles/4818d38cf2564825b312e66c9eb24762` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:40.918426 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cc4ac5-7010-4460-83a0-de809c4c5998 None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:40.919010 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cc4ac5-7010-4460-83a0-de809c4c5998 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:40.919478 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cc4ac5-7010-4460-83a0-de809c4c5998 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:40.947698 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d7829f-c65d-4a0c-b20e-69ba5397863f admin admin] RBAC: Authorizing `identity:create_grant(project_id=787164464e42427cbf2a912d3a1c4812, user_id=d15cbda643da4046be92fde98900736b, role_id=4818d38cf2564825b312e66c9eb24762)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:55:40.954121 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d7829f-c65d-4a0c-b20e-69ba5397863f admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:55:40.972741 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-92cc4ac5-7010-4460-83a0-de809c4c5998 None None] MFA Rules not processed for user `9bec4d9b08514461a1bf63c6b88f53b2`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:55:40.976662 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-92cc4ac5-7010-4460-83a0-de809c4c5998 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:55:40.985862 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 924/1845] 10.222.0.57 () {60 vars in 1483 bytes} [Fri Sep 16 07:55:40 2022] PUT /identity/v3/projects/787164464e42427cbf2a912d3a1c4812/users/d15cbda643da4046be92fde98900736b/roles/4818d38cf2564825b312e66c9eb24762 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 16 07:55:40.997040 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0f4f0c-eedb-422d-b695-bd6d6bdaa411 None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:40.997817 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0f4f0c-eedb-422d-b695-bd6d6bdaa411 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:40.998281 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0f4f0c-eedb-422d-b695-bd6d6bdaa411 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:41.110930 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-7d0f4f0c-eedb-422d-b695-bd6d6bdaa411 None None] MFA Rules not processed for user `d15cbda643da4046be92fde98900736b`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:55:41.113462 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-7d0f4f0c-eedb-422d-b695-bd6d6bdaa411 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:55:41.234859 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:DELETE=1,keystone:SELECT=99 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:55:41.314310 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 922/1846] 10.222.0.57 () {58 vars in 1018 bytes} [Fri Sep 16 07:55:40 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 397 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 16 07:55:41.319133 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cc4ac5-7010-4460-83a0-de809c4c5998 None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:55:41.327432 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-92cc4ac5-7010-4460-83a0-de809c4c5998 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:55:41.341709 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 925/1847] 10.222.0.57 () {58 vars in 958 bytes} [Fri Sep 16 07:55:40 2022] POST /identity/v3/auth/tokens => generated 3286 bytes in 345 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 16 07:55:41.343506 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0f4f0c-eedb-422d-b695-bd6d6bdaa411 None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:55:41.418950 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:55:41.489985 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cc4ac5-7010-4460-83a0-de809c4c5998 None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:55:41.500780 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0f4f0c-eedb-422d-b695-bd6d6bdaa411 None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:55:41.506691 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50da2a83-1e7d-49e1-8856-51b6e3dd2309 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:55:41.509022 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50da2a83-1e7d-49e1-8856-51b6e3dd2309 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:41.510430 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50da2a83-1e7d-49e1-8856-51b6e3dd2309 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:41.510835 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50da2a83-1e7d-49e1-8856-51b6e3dd2309 admin admin] PATH_INFO: `/v3/projects/b5770190b9a94317bbfc71518d6d2db5` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:41.513570 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c44f53-d556-40c4-bf9c-cecdd799f5bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:55:41.514617 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50da2a83-1e7d-49e1-8856-51b6e3dd2309 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b5770190b9a94317bbfc71518d6d2db5)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:55:41.515766 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c44f53-d556-40c4-bf9c-cecdd799f5bd admin admin] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:41.516133 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c44f53-d556-40c4-bf9c-cecdd799f5bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:41.518275 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c44f53-d556-40c4-bf9c-cecdd799f5bd admin admin] PATH_INFO: `/v3/projects` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:41.519075 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c44f53-d556-40c4-bf9c-cecdd799f5bd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:55:41.519903 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50da2a83-1e7d-49e1-8856-51b6e3dd2309 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:55:41.524858 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c44f53-d556-40c4-bf9c-cecdd799f5bd admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:55:41.598871 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 926/1848] 10.222.0.57 () {60 vars in 1153 bytes} [Fri Sep 16 07:55:41 2022] POST /identity/v3/projects => generated 405 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 07:55:41.606155 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c44f53-d556-40c4-bf9c-cecdd799f5bd admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:55:41.655883 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-50da2a83-1e7d-49e1-8856-51b6e3dd2309 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b5770190b9a94317bbfc71518d6d2db5', 'request_id': 'req-50da2a83-1e7d-49e1-8856-51b6e3dd2309'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:55:41.680887 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-50da2a83-1e7d-49e1-8856-51b6e3dd2309 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b5770190b9a94317bbfc71518d6d2db5', 'request_id': 'req-50da2a83-1e7d-49e1-8856-51b6e3dd2309'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:55:41.687841 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-50da2a83-1e7d-49e1-8856-51b6e3dd2309 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b5770190b9a94317bbfc71518d6d2db5', 'request_id': 'req-50da2a83-1e7d-49e1-8856-51b6e3dd2309'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:55:41.711985 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-50da2a83-1e7d-49e1-8856-51b6e3dd2309 admin admin] The token cache is being invalidate because project b5770190b9a94317bbfc71518d6d2db5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81430) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 07:55:41.712222 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-50da2a83-1e7d-49e1-8856-51b6e3dd2309 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:55:41.719854 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-50da2a83-1e7d-49e1-8856-51b6e3dd2309 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:55:41.725337 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 923/1849] 10.222.0.57 () {58 vars in 1233 bytes} [Fri Sep 16 07:55:41 2022] DELETE /identity/v3/projects/b5770190b9a94317bbfc71518d6d2db5 => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 07:55:41.726541 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50da2a83-1e7d-49e1-8856-51b6e3dd2309 admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:55:41.727951 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-50da2a83-1e7d-49e1-8856-51b6e3dd2309 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:55:41.796488 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c44f53-d556-40c4-bf9c-cecdd799f5bd admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:55:41.905090 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50da2a83-1e7d-49e1-8856-51b6e3dd2309 admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:55:41.925310 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3108d6d-3827-487d-9933-338d45a5ecd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:55:41.926005 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3108d6d-3827-487d-9933-338d45a5ecd7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:41.926288 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3108d6d-3827-487d-9933-338d45a5ecd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:41.927213 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3108d6d-3827-487d-9933-338d45a5ecd7 admin admin] PATH_INFO: `/v3/users/bc8d8a66ec794bc0bebb4021aedce4b7` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:41.928250 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3108d6d-3827-487d-9933-338d45a5ecd7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bc8d8a66ec794bc0bebb4021aedce4b7)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:55:41.930229 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3108d6d-3827-487d-9933-338d45a5ecd7 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:55:41.972733 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f68191c-4edb-48f3-a4c6-027e756401de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:55:41.975108 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f68191c-4edb-48f3-a4c6-027e756401de admin admin] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:41.976761 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f68191c-4edb-48f3-a4c6-027e756401de admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:41.977248 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f68191c-4edb-48f3-a4c6-027e756401de admin admin] PATH_INFO: `/v3/users` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:41.979732 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f68191c-4edb-48f3-a4c6-027e756401de admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:55:41.984025 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f68191c-4edb-48f3-a4c6-027e756401de admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:55:41.993207 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:55:42.050574 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 927/1850] 10.222.0.57 () {60 vars in 1144 bytes} [Fri Sep 16 07:55:41 2022] POST /identity/v3/users => generated 309 bytes in 447 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 07:55:42.051180 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-e3108d6d-3827-487d-9933-338d45a5ecd7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bc8d8a66ec794bc0bebb4021aedce4b7'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:55:42.051899 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f68191c-4edb-48f3-a4c6-027e756401de admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:55:42.054795 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-6f68191c-4edb-48f3-a4c6-027e756401de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:55:42.057040 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-e3108d6d-3827-487d-9933-338d45a5ecd7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bc8d8a66ec794bc0bebb4021aedce4b7'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:55:42.090630 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-e3108d6d-3827-487d-9933-338d45a5ecd7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bc8d8a66ec794bc0bebb4021aedce4b7'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:55:42.099082 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f68191c-4edb-48f3-a4c6-027e756401de admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:55:42.107775 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763888e8-7f4d-4420-b6ff-08a56fc42403 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:55:42.108428 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763888e8-7f4d-4420-b6ff-08a56fc42403 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:42.109354 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763888e8-7f4d-4420-b6ff-08a56fc42403 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:42.109354 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763888e8-7f4d-4420-b6ff-08a56fc42403 admin admin] PATH_INFO: `/v3/projects/dc64ce02b1d146f28a90bae00330c377` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:42.110360 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763888e8-7f4d-4420-b6ff-08a56fc42403 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dc64ce02b1d146f28a90bae00330c377)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:55:42.113915 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763888e8-7f4d-4420-b6ff-08a56fc42403 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:55:42.122412 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-e3108d6d-3827-487d-9933-338d45a5ecd7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bc8d8a66ec794bc0bebb4021aedce4b7'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:55:42.146336 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-e3108d6d-3827-487d-9933-338d45a5ecd7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bc8d8a66ec794bc0bebb4021aedce4b7'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:55:42.165911 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 924/1851] 10.222.0.57 () {58 vars in 1224 bytes} [Fri Sep 16 07:55:41 2022] DELETE /identity/v3/users/bc8d8a66ec794bc0bebb4021aedce4b7 => generated 0 bytes in 439 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 07:55:42.167563 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3108d6d-3827-487d-9933-338d45a5ecd7 admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:55:42.169842 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-e3108d6d-3827-487d-9933-338d45a5ecd7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:55:42.209694 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:55:42.213398 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-763888e8-7f4d-4420-b6ff-08a56fc42403 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dc64ce02b1d146f28a90bae00330c377', 'request_id': 'req-763888e8-7f4d-4420-b6ff-08a56fc42403'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:55:42.226444 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-763888e8-7f4d-4420-b6ff-08a56fc42403 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dc64ce02b1d146f28a90bae00330c377', 'request_id': 'req-763888e8-7f4d-4420-b6ff-08a56fc42403'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:55:42.241776 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-763888e8-7f4d-4420-b6ff-08a56fc42403 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dc64ce02b1d146f28a90bae00330c377', 'request_id': 'req-763888e8-7f4d-4420-b6ff-08a56fc42403'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:55:42.262104 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-763888e8-7f4d-4420-b6ff-08a56fc42403 admin admin] The token cache is being invalidate because project dc64ce02b1d146f28a90bae00330c377 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81431) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 07:55:42.262577 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-763888e8-7f4d-4420-b6ff-08a56fc42403 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:55:42.265532 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-763888e8-7f4d-4420-b6ff-08a56fc42403 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:55:42.267770 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 928/1852] 10.222.0.57 () {58 vars in 1233 bytes} [Fri Sep 16 07:55:42 2022] DELETE /identity/v3/projects/dc64ce02b1d146f28a90bae00330c377 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 07:55:42.272909 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763888e8-7f4d-4420-b6ff-08a56fc42403 admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:55:42.276574 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-763888e8-7f4d-4420-b6ff-08a56fc42403 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:55:42.383076 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3108d6d-3827-487d-9933-338d45a5ecd7 admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:55:42.471319 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763888e8-7f4d-4420-b6ff-08a56fc42403 admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:55:42.497792 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08df7e8e-697f-4a61-b192-2af715c9478d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:55:42.498569 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08df7e8e-697f-4a61-b192-2af715c9478d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:42.498963 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08df7e8e-697f-4a61-b192-2af715c9478d admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:42.499371 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08df7e8e-697f-4a61-b192-2af715c9478d admin admin] PATH_INFO: `/v3/users/2bbd4d4f0620449a913f2e08f09d9266` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:42.500684 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08df7e8e-697f-4a61-b192-2af715c9478d admin admin] RBAC: Authorizing `identity:delete_user(user_id=2bbd4d4f0620449a913f2e08f09d9266)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:55:42.503120 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08df7e8e-697f-4a61-b192-2af715c9478d admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:55:42.530646 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b44517f-b820-4a1b-ac56-2f2f30e78a4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:55:42.531419 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b44517f-b820-4a1b-ac56-2f2f30e78a4f admin admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:42.531799 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b44517f-b820-4a1b-ac56-2f2f30e78a4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:42.532250 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b44517f-b820-4a1b-ac56-2f2f30e78a4f admin admin] PATH_INFO: `/v3/roles` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:42.533013 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b44517f-b820-4a1b-ac56-2f2f30e78a4f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:55:42.535429 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b44517f-b820-4a1b-ac56-2f2f30e78a4f admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:55:42.554017 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 925/1853] 10.222.0.57 () {58 vars in 1122 bytes} [Fri Sep 16 07:55:42 2022] GET /identity/v3/roles => generated 1420 bytes in 384 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 07:55:42.555434 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b44517f-b820-4a1b-ac56-2f2f30e78a4f admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:55:42.557687 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-8b44517f-b820-4a1b-ac56-2f2f30e78a4f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:55:42.589870 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b44517f-b820-4a1b-ac56-2f2f30e78a4f admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:55:42.590536 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-08df7e8e-697f-4a61-b192-2af715c9478d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2bbd4d4f0620449a913f2e08f09d9266'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:55:42.604024 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edacc585-88ba-4767-8275-b6a442771f0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:55:42.604794 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edacc585-88ba-4767-8275-b6a442771f0e admin admin] REQUEST_METHOD: `PUT` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:42.605152 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edacc585-88ba-4767-8275-b6a442771f0e admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:42.605512 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edacc585-88ba-4767-8275-b6a442771f0e admin admin] PATH_INFO: `/v3/projects/df7d4e79518246a0b98c73e3597da381/users/9db41a6543924a109daef8af706bae39/roles/567db03c91854ad9af1e9a87ec1bd275` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:42.616494 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-08df7e8e-697f-4a61-b192-2af715c9478d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2bbd4d4f0620449a913f2e08f09d9266'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:55:42.617254 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-08df7e8e-697f-4a61-b192-2af715c9478d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2bbd4d4f0620449a913f2e08f09d9266'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:55:42.628179 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-08df7e8e-697f-4a61-b192-2af715c9478d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2bbd4d4f0620449a913f2e08f09d9266'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:55:42.637114 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-08df7e8e-697f-4a61-b192-2af715c9478d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2bbd4d4f0620449a913f2e08f09d9266'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:55:42.649354 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 929/1854] 10.222.0.57 () {58 vars in 1224 bytes} [Fri Sep 16 07:55:42 2022] DELETE /identity/v3/users/2bbd4d4f0620449a913f2e08f09d9266 => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 07:55:42.663700 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edacc585-88ba-4767-8275-b6a442771f0e admin admin] RBAC: Authorizing `identity:create_grant(project_id=df7d4e79518246a0b98c73e3597da381, user_id=9db41a6543924a109daef8af706bae39, role_id=567db03c91854ad9af1e9a87ec1bd275)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:55:42.666769 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edacc585-88ba-4767-8275-b6a442771f0e admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:55:42.708849 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 926/1855] 10.222.0.57 () {60 vars in 1483 bytes} [Fri Sep 16 07:55:42 2022] PUT /identity/v3/projects/df7d4e79518246a0b98c73e3597da381/users/9db41a6543924a109daef8af706bae39/roles/567db03c91854ad9af1e9a87ec1bd275 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 07:55:42.710617 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08df7e8e-697f-4a61-b192-2af715c9478d admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:55:42.711778 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-08df7e8e-697f-4a61-b192-2af715c9478d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:55:42.833104 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:55:42.863323 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08df7e8e-697f-4a61-b192-2af715c9478d admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:55:43.013845 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e9f0fe-7246-4ced-8973-1d797a72f769 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:55:43.015417 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e9f0fe-7246-4ced-8973-1d797a72f769 admin admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:43.015871 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e9f0fe-7246-4ced-8973-1d797a72f769 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:43.016602 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e9f0fe-7246-4ced-8973-1d797a72f769 admin admin] PATH_INFO: `/v3/roles` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:43.026339 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e9f0fe-7246-4ced-8973-1d797a72f769 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:55:43.029971 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e9f0fe-7246-4ced-8973-1d797a72f769 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:55:43.062380 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 930/1856] 10.222.0.57 () {58 vars in 1122 bytes} [Fri Sep 16 07:55:42 2022] GET /identity/v3/roles => generated 1420 bytes in 353 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 07:55:43.067463 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edacc585-88ba-4767-8275-b6a442771f0e admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:55:43.107764 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edacc585-88ba-4767-8275-b6a442771f0e admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:55:43.124440 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5288ffdc-4962-45f0-b75d-be5a5680ffa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:55:43.125997 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5288ffdc-4962-45f0-b75d-be5a5680ffa7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:43.125997 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5288ffdc-4962-45f0-b75d-be5a5680ffa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:43.126424 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5288ffdc-4962-45f0-b75d-be5a5680ffa7 admin admin] PATH_INFO: `/v3/projects/df7d4e79518246a0b98c73e3597da381/users/9db41a6543924a109daef8af706bae39/roles/567db03c91854ad9af1e9a87ec1bd275` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:43.139807 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5288ffdc-4962-45f0-b75d-be5a5680ffa7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=df7d4e79518246a0b98c73e3597da381, user_id=9db41a6543924a109daef8af706bae39, role_id=567db03c91854ad9af1e9a87ec1bd275)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:55:43.144750 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5288ffdc-4962-45f0-b75d-be5a5680ffa7 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:55:43.159069 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 927/1857] 10.222.0.57 () {60 vars in 1483 bytes} [Fri Sep 16 07:55:43 2022] PUT /identity/v3/projects/df7d4e79518246a0b98c73e3597da381/users/9db41a6543924a109daef8af706bae39/roles/567db03c91854ad9af1e9a87ec1bd275 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 07:55:43.170580 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996cd209-0295-42f6-8932-caea341a0854 None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:43.171208 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996cd209-0295-42f6-8932-caea341a0854 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:43.171694 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996cd209-0295-42f6-8932-caea341a0854 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:43.308681 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-996cd209-0295-42f6-8932-caea341a0854 None None] MFA Rules not processed for user `9db41a6543924a109daef8af706bae39`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:55:43.310002 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-996cd209-0295-42f6-8932-caea341a0854 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:55:43.458561 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5288ffdc-4962-45f0-b75d-be5a5680ffa7 admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:55:43.461007 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-5288ffdc-4962-45f0-b75d-be5a5680ffa7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:55:43.473131 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=91,keystone:DELETE=6,keystone:INSERT=3 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:55:43.554994 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 931/1858] 10.222.0.57 () {58 vars in 958 bytes} [Fri Sep 16 07:55:43 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 386 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 07:55:43.566991 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996cd209-0295-42f6-8932-caea341a0854 None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:55:43.568698 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-996cd209-0295-42f6-8932-caea341a0854 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:55:43.608758 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5288ffdc-4962-45f0-b75d-be5a5680ffa7 admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:55:43.620335 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492f4a37-b5e4-43ef-b9a4-5eda8c6b4d6c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bec4d9b08514461a1bf63c6b88f53b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4735f453c0c24cc4a1c14e9ac84a0b46', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:55:43.621002 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492f4a37-b5e4-43ef-b9a4-5eda8c6b4d6c service nova] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:43.621323 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492f4a37-b5e4-43ef-b9a4-5eda8c6b4d6c service nova] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:43.621595 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492f4a37-b5e4-43ef-b9a4-5eda8c6b4d6c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:43.624014 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-492f4a37-b5e4-43ef-b9a4-5eda8c6b4d6c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:55:43.647355 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492f4a37-b5e4-43ef-b9a4-5eda8c6b4d6c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:55:43.649672 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492f4a37-b5e4-43ef-b9a4-5eda8c6b4d6c service nova] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:55:43.672967 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 928/1859] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Sep 16 07:55:43 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 07:55:43.737258 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996cd209-0295-42f6-8932-caea341a0854 None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:55:43.744164 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a35d84c-8db9-4aaa-8277-ce8a466c098e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544bf6be4c24454a013ca110c43cef2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4735f453c0c24cc4a1c14e9ac84a0b46', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:55:43.745041 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a35d84c-8db9-4aaa-8277-ce8a466c098e service cinder] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:43.745478 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a35d84c-8db9-4aaa-8277-ce8a466c098e service cinder] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:43.746008 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a35d84c-8db9-4aaa-8277-ce8a466c098e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:43.761468 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a35d84c-8db9-4aaa-8277-ce8a466c098e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:55:43.764862 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a35d84c-8db9-4aaa-8277-ce8a466c098e service cinder] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:55:43.783757 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 932/1860] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Sep 16 07:55:43 2022] GET /identity/v3/auth/tokens => generated 3349 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 07:55:44.219281 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492f4a37-b5e4-43ef-b9a4-5eda8c6b4d6c service nova] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:55:44.221936 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-492f4a37-b5e4-43ef-b9a4-5eda8c6b4d6c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:55:44.267298 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492f4a37-b5e4-43ef-b9a4-5eda8c6b4d6c service nova] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:55:44.273264 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6319b5-9d1d-44dc-85a6-11f715e6ac3c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544bf6be4c24454a013ca110c43cef2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4735f453c0c24cc4a1c14e9ac84a0b46', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:55:44.274292 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6319b5-9d1d-44dc-85a6-11f715e6ac3c service cinder] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:44.275038 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6319b5-9d1d-44dc-85a6-11f715e6ac3c service cinder] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:44.275545 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6319b5-9d1d-44dc-85a6-11f715e6ac3c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:44.279707 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-bc6319b5-9d1d-44dc-85a6-11f715e6ac3c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:55:44.338494 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a35d84c-8db9-4aaa-8277-ce8a466c098e service cinder] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:55:44.340222 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-1a35d84c-8db9-4aaa-8277-ce8a466c098e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:55:44.448795 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:55:44.535913 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6319b5-9d1d-44dc-85a6-11f715e6ac3c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:55:44.537774 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6319b5-9d1d-44dc-85a6-11f715e6ac3c service cinder] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:55:44.577315 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 929/1861] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Sep 16 07:55:44 2022] GET /identity/v3/auth/tokens => generated 3286 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 07:55:44.588975 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a35d84c-8db9-4aaa-8277-ce8a466c098e service cinder] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:55:44.591898 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43012208-b3ef-46f2-bcab-96d3600da779 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:55:44.592657 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43012208-b3ef-46f2-bcab-96d3600da779 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:44.592915 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43012208-b3ef-46f2-bcab-96d3600da779 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:44.593200 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43012208-b3ef-46f2-bcab-96d3600da779 admin admin] PATH_INFO: `/v3/projects/ee8a6b0583074c7884b0ef624f7c5654` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:44.594634 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43012208-b3ef-46f2-bcab-96d3600da779 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ee8a6b0583074c7884b0ef624f7c5654)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:55:44.598987 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43012208-b3ef-46f2-bcab-96d3600da779 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:55:44.804938 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-43012208-b3ef-46f2-bcab-96d3600da779 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ee8a6b0583074c7884b0ef624f7c5654', 'request_id': 'req-43012208-b3ef-46f2-bcab-96d3600da779'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:55:44.845951 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-43012208-b3ef-46f2-bcab-96d3600da779 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ee8a6b0583074c7884b0ef624f7c5654', 'request_id': 'req-43012208-b3ef-46f2-bcab-96d3600da779'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:55:44.854798 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-43012208-b3ef-46f2-bcab-96d3600da779 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ee8a6b0583074c7884b0ef624f7c5654', 'request_id': 'req-43012208-b3ef-46f2-bcab-96d3600da779'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:55:44.879958 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-43012208-b3ef-46f2-bcab-96d3600da779 admin admin] The token cache is being invalidate because project ee8a6b0583074c7884b0ef624f7c5654 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81431) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 07:55:44.881284 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-43012208-b3ef-46f2-bcab-96d3600da779 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:55:44.884180 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-43012208-b3ef-46f2-bcab-96d3600da779 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:55:44.895210 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affd7b22-7950-42fc-8d70-ca8a4716b5a1 None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:44.895438 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 933/1862] 10.222.0.57 () {58 vars in 1233 bytes} [Fri Sep 16 07:55:44 2022] DELETE /identity/v3/projects/ee8a6b0583074c7884b0ef624f7c5654 => generated 0 bytes in 551 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 07:55:44.895532 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affd7b22-7950-42fc-8d70-ca8a4716b5a1 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:44.895803 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affd7b22-7950-42fc-8d70-ca8a4716b5a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:44.952639 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-affd7b22-7950-42fc-8d70-ca8a4716b5a1 None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:55:44.953901 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-affd7b22-7950-42fc-8d70-ca8a4716b5a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:55:45.061612 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423465fd-ef20-48dc-b2b9-5a7e24bffda9 None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:45.061962 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423465fd-ef20-48dc-b2b9-5a7e24bffda9 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:45.062606 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423465fd-ef20-48dc-b2b9-5a7e24bffda9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:45.066062 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 930/1863] 10.222.0.57 () {58 vars in 958 bytes} [Fri Sep 16 07:55:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 07:55:45.128211 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-423465fd-ef20-48dc-b2b9-5a7e24bffda9 None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:55:45.129453 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-423465fd-ef20-48dc-b2b9-5a7e24bffda9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:55:45.154482 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 934/1864] 10.222.0.57 () {58 vars in 958 bytes} [Fri Sep 16 07:55:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 07:55:45.155383 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affd7b22-7950-42fc-8d70-ca8a4716b5a1 None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:55:45.169480 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affd7b22-7950-42fc-8d70-ca8a4716b5a1 None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:55:45.177857 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19c7a13-f7a0-47af-8987-f010b70283b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:55:45.178709 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19c7a13-f7a0-47af-8987-f010b70283b3 admin admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:45.179064 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19c7a13-f7a0-47af-8987-f010b70283b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:45.179274 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19c7a13-f7a0-47af-8987-f010b70283b3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:45.180038 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19c7a13-f7a0-47af-8987-f010b70283b3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:55:45.180418 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19c7a13-f7a0-47af-8987-f010b70283b3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:55:45.182402 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19c7a13-f7a0-47af-8987-f010b70283b3 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:55:45.197772 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 931/1865] 10.222.0.57 () {58 vars in 1153 bytes} [Fri Sep 16 07:55:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:55:45.201671 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423465fd-ef20-48dc-b2b9-5a7e24bffda9 None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:55:45.211288 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423465fd-ef20-48dc-b2b9-5a7e24bffda9 None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:55:45.217921 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6de26f1-2b0b-47a2-86fd-a5f2886bb044 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:55:45.218549 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6de26f1-2b0b-47a2-86fd-a5f2886bb044 admin admin] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:45.218830 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6de26f1-2b0b-47a2-86fd-a5f2886bb044 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:45.219101 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6de26f1-2b0b-47a2-86fd-a5f2886bb044 admin admin] PATH_INFO: `/v3/projects` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:45.219946 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6de26f1-2b0b-47a2-86fd-a5f2886bb044 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:55:45.223056 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6de26f1-2b0b-47a2-86fd-a5f2886bb044 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:55:45.256058 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19c7a13-f7a0-47af-8987-f010b70283b3 admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:55:45.257949 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-a19c7a13-f7a0-47af-8987-f010b70283b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:55:45.276528 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19c7a13-f7a0-47af-8987-f010b70283b3 admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:55:45.281615 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 935/1866] 10.222.0.57 () {60 vars in 1153 bytes} [Fri Sep 16 07:55:45 2022] POST /identity/v3/projects => generated 369 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 07:55:45.286415 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170d91b7-194d-4cbb-8acd-36e69472a4f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:55:45.287993 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170d91b7-194d-4cbb-8acd-36e69472a4f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:45.288695 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170d91b7-194d-4cbb-8acd-36e69472a4f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:45.289185 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170d91b7-194d-4cbb-8acd-36e69472a4f7 admin admin] PATH_INFO: `/v3/projects/1f230c2cd0ce4904b355234bbe3f2bc0` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:45.291279 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170d91b7-194d-4cbb-8acd-36e69472a4f7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1f230c2cd0ce4904b355234bbe3f2bc0)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:55:45.293251 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170d91b7-194d-4cbb-8acd-36e69472a4f7 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:55:45.293957 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6de26f1-2b0b-47a2-86fd-a5f2886bb044 admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:55:45.308035 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:55:45.370065 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-170d91b7-194d-4cbb-8acd-36e69472a4f7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1f230c2cd0ce4904b355234bbe3f2bc0', 'request_id': 'req-170d91b7-194d-4cbb-8acd-36e69472a4f7'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:55:45.382334 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-170d91b7-194d-4cbb-8acd-36e69472a4f7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1f230c2cd0ce4904b355234bbe3f2bc0', 'request_id': 'req-170d91b7-194d-4cbb-8acd-36e69472a4f7'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:55:45.396227 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-170d91b7-194d-4cbb-8acd-36e69472a4f7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1f230c2cd0ce4904b355234bbe3f2bc0', 'request_id': 'req-170d91b7-194d-4cbb-8acd-36e69472a4f7'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:55:45.411167 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-170d91b7-194d-4cbb-8acd-36e69472a4f7 admin admin] The token cache is being invalidate because project 1f230c2cd0ce4904b355234bbe3f2bc0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81430) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 07:55:45.411460 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-170d91b7-194d-4cbb-8acd-36e69472a4f7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:55:45.412251 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-170d91b7-194d-4cbb-8acd-36e69472a4f7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:55:45.413919 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 932/1867] 10.222.0.57 () {58 vars in 1233 bytes} [Fri Sep 16 07:55:45 2022] DELETE /identity/v3/projects/1f230c2cd0ce4904b355234bbe3f2bc0 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 16 07:55:45.419780 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db041e75-26fc-4cce-9bcb-35d827b1739a None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:45.420108 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db041e75-26fc-4cce-9bcb-35d827b1739a None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:45.420381 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db041e75-26fc-4cce-9bcb-35d827b1739a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:45.424572 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6de26f1-2b0b-47a2-86fd-a5f2886bb044 admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:55:45.443055 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-db041e75-26fc-4cce-9bcb-35d827b1739a None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:55:45.444315 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-db041e75-26fc-4cce-9bcb-35d827b1739a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:55:45.467687 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:55:45.522212 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bf8e50-5ea1-47cd-81c8-f13d55b0dc71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:55:45.522954 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bf8e50-5ea1-47cd-81c8-f13d55b0dc71 admin admin] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:45.523329 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bf8e50-5ea1-47cd-81c8-f13d55b0dc71 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:45.523604 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bf8e50-5ea1-47cd-81c8-f13d55b0dc71 admin admin] PATH_INFO: `/v3/users` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:45.524231 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7bf8e50-5ea1-47cd-81c8-f13d55b0dc71 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:55:45.526173 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7bf8e50-5ea1-47cd-81c8-f13d55b0dc71 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:55:45.526867 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 933/1868] 10.222.0.57 () {58 vars in 958 bytes} [Fri Sep 16 07:55:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 07:55:45.534847 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f9e8a2-bb53-49e6-8b35-9c94cb9a9ebb None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:45.535136 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f9e8a2-bb53-49e6-8b35-9c94cb9a9ebb None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:45.535419 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f9e8a2-bb53-49e6-8b35-9c94cb9a9ebb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:45.547918 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 936/1869] 10.222.0.57 () {60 vars in 1144 bytes} [Fri Sep 16 07:55:45 2022] POST /identity/v3/users => generated 285 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 07:55:45.551570 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bf8e50-5ea1-47cd-81c8-f13d55b0dc71 admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:55:45.553274 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-f7bf8e50-5ea1-47cd-81c8-f13d55b0dc71 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:55:45.556169 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-57f9e8a2-bb53-49e6-8b35-9c94cb9a9ebb None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:55:45.557323 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-57f9e8a2-bb53-49e6-8b35-9c94cb9a9ebb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:55:45.565209 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bf8e50-5ea1-47cd-81c8-f13d55b0dc71 admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:55:45.565781 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 934/1870] 10.222.0.57 () {58 vars in 958 bytes} [Fri Sep 16 07:55:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 07:55:45.570158 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f9e8a2-bb53-49e6-8b35-9c94cb9a9ebb None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:55:45.574291 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901e0712-bce8-4a30-8875-608ceb9d0031 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:55:45.574886 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901e0712-bce8-4a30-8875-608ceb9d0031 admin admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:45.575784 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901e0712-bce8-4a30-8875-608ceb9d0031 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:45.575784 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901e0712-bce8-4a30-8875-608ceb9d0031 admin admin] PATH_INFO: `/v3/roles` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:45.576264 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901e0712-bce8-4a30-8875-608ceb9d0031 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:55:45.578286 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901e0712-bce8-4a30-8875-608ceb9d0031 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:55:45.578981 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f9e8a2-bb53-49e6-8b35-9c94cb9a9ebb None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:55:45.584134 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77fc2c8-fd13-404b-82ea-f501e3b74753 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:55:45.584714 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77fc2c8-fd13-404b-82ea-f501e3b74753 admin admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:45.584991 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77fc2c8-fd13-404b-82ea-f501e3b74753 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:45.585259 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77fc2c8-fd13-404b-82ea-f501e3b74753 admin admin] PATH_INFO: `/v3/domains` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:45.585924 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77fc2c8-fd13-404b-82ea-f501e3b74753 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:55:45.586229 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77fc2c8-fd13-404b-82ea-f501e3b74753 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:55:45.587766 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77fc2c8-fd13-404b-82ea-f501e3b74753 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:55:45.594253 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 937/1871] 10.222.0.57 () {58 vars in 1122 bytes} [Fri Sep 16 07:55:45 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 16 07:55:45.595860 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901e0712-bce8-4a30-8875-608ceb9d0031 admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:55:45.599797 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 935/1872] 10.222.0.57 () {58 vars in 1153 bytes} [Fri Sep 16 07:55:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 07:55:45.604103 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77fc2c8-fd13-404b-82ea-f501e3b74753 admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:55:45.608075 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901e0712-bce8-4a30-8875-608ceb9d0031 admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:55:45.613374 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be44344d-f06f-47c4-954b-0496ff7bf355 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:55:45.613653 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77fc2c8-fd13-404b-82ea-f501e3b74753 admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:55:45.614003 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be44344d-f06f-47c4-954b-0496ff7bf355 admin admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:45.614325 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be44344d-f06f-47c4-954b-0496ff7bf355 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:45.614552 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be44344d-f06f-47c4-954b-0496ff7bf355 admin admin] PATH_INFO: `/v3/roles` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:45.615178 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be44344d-f06f-47c4-954b-0496ff7bf355 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:55:45.616751 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be44344d-f06f-47c4-954b-0496ff7bf355 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:55:45.618486 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cdf8bd-4409-4d2d-abf1-2f75f4d5e27a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:55:45.619341 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cdf8bd-4409-4d2d-abf1-2f75f4d5e27a admin admin] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:45.619341 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cdf8bd-4409-4d2d-abf1-2f75f4d5e27a admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:45.619583 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cdf8bd-4409-4d2d-abf1-2f75f4d5e27a admin admin] PATH_INFO: `/v3/projects` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:45.620197 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cdf8bd-4409-4d2d-abf1-2f75f4d5e27a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:55:45.622069 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cdf8bd-4409-4d2d-abf1-2f75f4d5e27a admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:55:45.628944 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 938/1873] 10.222.0.57 () {58 vars in 1122 bytes} [Fri Sep 16 07:55:45 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 07:55:45.632987 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be44344d-f06f-47c4-954b-0496ff7bf355 admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:55:45.645008 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be44344d-f06f-47c4-954b-0496ff7bf355 admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:55:45.650419 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14704971-4321-4775-ae9b-ba1b4b61fa26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:55:45.651089 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14704971-4321-4775-ae9b-ba1b4b61fa26 admin admin] REQUEST_METHOD: `PUT` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:45.651578 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14704971-4321-4775-ae9b-ba1b4b61fa26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:45.651997 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14704971-4321-4775-ae9b-ba1b4b61fa26 admin admin] PATH_INFO: `/v3/projects/ae277b6c32504a40a522b888c1b0dc5b/users/020909438a184ee5bac102608eaac871/roles/4818d38cf2564825b312e66c9eb24762` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:45.659581 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 936/1874] 10.222.0.57 () {60 vars in 1153 bytes} [Fri Sep 16 07:55:45 2022] POST /identity/v3/projects => generated 391 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 16 07:55:45.663582 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cdf8bd-4409-4d2d-abf1-2f75f4d5e27a admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:55:45.666833 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14704971-4321-4775-ae9b-ba1b4b61fa26 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae277b6c32504a40a522b888c1b0dc5b, user_id=020909438a184ee5bac102608eaac871, role_id=4818d38cf2564825b312e66c9eb24762)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:55:45.669515 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14704971-4321-4775-ae9b-ba1b4b61fa26 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:55:45.683647 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 939/1875] 10.222.0.57 () {60 vars in 1483 bytes} [Fri Sep 16 07:55:45 2022] PUT /identity/v3/projects/ae277b6c32504a40a522b888c1b0dc5b/users/020909438a184ee5bac102608eaac871/roles/4818d38cf2564825b312e66c9eb24762 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 16 07:55:45.694407 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd0e7ae-05fe-4ad3-8688-75953d9a4f07 None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:45.694694 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd0e7ae-05fe-4ad3-8688-75953d9a4f07 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:45.694968 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd0e7ae-05fe-4ad3-8688-75953d9a4f07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:45.726176 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-2cd0e7ae-05fe-4ad3-8688-75953d9a4f07 None None] MFA Rules not processed for user `020909438a184ee5bac102608eaac871`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:55:45.726792 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cdf8bd-4409-4d2d-abf1-2f75f4d5e27a admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:55:45.727391 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-2cd0e7ae-05fe-4ad3-8688-75953d9a4f07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:55:45.730375 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:55:45.786937 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdd7500-0bd8-43e8-b1cf-783239501fab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:55:45.787369 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdd7500-0bd8-43e8-b1cf-783239501fab admin admin] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:45.787656 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdd7500-0bd8-43e8-b1cf-783239501fab admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:45.787933 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdd7500-0bd8-43e8-b1cf-783239501fab admin admin] PATH_INFO: `/v3/users` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:45.788682 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdd7500-0bd8-43e8-b1cf-783239501fab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:55:45.790708 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdd7500-0bd8-43e8-b1cf-783239501fab admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:55:45.798689 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 940/1876] 10.222.0.57 () {58 vars in 958 bytes} [Fri Sep 16 07:55:45 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 07:55:45.804359 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd0e7ae-05fe-4ad3-8688-75953d9a4f07 None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:55:45.824625 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd0e7ae-05fe-4ad3-8688-75953d9a4f07 None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:55:45.826404 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 937/1877] 10.222.0.57 () {60 vars in 1144 bytes} [Fri Sep 16 07:55:45 2022] POST /identity/v3/users => generated 296 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 16 07:55:45.827310 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdd7500-0bd8-43e8-b1cf-783239501fab admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:55:45.831320 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3aebc0d-ac21-4757-80d4-3f7136fe3d62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:55:45.832350 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3aebc0d-ac21-4757-80d4-3f7136fe3d62 admin admin] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:45.832864 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3aebc0d-ac21-4757-80d4-3f7136fe3d62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:45.833857 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3aebc0d-ac21-4757-80d4-3f7136fe3d62 admin admin] PATH_INFO: `/v3/projects` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:45.834864 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3aebc0d-ac21-4757-80d4-3f7136fe3d62 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:55:45.836884 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3aebc0d-ac21-4757-80d4-3f7136fe3d62 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:55:45.839387 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdd7500-0bd8-43e8-b1cf-783239501fab admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:55:45.844738 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ffce7b-d50b-42b2-8370-32d7c4406e7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:55:45.845342 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ffce7b-d50b-42b2-8370-32d7c4406e7f admin admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:45.845819 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ffce7b-d50b-42b2-8370-32d7c4406e7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:45.846099 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ffce7b-d50b-42b2-8370-32d7c4406e7f admin admin] PATH_INFO: `/v3/roles` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:45.846794 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ffce7b-d50b-42b2-8370-32d7c4406e7f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:55:45.848500 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ffce7b-d50b-42b2-8370-32d7c4406e7f admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:55:45.871580 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 941/1878] 10.222.0.57 () {60 vars in 1153 bytes} [Fri Sep 16 07:55:45 2022] POST /identity/v3/projects => generated 367 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 07:55:45.880029 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 938/1879] 10.222.0.57 () {58 vars in 1122 bytes} [Fri Sep 16 07:55:45 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 07:55:45.883327 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3aebc0d-ac21-4757-80d4-3f7136fe3d62 admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:55:45.887031 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ffce7b-d50b-42b2-8370-32d7c4406e7f admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:55:45.901530 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ffce7b-d50b-42b2-8370-32d7c4406e7f admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:55:45.948231 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:55:45.984989 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3aebc0d-ac21-4757-80d4-3f7136fe3d62 admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:55:45.991082 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0a7e4a-d885-4b76-a24c-a54aea1ee68f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:55:45.991701 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0a7e4a-d885-4b76-a24c-a54aea1ee68f admin admin] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:45.992479 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0a7e4a-d885-4b76-a24c-a54aea1ee68f admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:45.992479 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0a7e4a-d885-4b76-a24c-a54aea1ee68f admin admin] PATH_INFO: `/v3/users` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:45.992864 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0a7e4a-d885-4b76-a24c-a54aea1ee68f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:55:45.995236 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0a7e4a-d885-4b76-a24c-a54aea1ee68f admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:55:46.003992 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ef590c-0bfb-4a54-b276-abf1e1f9af7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:55:46.003992 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ef590c-0bfb-4a54-b276-abf1e1f9af7a admin admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:46.004690 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ef590c-0bfb-4a54-b276-abf1e1f9af7a admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:46.004690 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ef590c-0bfb-4a54-b276-abf1e1f9af7a admin admin] PATH_INFO: `/v3/roles` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:46.005760 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ef590c-0bfb-4a54-b276-abf1e1f9af7a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:55:46.007258 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ef590c-0bfb-4a54-b276-abf1e1f9af7a admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:55:46.020594 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 939/1880] 10.222.0.57 () {58 vars in 1122 bytes} [Fri Sep 16 07:55:45 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 07:55:46.024473 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ef590c-0bfb-4a54-b276-abf1e1f9af7a admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:55:46.035621 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 942/1881] 10.222.0.57 () {60 vars in 1144 bytes} [Fri Sep 16 07:55:45 2022] POST /identity/v3/users => generated 290 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 07:55:46.038847 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0a7e4a-d885-4b76-a24c-a54aea1ee68f admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:55:46.042263 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ef590c-0bfb-4a54-b276-abf1e1f9af7a admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:55:46.047114 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c3c6a3-641b-4262-894e-44038a0ff8e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:55:46.047842 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c3c6a3-641b-4262-894e-44038a0ff8e6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:46.048127 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c3c6a3-641b-4262-894e-44038a0ff8e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:46.049338 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c3c6a3-641b-4262-894e-44038a0ff8e6 admin admin] PATH_INFO: `/v3/projects/30b82803b0fe483e963766e2e3c65506/users/6538241d5dbd4dc985796ea8eb284098/roles/4818d38cf2564825b312e66c9eb24762` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:46.056678 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0a7e4a-d885-4b76-a24c-a54aea1ee68f admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:55:46.061383 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4387e686-0a47-4768-837b-295ebc4120aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:55:46.062023 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4387e686-0a47-4768-837b-295ebc4120aa admin admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:46.062341 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4387e686-0a47-4768-837b-295ebc4120aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:46.062611 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4387e686-0a47-4768-837b-295ebc4120aa admin admin] PATH_INFO: `/v3/roles` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:46.063271 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4387e686-0a47-4768-837b-295ebc4120aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:55:46.065494 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4387e686-0a47-4768-837b-295ebc4120aa admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:55:46.071098 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c3c6a3-641b-4262-894e-44038a0ff8e6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=30b82803b0fe483e963766e2e3c65506, user_id=6538241d5dbd4dc985796ea8eb284098, role_id=4818d38cf2564825b312e66c9eb24762)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:55:46.073927 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c3c6a3-641b-4262-894e-44038a0ff8e6 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:55:46.076206 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 943/1882] 10.222.0.57 () {58 vars in 1122 bytes} [Fri Sep 16 07:55:46 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 16 07:55:46.080628 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4387e686-0a47-4768-837b-295ebc4120aa admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:55:46.091608 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 940/1883] 10.222.0.57 () {60 vars in 1483 bytes} [Fri Sep 16 07:55:46 2022] PUT /identity/v3/projects/30b82803b0fe483e963766e2e3c65506/users/6538241d5dbd4dc985796ea8eb284098/roles/4818d38cf2564825b312e66c9eb24762 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 07:55:46.091935 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4387e686-0a47-4768-837b-295ebc4120aa admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:55:46.103347 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f9c410-886d-4d9f-a559-6f92ae7fce7c None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:46.103591 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f9c410-886d-4d9f-a559-6f92ae7fce7c None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:46.103867 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f9c410-886d-4d9f-a559-6f92ae7fce7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:46.136279 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-92f9c410-886d-4d9f-a559-6f92ae7fce7c None None] MFA Rules not processed for user `6538241d5dbd4dc985796ea8eb284098`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:55:46.137653 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-92f9c410-886d-4d9f-a559-6f92ae7fce7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:55:46.194018 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed65b641-86d2-42d3-a76b-99021e519243 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:55:46.194816 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed65b641-86d2-42d3-a76b-99021e519243 admin admin] REQUEST_METHOD: `PUT` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:46.194962 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed65b641-86d2-42d3-a76b-99021e519243 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:46.195209 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed65b641-86d2-42d3-a76b-99021e519243 admin admin] PATH_INFO: `/v3/projects/61ba026817d747bfa5f78018e985d6cd/users/9b6f2327c42c41de82b86b619b146089/roles/567db03c91854ad9af1e9a87ec1bd275` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:46.207208 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:55:46.218684 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed65b641-86d2-42d3-a76b-99021e519243 admin admin] RBAC: Authorizing `identity:create_grant(project_id=61ba026817d747bfa5f78018e985d6cd, user_id=9b6f2327c42c41de82b86b619b146089, role_id=567db03c91854ad9af1e9a87ec1bd275)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:55:46.222457 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed65b641-86d2-42d3-a76b-99021e519243 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:55:46.244543 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 941/1884] 10.222.0.57 () {58 vars in 958 bytes} [Fri Sep 16 07:55:46 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 07:55:46.251436 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 944/1885] 10.222.0.57 () {60 vars in 1483 bytes} [Fri Sep 16 07:55:46 2022] PUT /identity/v3/projects/61ba026817d747bfa5f78018e985d6cd/users/9b6f2327c42c41de82b86b619b146089/roles/567db03c91854ad9af1e9a87ec1bd275 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 16 07:55:46.254923 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f9c410-886d-4d9f-a559-6f92ae7fce7c None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:55:46.256178 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed65b641-86d2-42d3-a76b-99021e519243 admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:55:46.265179 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f9c410-886d-4d9f-a559-6f92ae7fce7c None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:55:46.340577 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed65b641-86d2-42d3-a76b-99021e519243 admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:55:46.343111 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c18031b-5848-4474-97bf-d05f313aca9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:55:46.343974 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c18031b-5848-4474-97bf-d05f313aca9d admin admin] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:46.344274 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c18031b-5848-4474-97bf-d05f313aca9d admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:46.344700 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c18031b-5848-4474-97bf-d05f313aca9d admin admin] PATH_INFO: `/v3/projects` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:46.346056 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c18031b-5848-4474-97bf-d05f313aca9d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:55:46.346580 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e437f0c3-ab7a-440c-8a8c-05352af60b7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:55:46.347554 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e437f0c3-ab7a-440c-8a8c-05352af60b7a admin admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:46.347891 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e437f0c3-ab7a-440c-8a8c-05352af60b7a admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:46.348123 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e437f0c3-ab7a-440c-8a8c-05352af60b7a admin admin] PATH_INFO: `/v3/roles` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:46.348625 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c18031b-5848-4474-97bf-d05f313aca9d admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:55:46.349269 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e437f0c3-ab7a-440c-8a8c-05352af60b7a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:55:46.351140 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e437f0c3-ab7a-440c-8a8c-05352af60b7a admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:55:46.366562 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 945/1886] 10.222.0.57 () {58 vars in 1122 bytes} [Fri Sep 16 07:55:46 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 07:55:46.367809 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e437f0c3-ab7a-440c-8a8c-05352af60b7a admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:55:46.379084 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e437f0c3-ab7a-440c-8a8c-05352af60b7a admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:55:46.380611 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 942/1887] 10.222.0.57 () {60 vars in 1153 bytes} [Fri Sep 16 07:55:46 2022] POST /identity/v3/projects => generated 393 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 07:55:46.386631 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c18031b-5848-4474-97bf-d05f313aca9d admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:55:46.433446 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:55:46.453107 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f06f6c3-4155-420d-81ae-bb44fed2fce6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:55:46.453966 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f06f6c3-4155-420d-81ae-bb44fed2fce6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:46.454255 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f06f6c3-4155-420d-81ae-bb44fed2fce6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:46.454530 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f06f6c3-4155-420d-81ae-bb44fed2fce6 admin admin] PATH_INFO: `/v3/projects/61ba026817d747bfa5f78018e985d6cd/users/9b6f2327c42c41de82b86b619b146089/roles/567db03c91854ad9af1e9a87ec1bd275` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:46.459297 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f06f6c3-4155-420d-81ae-bb44fed2fce6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=61ba026817d747bfa5f78018e985d6cd, user_id=9b6f2327c42c41de82b86b619b146089, role_id=567db03c91854ad9af1e9a87ec1bd275)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:55:46.461981 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f06f6c3-4155-420d-81ae-bb44fed2fce6 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:55:46.475813 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 946/1888] 10.222.0.57 () {60 vars in 1483 bytes} [Fri Sep 16 07:55:46 2022] PUT /identity/v3/projects/61ba026817d747bfa5f78018e985d6cd/users/9b6f2327c42c41de82b86b619b146089/roles/567db03c91854ad9af1e9a87ec1bd275 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 07:55:46.477771 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c18031b-5848-4474-97bf-d05f313aca9d admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:55:46.487546 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6cf4b3-ebc3-4f51-9cfa-c50b93e2e3ab None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:46.487931 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6cf4b3-ebc3-4f51-9cfa-c50b93e2e3ab None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:46.488215 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6cf4b3-ebc3-4f51-9cfa-c50b93e2e3ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:46.518856 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-9c6cf4b3-ebc3-4f51-9cfa-c50b93e2e3ab None None] MFA Rules not processed for user `9b6f2327c42c41de82b86b619b146089`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:55:46.520209 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-9c6cf4b3-ebc3-4f51-9cfa-c50b93e2e3ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:55:46.553765 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669685b5-3654-49e6-9a03-388a5162f3dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:55:46.554395 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669685b5-3654-49e6-9a03-388a5162f3dd admin admin] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:46.554675 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669685b5-3654-49e6-9a03-388a5162f3dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:46.556047 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669685b5-3654-49e6-9a03-388a5162f3dd admin admin] PATH_INFO: `/v3/users` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:46.556703 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669685b5-3654-49e6-9a03-388a5162f3dd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:55:46.559548 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669685b5-3654-49e6-9a03-388a5162f3dd admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:55:46.593748 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 943/1889] 10.222.0.57 () {60 vars in 1144 bytes} [Fri Sep 16 07:55:46 2022] POST /identity/v3/users => generated 303 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 07:55:46.598372 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669685b5-3654-49e6-9a03-388a5162f3dd admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:55:46.610889 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669685b5-3654-49e6-9a03-388a5162f3dd admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:55:46.618622 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369b4fea-f826-4c76-822d-19e9bb1467d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:55:46.621429 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 947/1890] 10.222.0.57 () {58 vars in 958 bytes} [Fri Sep 16 07:55:46 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 16 07:55:46.622503 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369b4fea-f826-4c76-822d-19e9bb1467d3 admin admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:46.622792 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369b4fea-f826-4c76-822d-19e9bb1467d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:46.623065 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369b4fea-f826-4c76-822d-19e9bb1467d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:46.623932 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369b4fea-f826-4c76-822d-19e9bb1467d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:55:46.625529 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369b4fea-f826-4c76-822d-19e9bb1467d3 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:55:46.628479 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:55:46.633971 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6cf4b3-ebc3-4f51-9cfa-c50b93e2e3ab None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:55:46.636351 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-9c6cf4b3-ebc3-4f51-9cfa-c50b93e2e3ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:55:46.644557 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 944/1891] 10.222.0.57 () {58 vars in 1122 bytes} [Fri Sep 16 07:55:46 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 16 07:55:46.645444 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369b4fea-f826-4c76-822d-19e9bb1467d3 admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:55:46.657082 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369b4fea-f826-4c76-822d-19e9bb1467d3 admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:55:46.664283 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd546a1-12bb-4562-94cc-022343809e01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:55:46.665210 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd546a1-12bb-4562-94cc-022343809e01 admin admin] REQUEST_METHOD: `PUT` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:46.665767 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd546a1-12bb-4562-94cc-022343809e01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:46.666270 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd546a1-12bb-4562-94cc-022343809e01 admin admin] PATH_INFO: `/v3/projects/eff33feb39fd4aa288279e4eab944a6e/users/abea64d2e2f84e49a0097261a9813fff/roles/567db03c91854ad9af1e9a87ec1bd275` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:46.683336 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd546a1-12bb-4562-94cc-022343809e01 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eff33feb39fd4aa288279e4eab944a6e, user_id=abea64d2e2f84e49a0097261a9813fff, role_id=567db03c91854ad9af1e9a87ec1bd275)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:55:46.686613 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd546a1-12bb-4562-94cc-022343809e01 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:55:46.702898 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6cf4b3-ebc3-4f51-9cfa-c50b93e2e3ab None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:55:46.704243 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 945/1892] 10.222.0.57 () {60 vars in 1483 bytes} [Fri Sep 16 07:55:46 2022] PUT /identity/v3/projects/eff33feb39fd4aa288279e4eab944a6e/users/abea64d2e2f84e49a0097261a9813fff/roles/567db03c91854ad9af1e9a87ec1bd275 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 07:55:46.708995 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd546a1-12bb-4562-94cc-022343809e01 admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:55:46.765984 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3091e567-a26e-41ad-bdeb-d6108cbe3668 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544bf6be4c24454a013ca110c43cef2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4735f453c0c24cc4a1c14e9ac84a0b46', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:55:46.766592 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3091e567-a26e-41ad-bdeb-d6108cbe3668 service cinder] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:46.766908 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3091e567-a26e-41ad-bdeb-d6108cbe3668 service cinder] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:46.767802 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3091e567-a26e-41ad-bdeb-d6108cbe3668 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:46.778404 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd546a1-12bb-4562-94cc-022343809e01 admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:55:46.784144 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41bc79d-eabb-41b0-a412-dbac54b995d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:55:46.784750 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41bc79d-eabb-41b0-a412-dbac54b995d4 admin admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:46.785031 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41bc79d-eabb-41b0-a412-dbac54b995d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:46.785307 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41bc79d-eabb-41b0-a412-dbac54b995d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:46.785990 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41bc79d-eabb-41b0-a412-dbac54b995d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:55:46.787583 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41bc79d-eabb-41b0-a412-dbac54b995d4 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:55:46.797741 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 946/1893] 10.222.0.57 () {58 vars in 1122 bytes} [Fri Sep 16 07:55:46 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 16 07:55:46.798636 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:55:46.802044 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41bc79d-eabb-41b0-a412-dbac54b995d4 admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:55:46.813001 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41bc79d-eabb-41b0-a412-dbac54b995d4 admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:55:46.818307 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc053881-43d4-45c8-bfcc-afe301d9d9dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:55:46.818959 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc053881-43d4-45c8-bfcc-afe301d9d9dd admin admin] REQUEST_METHOD: `PUT` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:46.819238 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc053881-43d4-45c8-bfcc-afe301d9d9dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:46.819591 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc053881-43d4-45c8-bfcc-afe301d9d9dd admin admin] PATH_INFO: `/v3/projects/eff33feb39fd4aa288279e4eab944a6e/users/abea64d2e2f84e49a0097261a9813fff/roles/567db03c91854ad9af1e9a87ec1bd275` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:46.821491 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc053881-43d4-45c8-bfcc-afe301d9d9dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=eff33feb39fd4aa288279e4eab944a6e, user_id=abea64d2e2f84e49a0097261a9813fff, role_id=567db03c91854ad9af1e9a87ec1bd275)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:55:46.824146 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc053881-43d4-45c8-bfcc-afe301d9d9dd admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:55:46.833168 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3091e567-a26e-41ad-bdeb-d6108cbe3668 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:55:46.834774 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3091e567-a26e-41ad-bdeb-d6108cbe3668 service cinder] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:55:46.835817 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 947/1894] 10.222.0.57 () {60 vars in 1483 bytes} [Fri Sep 16 07:55:46 2022] PUT /identity/v3/projects/eff33feb39fd4aa288279e4eab944a6e/users/abea64d2e2f84e49a0097261a9813fff/roles/567db03c91854ad9af1e9a87ec1bd275 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 07:55:46.844635 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 948/1895] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Sep 16 07:55:46 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 07:55:46.846480 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d168753-6ed9-403f-943d-844f7a87c041 None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:46.846804 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d168753-6ed9-403f-943d-844f7a87c041 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:46.847146 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d168753-6ed9-403f-943d-844f7a87c041 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:46.877737 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-6d168753-6ed9-403f-943d-844f7a87c041 None None] MFA Rules not processed for user `abea64d2e2f84e49a0097261a9813fff`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:55:46.878987 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-6d168753-6ed9-403f-943d-844f7a87c041 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:55:46.890102 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3091e567-a26e-41ad-bdeb-d6108cbe3668 service cinder] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:55:46.891464 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-3091e567-a26e-41ad-bdeb-d6108cbe3668 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:55:46.902661 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3091e567-a26e-41ad-bdeb-d6108cbe3668 service cinder] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:55:46.950520 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 948/1896] 10.222.0.57 () {58 vars in 958 bytes} [Fri Sep 16 07:55:46 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 16 07:55:46.955594 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec9893c-6500-4efb-baa9-4e259be448f3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544bf6be4c24454a013ca110c43cef2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4735f453c0c24cc4a1c14e9ac84a0b46', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:55:46.956206 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec9893c-6500-4efb-baa9-4e259be448f3 service cinder] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:46.956517 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec9893c-6500-4efb-baa9-4e259be448f3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:46.956729 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec9893c-6500-4efb-baa9-4e259be448f3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:46.961987 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d168753-6ed9-403f-943d-844f7a87c041 None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:55:46.972254 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d168753-6ed9-403f-943d-844f7a87c041 None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:55:46.975927 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac917c03-7042-4c10-a6ee-313a32ef4b02 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544bf6be4c24454a013ca110c43cef2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4735f453c0c24cc4a1c14e9ac84a0b46', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:55:46.976519 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac917c03-7042-4c10-a6ee-313a32ef4b02 service cinder] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:46.976808 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac917c03-7042-4c10-a6ee-313a32ef4b02 service cinder] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:46.977083 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac917c03-7042-4c10-a6ee-313a32ef4b02 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:46.986958 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac917c03-7042-4c10-a6ee-313a32ef4b02 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:55:46.988465 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac917c03-7042-4c10-a6ee-313a32ef4b02 service cinder] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:55:46.998526 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 949/1897] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Sep 16 07:55:46 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 07:55:47.016161 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec9893c-6500-4efb-baa9-4e259be448f3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:55:47.018187 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec9893c-6500-4efb-baa9-4e259be448f3 service cinder] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:55:47.027344 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 949/1898] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Sep 16 07:55:46 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 16 07:55:47.068674 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac917c03-7042-4c10-a6ee-313a32ef4b02 service cinder] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:55:47.078052 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac917c03-7042-4c10-a6ee-313a32ef4b02 service cinder] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:55:47.087515 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145efad4-7a01-4150-a4a5-ee3e03297550 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544bf6be4c24454a013ca110c43cef2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4735f453c0c24cc4a1c14e9ac84a0b46', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:55:47.088825 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145efad4-7a01-4150-a4a5-ee3e03297550 service cinder] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:47.089162 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145efad4-7a01-4150-a4a5-ee3e03297550 service cinder] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:47.089378 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145efad4-7a01-4150-a4a5-ee3e03297550 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:47.126104 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:55:47.166919 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145efad4-7a01-4150-a4a5-ee3e03297550 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:55:47.168493 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145efad4-7a01-4150-a4a5-ee3e03297550 service cinder] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:55:47.180099 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 950/1899] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Sep 16 07:55:47 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 07:55:50.687204 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec9893c-6500-4efb-baa9-4e259be448f3 service cinder] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:55:50.689366 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-8ec9893c-6500-4efb-baa9-4e259be448f3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:55:50.847669 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec9893c-6500-4efb-baa9-4e259be448f3 service cinder] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:55:50.866394 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe60459-4045-4368-a986-0cf0090b4e42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:55:50.867179 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe60459-4045-4368-a986-0cf0090b4e42 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:50.867538 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe60459-4045-4368-a986-0cf0090b4e42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:50.867887 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe60459-4045-4368-a986-0cf0090b4e42 admin admin] PATH_INFO: `/v3/users/d15cbda643da4046be92fde98900736b` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:50.869573 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe60459-4045-4368-a986-0cf0090b4e42 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d15cbda643da4046be92fde98900736b)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:55:50.871671 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe60459-4045-4368-a986-0cf0090b4e42 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:55:50.928155 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:55:50.986941 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9b1a67-02f4-4f15-911b-38b5139eafae None None] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:50.988249 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9b1a67-02f4-4f15-911b-38b5139eafae None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:50.988547 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9b1a67-02f4-4f15-911b-38b5139eafae None None] PATH_INFO: `/` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:50.989405 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-6fe60459-4045-4368-a986-0cf0090b4e42 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd15cbda643da4046be92fde98900736b'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:55:50.989949 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 951/1900] 10.222.0.57 () {54 vars in 921 bytes} [Fri Sep 16 07:55:50 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 07:55:51.008584 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a401e630-6b3d-4869-85ad-a17b5840349d None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:51.009033 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a401e630-6b3d-4869-85ad-a17b5840349d None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:51.009385 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a401e630-6b3d-4869-85ad-a17b5840349d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:51.018848 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-6fe60459-4045-4368-a986-0cf0090b4e42 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd15cbda643da4046be92fde98900736b'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:55:51.025779 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-6fe60459-4045-4368-a986-0cf0090b4e42 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd15cbda643da4046be92fde98900736b'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:55:51.038945 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-6fe60459-4045-4368-a986-0cf0090b4e42 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd15cbda643da4046be92fde98900736b'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:55:51.054160 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-6fe60459-4045-4368-a986-0cf0090b4e42 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd15cbda643da4046be92fde98900736b'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:55:51.058218 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-a401e630-6b3d-4869-85ad-a17b5840349d None None] MFA Rules not processed for user `9bec4d9b08514461a1bf63c6b88f53b2`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:55:51.059885 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-a401e630-6b3d-4869-85ad-a17b5840349d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:55:51.071445 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 950/1901] 10.222.0.57 () {58 vars in 1224 bytes} [Fri Sep 16 07:55:50 2022] DELETE /identity/v3/users/d15cbda643da4046be92fde98900736b => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 07:55:51.076112 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5000e3c-8650-48b6-9d17-936b5837c66a None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:51.076464 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5000e3c-8650-48b6-9d17-936b5837c66a None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:51.077037 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5000e3c-8650-48b6-9d17-936b5837c66a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:51.135180 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-a5000e3c-8650-48b6-9d17-936b5837c66a None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:55:51.142283 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-a5000e3c-8650-48b6-9d17-936b5837c66a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:55:51.267852 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 952/1902] 10.222.0.57 () {58 vars in 1018 bytes} [Fri Sep 16 07:55:51 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 16 07:55:51.307927 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 951/1903] 10.222.0.57 () {58 vars in 958 bytes} [Fri Sep 16 07:55:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 16 07:55:51.340342 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a401e630-6b3d-4869-85ad-a17b5840349d None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:55:51.342124 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-a401e630-6b3d-4869-85ad-a17b5840349d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:55:51.502454 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5000e3c-8650-48b6-9d17-936b5837c66a None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:55:51.504578 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-a5000e3c-8650-48b6-9d17-936b5837c66a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:55:51.526273 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5000e3c-8650-48b6-9d17-936b5837c66a None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:55:51.531727 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a401e630-6b3d-4869-85ad-a17b5840349d None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:55:51.540059 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53436817-956f-49a4-9bdb-b31a0223e5f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:55:51.540833 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53436817-956f-49a4-9bdb-b31a0223e5f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:51.541178 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53436817-956f-49a4-9bdb-b31a0223e5f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:51.541563 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53436817-956f-49a4-9bdb-b31a0223e5f7 admin admin] PATH_INFO: `/v3/users/020909438a184ee5bac102608eaac871` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:51.544866 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53436817-956f-49a4-9bdb-b31a0223e5f7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=020909438a184ee5bac102608eaac871)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:55:51.550747 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53436817-956f-49a4-9bdb-b31a0223e5f7 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:55:51.650744 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-53436817-956f-49a4-9bdb-b31a0223e5f7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '020909438a184ee5bac102608eaac871'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:55:51.654679 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e69781d-0fea-4df9-ac57-acfde895dc10 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1062e457207a41e4ba4f0a0c4bf36f1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4735f453c0c24cc4a1c14e9ac84a0b46', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:55:51.655226 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e69781d-0fea-4df9-ac57-acfde895dc10 service neutron] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:51.655514 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e69781d-0fea-4df9-ac57-acfde895dc10 service neutron] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:51.656113 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e69781d-0fea-4df9-ac57-acfde895dc10 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:51.667139 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-53436817-956f-49a4-9bdb-b31a0223e5f7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '020909438a184ee5bac102608eaac871'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:55:51.667882 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-53436817-956f-49a4-9bdb-b31a0223e5f7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '020909438a184ee5bac102608eaac871'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:55:51.679627 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-53436817-956f-49a4-9bdb-b31a0223e5f7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '020909438a184ee5bac102608eaac871'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:55:51.684992 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e69781d-0fea-4df9-ac57-acfde895dc10 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:55:51.687951 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e69781d-0fea-4df9-ac57-acfde895dc10 service neutron] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:55:51.689298 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-53436817-956f-49a4-9bdb-b31a0223e5f7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '020909438a184ee5bac102608eaac871'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:55:51.696231 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 952/1904] 10.222.0.57 () {58 vars in 1224 bytes} [Fri Sep 16 07:55:51 2022] DELETE /identity/v3/users/020909438a184ee5bac102608eaac871 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 16 07:55:51.697154 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53436817-956f-49a4-9bdb-b31a0223e5f7 admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:55:51.699710 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-53436817-956f-49a4-9bdb-b31a0223e5f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:55:51.727411 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 953/1905] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Sep 16 07:55:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 07:55:51.728745 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00975516-97fc-4afb-af7c-b61f8530ac56 None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:51.728952 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00975516-97fc-4afb-af7c-b61f8530ac56 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:51.729225 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00975516-97fc-4afb-af7c-b61f8530ac56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:51.738526 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:55:51.774595 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-00975516-97fc-4afb-af7c-b61f8530ac56 None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:55:51.780541 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-00975516-97fc-4afb-af7c-b61f8530ac56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:55:51.820273 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:55:51.837947 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53436817-956f-49a4-9bdb-b31a0223e5f7 admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:55:51.848619 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5545dcd8-ac32-4af0-b512-a2c8cb079727 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:55:51.849920 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5545dcd8-ac32-4af0-b512-a2c8cb079727 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:51.850304 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5545dcd8-ac32-4af0-b512-a2c8cb079727 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:51.851903 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5545dcd8-ac32-4af0-b512-a2c8cb079727 admin admin] PATH_INFO: `/v3/users/6538241d5dbd4dc985796ea8eb284098` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:51.853695 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5545dcd8-ac32-4af0-b512-a2c8cb079727 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6538241d5dbd4dc985796ea8eb284098)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:55:51.857019 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5545dcd8-ac32-4af0-b512-a2c8cb079727 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:55:51.961429 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 954/1906] 10.222.0.57 () {58 vars in 958 bytes} [Fri Sep 16 07:55:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 07:55:51.961974 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-5545dcd8-ac32-4af0-b512-a2c8cb079727 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6538241d5dbd4dc985796ea8eb284098'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:55:51.963657 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00975516-97fc-4afb-af7c-b61f8530ac56 None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:55:51.967508 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-00975516-97fc-4afb-af7c-b61f8530ac56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:55:51.984444 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-5545dcd8-ac32-4af0-b512-a2c8cb079727 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6538241d5dbd4dc985796ea8eb284098'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:55:51.985261 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-5545dcd8-ac32-4af0-b512-a2c8cb079727 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6538241d5dbd4dc985796ea8eb284098'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:55:51.998099 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-5545dcd8-ac32-4af0-b512-a2c8cb079727 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6538241d5dbd4dc985796ea8eb284098'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:55:52.009258 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-5545dcd8-ac32-4af0-b512-a2c8cb079727 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6538241d5dbd4dc985796ea8eb284098'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:55:52.021051 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 953/1907] 10.222.0.57 () {58 vars in 1224 bytes} [Fri Sep 16 07:55:51 2022] DELETE /identity/v3/users/6538241d5dbd4dc985796ea8eb284098 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 07:55:52.026510 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5545dcd8-ac32-4af0-b512-a2c8cb079727 admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:55:52.028610 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-5545dcd8-ac32-4af0-b512-a2c8cb079727 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:55:52.103670 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00975516-97fc-4afb-af7c-b61f8530ac56 None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:55:52.136807 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5545dcd8-ac32-4af0-b512-a2c8cb079727 admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:55:52.140778 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f93fcd-3efb-4ebb-a2cd-9ab9435a63b5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1062e457207a41e4ba4f0a0c4bf36f1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4735f453c0c24cc4a1c14e9ac84a0b46', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:55:52.141395 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f93fcd-3efb-4ebb-a2cd-9ab9435a63b5 service neutron] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:52.141667 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f93fcd-3efb-4ebb-a2cd-9ab9435a63b5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:52.142569 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f93fcd-3efb-4ebb-a2cd-9ab9435a63b5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:52.145003 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-c9f93fcd-3efb-4ebb-a2cd-9ab9435a63b5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:55:52.201638 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:55:52.204071 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062ffca8-6a2b-42eb-bd80-04b26a438317 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bec4d9b08514461a1bf63c6b88f53b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4735f453c0c24cc4a1c14e9ac84a0b46', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:55:52.205746 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062ffca8-6a2b-42eb-bd80-04b26a438317 service nova] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:52.206006 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062ffca8-6a2b-42eb-bd80-04b26a438317 service nova] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:52.206354 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062ffca8-6a2b-42eb-bd80-04b26a438317 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:52.209166 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-062ffca8-6a2b-42eb-bd80-04b26a438317 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:55:52.234979 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062ffca8-6a2b-42eb-bd80-04b26a438317 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:55:52.237598 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062ffca8-6a2b-42eb-bd80-04b26a438317 service nova] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:55:52.240754 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f93fcd-3efb-4ebb-a2cd-9ab9435a63b5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:55:52.240754 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f93fcd-3efb-4ebb-a2cd-9ab9435a63b5 service neutron] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:55:52.259251 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 954/1908] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Sep 16 07:55:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 07:55:52.260835 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b7d446-6382-4426-b82d-ae254d903e5e None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:52.261604 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b7d446-6382-4426-b82d-ae254d903e5e None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:52.261604 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b7d446-6382-4426-b82d-ae254d903e5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:52.268622 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 955/1909] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Sep 16 07:55:51 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 07:55:52.269608 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062ffca8-6a2b-42eb-bd80-04b26a438317 service nova] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:55:52.272273 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-062ffca8-6a2b-42eb-bd80-04b26a438317 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:55:52.304918 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062ffca8-6a2b-42eb-bd80-04b26a438317 service nova] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:55:52.311382 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-e3b7d446-6382-4426-b82d-ae254d903e5e None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:55:52.311824 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78824b66-27b8-4520-a3d0-241eb67638c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:55:52.312470 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78824b66-27b8-4520-a3d0-241eb67638c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:52.312584 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-e3b7d446-6382-4426-b82d-ae254d903e5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:55:52.312747 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78824b66-27b8-4520-a3d0-241eb67638c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:52.313019 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78824b66-27b8-4520-a3d0-241eb67638c1 admin admin] PATH_INFO: `/v3/projects/787164464e42427cbf2a912d3a1c4812` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:52.316480 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78824b66-27b8-4520-a3d0-241eb67638c1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=787164464e42427cbf2a912d3a1c4812)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:55:52.318185 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78824b66-27b8-4520-a3d0-241eb67638c1 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:55:52.336708 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 955/1910] 10.222.0.57 () {58 vars in 958 bytes} [Fri Sep 16 07:55:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 07:55:52.354043 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b7d446-6382-4426-b82d-ae254d903e5e None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:55:52.375140 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b7d446-6382-4426-b82d-ae254d903e5e None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:55:52.386401 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:55:52.408546 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-78824b66-27b8-4520-a3d0-241eb67638c1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '787164464e42427cbf2a912d3a1c4812', 'request_id': 'req-78824b66-27b8-4520-a3d0-241eb67638c1'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:55:52.427200 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-78824b66-27b8-4520-a3d0-241eb67638c1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '787164464e42427cbf2a912d3a1c4812', 'request_id': 'req-78824b66-27b8-4520-a3d0-241eb67638c1'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:55:52.440637 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-78824b66-27b8-4520-a3d0-241eb67638c1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '787164464e42427cbf2a912d3a1c4812', 'request_id': 'req-78824b66-27b8-4520-a3d0-241eb67638c1'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:55:52.470714 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-78824b66-27b8-4520-a3d0-241eb67638c1 admin admin] The token cache is being invalidate because project 787164464e42427cbf2a912d3a1c4812 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81430) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 07:55:52.471992 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-78824b66-27b8-4520-a3d0-241eb67638c1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:55:52.473253 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-78824b66-27b8-4520-a3d0-241eb67638c1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:55:52.482385 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 956/1911] 10.222.0.57 () {58 vars in 1233 bytes} [Fri Sep 16 07:55:52 2022] DELETE /identity/v3/projects/787164464e42427cbf2a912d3a1c4812 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 07:55:52.483633 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78824b66-27b8-4520-a3d0-241eb67638c1 admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:55:52.489736 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-78824b66-27b8-4520-a3d0-241eb67638c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:55:52.540033 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c102197d-95ea-4f96-828a-c6d9d36263e4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1062e457207a41e4ba4f0a0c4bf36f1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4735f453c0c24cc4a1c14e9ac84a0b46', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:55:52.540734 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c102197d-95ea-4f96-828a-c6d9d36263e4 service neutron] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:52.541017 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c102197d-95ea-4f96-828a-c6d9d36263e4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:52.541285 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c102197d-95ea-4f96-828a-c6d9d36263e4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:52.543753 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-c102197d-95ea-4f96-828a-c6d9d36263e4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:55:52.640188 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78824b66-27b8-4520-a3d0-241eb67638c1 admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:55:52.653846 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cdbee6-10e4-45a8-8714-402c8e9d08b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:55:52.654514 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cdbee6-10e4-45a8-8714-402c8e9d08b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:52.654798 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cdbee6-10e4-45a8-8714-402c8e9d08b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:52.655076 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cdbee6-10e4-45a8-8714-402c8e9d08b3 admin admin] PATH_INFO: `/v3/users/9db41a6543924a109daef8af706bae39` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:52.657799 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61cdbee6-10e4-45a8-8714-402c8e9d08b3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9db41a6543924a109daef8af706bae39)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:55:52.660246 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61cdbee6-10e4-45a8-8714-402c8e9d08b3 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:55:52.713470 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c102197d-95ea-4f96-828a-c6d9d36263e4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:55:52.715839 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c102197d-95ea-4f96-828a-c6d9d36263e4 service neutron] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:55:52.756539 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 956/1912] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Sep 16 07:55:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 07:55:52.792060 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-61cdbee6-10e4-45a8-8714-402c8e9d08b3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9db41a6543924a109daef8af706bae39'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:55:52.794213 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-61cdbee6-10e4-45a8-8714-402c8e9d08b3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9db41a6543924a109daef8af706bae39'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:55:52.808044 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-61cdbee6-10e4-45a8-8714-402c8e9d08b3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9db41a6543924a109daef8af706bae39'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:55:52.855700 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-61cdbee6-10e4-45a8-8714-402c8e9d08b3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9db41a6543924a109daef8af706bae39'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:55:52.872300 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-61cdbee6-10e4-45a8-8714-402c8e9d08b3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9db41a6543924a109daef8af706bae39'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:55:52.894726 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 957/1913] 10.222.0.57 () {58 vars in 1224 bytes} [Fri Sep 16 07:55:52 2022] DELETE /identity/v3/users/9db41a6543924a109daef8af706bae39 => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 07:55:53.017762 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c102197d-95ea-4f96-828a-c6d9d36263e4 service neutron] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:55:53.019588 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-c102197d-95ea-4f96-828a-c6d9d36263e4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:55:53.042651 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c102197d-95ea-4f96-828a-c6d9d36263e4 service neutron] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:55:53.113890 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f46bd4c-fbd4-43b8-8cb9-eee15cecbd80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:55:53.114531 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f46bd4c-fbd4-43b8-8cb9-eee15cecbd80 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:53.114812 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f46bd4c-fbd4-43b8-8cb9-eee15cecbd80 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:53.115064 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f46bd4c-fbd4-43b8-8cb9-eee15cecbd80 admin admin] PATH_INFO: `/v3/projects/ae277b6c32504a40a522b888c1b0dc5b` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:53.116223 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f46bd4c-fbd4-43b8-8cb9-eee15cecbd80 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ae277b6c32504a40a522b888c1b0dc5b)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:55:53.118552 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f46bd4c-fbd4-43b8-8cb9-eee15cecbd80 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:55:53.154734 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:55:53.191398 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-0f46bd4c-fbd4-43b8-8cb9-eee15cecbd80 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ae277b6c32504a40a522b888c1b0dc5b', 'request_id': 'req-0f46bd4c-fbd4-43b8-8cb9-eee15cecbd80'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:55:53.199299 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-0f46bd4c-fbd4-43b8-8cb9-eee15cecbd80 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ae277b6c32504a40a522b888c1b0dc5b', 'request_id': 'req-0f46bd4c-fbd4-43b8-8cb9-eee15cecbd80'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:55:53.210247 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-0f46bd4c-fbd4-43b8-8cb9-eee15cecbd80 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ae277b6c32504a40a522b888c1b0dc5b', 'request_id': 'req-0f46bd4c-fbd4-43b8-8cb9-eee15cecbd80'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:55:53.225527 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-0f46bd4c-fbd4-43b8-8cb9-eee15cecbd80 admin admin] The token cache is being invalidate because project ae277b6c32504a40a522b888c1b0dc5b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81431) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 07:55:53.225966 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-0f46bd4c-fbd4-43b8-8cb9-eee15cecbd80 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:55:53.226703 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-0f46bd4c-fbd4-43b8-8cb9-eee15cecbd80 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:55:53.228372 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 957/1914] 10.222.0.57 () {58 vars in 1233 bytes} [Fri Sep 16 07:55:53 2022] DELETE /identity/v3/projects/ae277b6c32504a40a522b888c1b0dc5b => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 07:55:53.232711 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cdbee6-10e4-45a8-8714-402c8e9d08b3 admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:55:53.234353 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-61cdbee6-10e4-45a8-8714-402c8e9d08b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:55:53.249527 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cdbee6-10e4-45a8-8714-402c8e9d08b3 admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:55:53.297280 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:55:53.320217 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319c0b2c-d86d-472b-811b-f00e7317c381 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:55:53.321034 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319c0b2c-d86d-472b-811b-f00e7317c381 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:53.321396 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319c0b2c-d86d-472b-811b-f00e7317c381 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:53.321865 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319c0b2c-d86d-472b-811b-f00e7317c381 admin admin] PATH_INFO: `/v3/users/9b6f2327c42c41de82b86b619b146089` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:53.323102 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319c0b2c-d86d-472b-811b-f00e7317c381 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9b6f2327c42c41de82b86b619b146089)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:55:53.325352 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319c0b2c-d86d-472b-811b-f00e7317c381 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:55:53.370032 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f46bd4c-fbd4-43b8-8cb9-eee15cecbd80 admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:55:53.370032 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-0f46bd4c-fbd4-43b8-8cb9-eee15cecbd80 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:55:53.396494 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f46bd4c-fbd4-43b8-8cb9-eee15cecbd80 admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:55:53.402190 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2a093c-2079-4b3d-ad20-bbd26432d7a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:55:53.403012 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2a093c-2079-4b3d-ad20-bbd26432d7a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:53.403244 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-319c0b2c-d86d-472b-811b-f00e7317c381 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9b6f2327c42c41de82b86b619b146089'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:55:53.403351 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2a093c-2079-4b3d-ad20-bbd26432d7a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:53.403696 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2a093c-2079-4b3d-ad20-bbd26432d7a1 admin admin] PATH_INFO: `/v3/projects/30b82803b0fe483e963766e2e3c65506` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:53.404054 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-319c0b2c-d86d-472b-811b-f00e7317c381 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9b6f2327c42c41de82b86b619b146089'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:55:53.405576 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2a093c-2079-4b3d-ad20-bbd26432d7a1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=30b82803b0fe483e963766e2e3c65506)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:55:53.407707 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2a093c-2079-4b3d-ad20-bbd26432d7a1 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:55:53.413706 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-319c0b2c-d86d-472b-811b-f00e7317c381 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9b6f2327c42c41de82b86b619b146089'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:55:53.428565 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-319c0b2c-d86d-472b-811b-f00e7317c381 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9b6f2327c42c41de82b86b619b146089'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:55:53.437098 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-319c0b2c-d86d-472b-811b-f00e7317c381 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9b6f2327c42c41de82b86b619b146089'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:55:53.445986 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 958/1915] 10.222.0.57 () {58 vars in 1224 bytes} [Fri Sep 16 07:55:53 2022] DELETE /identity/v3/users/9b6f2327c42c41de82b86b619b146089 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 07:55:53.494507 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-2f2a093c-2079-4b3d-ad20-bbd26432d7a1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '30b82803b0fe483e963766e2e3c65506', 'request_id': 'req-2f2a093c-2079-4b3d-ad20-bbd26432d7a1'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:55:53.500875 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-2f2a093c-2079-4b3d-ad20-bbd26432d7a1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '30b82803b0fe483e963766e2e3c65506', 'request_id': 'req-2f2a093c-2079-4b3d-ad20-bbd26432d7a1'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:55:53.511595 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-2f2a093c-2079-4b3d-ad20-bbd26432d7a1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '30b82803b0fe483e963766e2e3c65506', 'request_id': 'req-2f2a093c-2079-4b3d-ad20-bbd26432d7a1'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:55:53.525861 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-2f2a093c-2079-4b3d-ad20-bbd26432d7a1 admin admin] The token cache is being invalidate because project 30b82803b0fe483e963766e2e3c65506 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81431) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 07:55:53.526603 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-2f2a093c-2079-4b3d-ad20-bbd26432d7a1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:55:53.527006 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-2f2a093c-2079-4b3d-ad20-bbd26432d7a1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:55:53.530427 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 958/1916] 10.222.0.57 () {58 vars in 1233 bytes} [Fri Sep 16 07:55:53 2022] DELETE /identity/v3/projects/30b82803b0fe483e963766e2e3c65506 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 07:55:53.533670 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319c0b2c-d86d-472b-811b-f00e7317c381 admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:55:53.535532 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-319c0b2c-d86d-472b-811b-f00e7317c381 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:55:53.615191 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319c0b2c-d86d-472b-811b-f00e7317c381 admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:55:53.668453 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2a093c-2079-4b3d-ad20-bbd26432d7a1 admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:55:53.670243 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-2f2a093c-2079-4b3d-ad20-bbd26432d7a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:55:53.718696 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee81bd0-ea81-4b7c-bbe5-fb3c3a953c3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:55:53.719414 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee81bd0-ea81-4b7c-bbe5-fb3c3a953c3d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:53.719702 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee81bd0-ea81-4b7c-bbe5-fb3c3a953c3d admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:53.720732 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee81bd0-ea81-4b7c-bbe5-fb3c3a953c3d admin admin] PATH_INFO: `/v3/users/abea64d2e2f84e49a0097261a9813fff` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:53.723433 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee81bd0-ea81-4b7c-bbe5-fb3c3a953c3d admin admin] RBAC: Authorizing `identity:delete_user(user_id=abea64d2e2f84e49a0097261a9813fff)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:55:53.725786 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee81bd0-ea81-4b7c-bbe5-fb3c3a953c3d admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:55:53.745403 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:55:53.818717 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2a093c-2079-4b3d-ad20-bbd26432d7a1 admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:55:53.824664 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03de3f28-8799-4b2d-9c8d-e75bc24e2b7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:55:53.825604 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03de3f28-8799-4b2d-9c8d-e75bc24e2b7d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:53.826057 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03de3f28-8799-4b2d-9c8d-e75bc24e2b7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:53.826427 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03de3f28-8799-4b2d-9c8d-e75bc24e2b7d admin admin] PATH_INFO: `/v3/projects/df7d4e79518246a0b98c73e3597da381` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:53.841957 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03de3f28-8799-4b2d-9c8d-e75bc24e2b7d admin admin] RBAC: Authorizing `identity:delete_project(project_id=df7d4e79518246a0b98c73e3597da381)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:55:53.844248 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03de3f28-8799-4b2d-9c8d-e75bc24e2b7d admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:55:53.869679 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-1ee81bd0-ea81-4b7c-bbe5-fb3c3a953c3d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'abea64d2e2f84e49a0097261a9813fff'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:55:53.870429 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-1ee81bd0-ea81-4b7c-bbe5-fb3c3a953c3d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'abea64d2e2f84e49a0097261a9813fff'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:55:53.895131 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-1ee81bd0-ea81-4b7c-bbe5-fb3c3a953c3d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'abea64d2e2f84e49a0097261a9813fff'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:55:53.924818 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-1ee81bd0-ea81-4b7c-bbe5-fb3c3a953c3d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'abea64d2e2f84e49a0097261a9813fff'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:55:53.947375 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-1ee81bd0-ea81-4b7c-bbe5-fb3c3a953c3d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'abea64d2e2f84e49a0097261a9813fff'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:55:53.951871 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:55:53.964643 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-03de3f28-8799-4b2d-9c8d-e75bc24e2b7d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'df7d4e79518246a0b98c73e3597da381', 'request_id': 'req-03de3f28-8799-4b2d-9c8d-e75bc24e2b7d'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:55:53.969386 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 959/1917] 10.222.0.57 () {58 vars in 1224 bytes} [Fri Sep 16 07:55:53 2022] DELETE /identity/v3/users/abea64d2e2f84e49a0097261a9813fff => generated 0 bytes in 430 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 16 07:55:53.991048 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-03de3f28-8799-4b2d-9c8d-e75bc24e2b7d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'df7d4e79518246a0b98c73e3597da381', 'request_id': 'req-03de3f28-8799-4b2d-9c8d-e75bc24e2b7d'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:55:54.001584 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-03de3f28-8799-4b2d-9c8d-e75bc24e2b7d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'df7d4e79518246a0b98c73e3597da381', 'request_id': 'req-03de3f28-8799-4b2d-9c8d-e75bc24e2b7d'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:55:54.022355 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-03de3f28-8799-4b2d-9c8d-e75bc24e2b7d admin admin] The token cache is being invalidate because project df7d4e79518246a0b98c73e3597da381 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81431) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 07:55:54.022914 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-03de3f28-8799-4b2d-9c8d-e75bc24e2b7d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:55:54.023607 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-03de3f28-8799-4b2d-9c8d-e75bc24e2b7d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:55:54.025645 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 959/1918] 10.222.0.57 () {58 vars in 1233 bytes} [Fri Sep 16 07:55:53 2022] DELETE /identity/v3/projects/df7d4e79518246a0b98c73e3597da381 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 16 07:55:54.030496 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cabe17c-920d-4431-abdc-fa052e9d68cb None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:54.030709 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cabe17c-920d-4431-abdc-fa052e9d68cb None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:54.031006 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cabe17c-920d-4431-abdc-fa052e9d68cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:54.050991 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03de3f28-8799-4b2d-9c8d-e75bc24e2b7d admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:55:54.054226 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-03de3f28-8799-4b2d-9c8d-e75bc24e2b7d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:55:54.061497 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-5cabe17c-920d-4431-abdc-fa052e9d68cb None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:55:54.062930 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-5cabe17c-920d-4431-abdc-fa052e9d68cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:55:54.146383 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03de3f28-8799-4b2d-9c8d-e75bc24e2b7d admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:55:54.167110 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 960/1919] 10.222.0.57 () {58 vars in 958 bytes} [Fri Sep 16 07:55:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 07:55:54.170694 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cabe17c-920d-4431-abdc-fa052e9d68cb None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:55:54.173085 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-5cabe17c-920d-4431-abdc-fa052e9d68cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:55:54.187410 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cabe17c-920d-4431-abdc-fa052e9d68cb None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:55:54.194022 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e56666-1946-4546-962c-daaf86398a26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:55:54.194985 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e56666-1946-4546-962c-daaf86398a26 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:54.195445 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e56666-1946-4546-962c-daaf86398a26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:54.195897 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e56666-1946-4546-962c-daaf86398a26 admin admin] PATH_INFO: `/v3/projects/61ba026817d747bfa5f78018e985d6cd` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:54.197657 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e56666-1946-4546-962c-daaf86398a26 admin admin] RBAC: Authorizing `identity:delete_project(project_id=61ba026817d747bfa5f78018e985d6cd)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:55:54.200363 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e56666-1946-4546-962c-daaf86398a26 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:55:54.237324 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1157b82-3860-4f3f-9135-41af258c9a74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:55:54.238301 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1157b82-3860-4f3f-9135-41af258c9a74 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:54.238600 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1157b82-3860-4f3f-9135-41af258c9a74 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:54.238872 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1157b82-3860-4f3f-9135-41af258c9a74 admin admin] PATH_INFO: `/v3/users/9cbcc90866de4a1da7eafdaa2c41c2a6` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:54.240670 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1157b82-3860-4f3f-9135-41af258c9a74 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9cbcc90866de4a1da7eafdaa2c41c2a6)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:55:54.243259 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1157b82-3860-4f3f-9135-41af258c9a74 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:55:54.278740 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-b4e56666-1946-4546-962c-daaf86398a26 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '61ba026817d747bfa5f78018e985d6cd', 'request_id': 'req-b4e56666-1946-4546-962c-daaf86398a26'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:55:54.289766 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-b4e56666-1946-4546-962c-daaf86398a26 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '61ba026817d747bfa5f78018e985d6cd', 'request_id': 'req-b4e56666-1946-4546-962c-daaf86398a26'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:55:54.299926 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-b4e56666-1946-4546-962c-daaf86398a26 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '61ba026817d747bfa5f78018e985d6cd', 'request_id': 'req-b4e56666-1946-4546-962c-daaf86398a26'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:55:54.323451 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-b4e56666-1946-4546-962c-daaf86398a26 admin admin] The token cache is being invalidate because project 61ba026817d747bfa5f78018e985d6cd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81430) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 07:55:54.323739 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-b4e56666-1946-4546-962c-daaf86398a26 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:55:54.324462 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-b4e56666-1946-4546-962c-daaf86398a26 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:55:54.330289 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 961/1920] 10.222.0.57 () {58 vars in 1233 bytes} [Fri Sep 16 07:55:54 2022] DELETE /identity/v3/projects/61ba026817d747bfa5f78018e985d6cd => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 07:55:54.331920 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94475f48-4d2a-49eb-b349-98f26904e93a None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:54.332051 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94475f48-4d2a-49eb-b349-98f26904e93a None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:54.332278 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94475f48-4d2a-49eb-b349-98f26904e93a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:54.336486 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-e1157b82-3860-4f3f-9135-41af258c9a74 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9cbcc90866de4a1da7eafdaa2c41c2a6'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:55:54.355860 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-94475f48-4d2a-49eb-b349-98f26904e93a None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:55:54.356387 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-e1157b82-3860-4f3f-9135-41af258c9a74 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9cbcc90866de4a1da7eafdaa2c41c2a6'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:55:54.357114 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-94475f48-4d2a-49eb-b349-98f26904e93a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:55:54.357600 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-e1157b82-3860-4f3f-9135-41af258c9a74 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9cbcc90866de4a1da7eafdaa2c41c2a6'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:55:54.368372 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:55:54.372886 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-e1157b82-3860-4f3f-9135-41af258c9a74 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9cbcc90866de4a1da7eafdaa2c41c2a6'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:55:54.383523 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:55:54.387975 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-e1157b82-3860-4f3f-9135-41af258c9a74 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9cbcc90866de4a1da7eafdaa2c41c2a6'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:55:54.413497 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 960/1921] 10.222.0.57 () {58 vars in 1224 bytes} [Fri Sep 16 07:55:54 2022] DELETE /identity/v3/users/9cbcc90866de4a1da7eafdaa2c41c2a6 => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 16 07:55:54.413497 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752888c4-b766-4bce-a901-9cac652f938f None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:54.413497 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752888c4-b766-4bce-a901-9cac652f938f None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:54.413497 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752888c4-b766-4bce-a901-9cac652f938f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:54.457831 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-752888c4-b766-4bce-a901-9cac652f938f None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:55:54.459185 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-752888c4-b766-4bce-a901-9cac652f938f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:55:54.484030 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 962/1922] 10.222.0.57 () {58 vars in 958 bytes} [Fri Sep 16 07:55:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 07:55:54.485290 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3afa09b-8fcd-41cc-98e5-7530e1013c9f None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:54.486235 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3afa09b-8fcd-41cc-98e5-7530e1013c9f None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:54.486734 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3afa09b-8fcd-41cc-98e5-7530e1013c9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:54.511777 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-a3afa09b-8fcd-41cc-98e5-7530e1013c9f None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:55:54.513141 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-a3afa09b-8fcd-41cc-98e5-7530e1013c9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:55:54.578541 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 961/1923] 10.222.0.57 () {58 vars in 958 bytes} [Fri Sep 16 07:55:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 07:55:54.579729 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752888c4-b766-4bce-a901-9cac652f938f None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:55:54.592296 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752888c4-b766-4bce-a901-9cac652f938f None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:55:54.598885 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062b95ac-f433-4113-b96e-8b4107e5270e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:55:54.599502 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062b95ac-f433-4113-b96e-8b4107e5270e admin admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:54.599921 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062b95ac-f433-4113-b96e-8b4107e5270e admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:54.600194 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062b95ac-f433-4113-b96e-8b4107e5270e admin admin] PATH_INFO: `/v3/domains` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:54.600957 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062b95ac-f433-4113-b96e-8b4107e5270e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:55:54.601195 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062b95ac-f433-4113-b96e-8b4107e5270e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:55:54.603332 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062b95ac-f433-4113-b96e-8b4107e5270e admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:55:54.613909 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 963/1924] 10.222.0.57 () {58 vars in 958 bytes} [Fri Sep 16 07:55:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 07:55:54.615367 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65003de2-725b-4914-8652-195d483a8b4c None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:54.615654 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65003de2-725b-4914-8652-195d483a8b4c None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:54.621095 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65003de2-725b-4914-8652-195d483a8b4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:54.634022 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 962/1925] 10.222.0.57 () {58 vars in 1153 bytes} [Fri Sep 16 07:55:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:55:54.635159 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062b95ac-f433-4113-b96e-8b4107e5270e admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:55:54.637609 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-062b95ac-f433-4113-b96e-8b4107e5270e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:55:54.652386 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-65003de2-725b-4914-8652-195d483a8b4c None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:55:54.653900 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-65003de2-725b-4914-8652-195d483a8b4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:55:54.671042 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 964/1926] 10.222.0.57 () {58 vars in 958 bytes} [Fri Sep 16 07:55:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 07:55:54.672027 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65003de2-725b-4914-8652-195d483a8b4c None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:55:54.683517 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65003de2-725b-4914-8652-195d483a8b4c None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:55:54.691482 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228b06c5-1987-4a67-bd7f-cdde5c2421c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:55:54.692107 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228b06c5-1987-4a67-bd7f-cdde5c2421c4 admin admin] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:54.692387 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228b06c5-1987-4a67-bd7f-cdde5c2421c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:54.692657 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228b06c5-1987-4a67-bd7f-cdde5c2421c4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:54.695057 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228b06c5-1987-4a67-bd7f-cdde5c2421c4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:55:54.697832 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228b06c5-1987-4a67-bd7f-cdde5c2421c4 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:55:54.772156 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062b95ac-f433-4113-b96e-8b4107e5270e admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:55:54.785101 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa670534-5131-4c64-b600-d40f2594a348 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1062e457207a41e4ba4f0a0c4bf36f1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4735f453c0c24cc4a1c14e9ac84a0b46', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:55:54.786575 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa670534-5131-4c64-b600-d40f2594a348 service neutron] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:54.786868 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa670534-5131-4c64-b600-d40f2594a348 service neutron] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:54.787313 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa670534-5131-4c64-b600-d40f2594a348 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:54.793713 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 965/1927] 10.222.0.57 () {60 vars in 1153 bytes} [Fri Sep 16 07:55:54 2022] POST /identity/v3/projects => generated 379 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 07:55:54.794596 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228b06c5-1987-4a67-bd7f-cdde5c2421c4 admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:55:54.801536 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa670534-5131-4c64-b600-d40f2594a348 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:55:54.803027 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa670534-5131-4c64-b600-d40f2594a348 service neutron] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:55:54.820039 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 963/1928] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Sep 16 07:55:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 07:55:54.821018 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa670534-5131-4c64-b600-d40f2594a348 service neutron] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:55:54.850449 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa670534-5131-4c64-b600-d40f2594a348 service neutron] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:55:54.929428 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228b06c5-1987-4a67-bd7f-cdde5c2421c4 admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:55:54.939646 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791c782a-8650-449c-91e6-513ae02367db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:55:54.940580 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791c782a-8650-449c-91e6-513ae02367db admin admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:54.940807 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791c782a-8650-449c-91e6-513ae02367db admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:54.941080 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791c782a-8650-449c-91e6-513ae02367db admin admin] PATH_INFO: `/v3/domains` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:54.941748 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791c782a-8650-449c-91e6-513ae02367db admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:55:54.943807 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791c782a-8650-449c-91e6-513ae02367db admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:55:54.946304 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791c782a-8650-449c-91e6-513ae02367db admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:55:54.964132 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 966/1929] 10.222.0.57 () {58 vars in 1153 bytes} [Fri Sep 16 07:55:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:55:54.965357 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791c782a-8650-449c-91e6-513ae02367db admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:55:54.967493 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-791c782a-8650-449c-91e6-513ae02367db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:55:54.981314 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82efe85-3581-4d8b-a771-d894707c9f08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:55:54.981981 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82efe85-3581-4d8b-a771-d894707c9f08 admin admin] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:54.982282 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82efe85-3581-4d8b-a771-d894707c9f08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:54.982599 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82efe85-3581-4d8b-a771-d894707c9f08 admin admin] PATH_INFO: `/v3/users` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:54.983249 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82efe85-3581-4d8b-a771-d894707c9f08 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:55:54.985631 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82efe85-3581-4d8b-a771-d894707c9f08 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:55:54.986241 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791c782a-8650-449c-91e6-513ae02367db admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:55:54.992036 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0b42a2-16a2-449b-ab5f-8f3614b8422e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:55:54.992810 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0b42a2-16a2-449b-ab5f-8f3614b8422e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:54.994276 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0b42a2-16a2-449b-ab5f-8f3614b8422e admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:54.994905 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0b42a2-16a2-449b-ab5f-8f3614b8422e admin admin] PATH_INFO: `/v3/projects/eff33feb39fd4aa288279e4eab944a6e` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:54.996454 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0b42a2-16a2-449b-ab5f-8f3614b8422e admin admin] RBAC: Authorizing `identity:delete_project(project_id=eff33feb39fd4aa288279e4eab944a6e)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:55:54.998962 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0b42a2-16a2-449b-ab5f-8f3614b8422e admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:55:55.026463 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 964/1930] 10.222.0.57 () {60 vars in 1144 bytes} [Fri Sep 16 07:55:54 2022] POST /identity/v3/users => generated 290 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 07:55:55.027391 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82efe85-3581-4d8b-a771-d894707c9f08 admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:55:55.031821 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:55:55.051925 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82efe85-3581-4d8b-a771-d894707c9f08 admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:55:55.057264 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d191f62-1fd1-4538-9814-e384f023799a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:55:55.058172 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d191f62-1fd1-4538-9814-e384f023799a admin admin] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:55.058172 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d191f62-1fd1-4538-9814-e384f023799a admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:55.058425 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d191f62-1fd1-4538-9814-e384f023799a admin admin] PATH_INFO: `/v3/projects` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:55.059068 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d191f62-1fd1-4538-9814-e384f023799a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:55:55.061023 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d191f62-1fd1-4538-9814-e384f023799a admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:55:55.081174 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:55:55.086100 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-4c0b42a2-16a2-449b-ab5f-8f3614b8422e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eff33feb39fd4aa288279e4eab944a6e', 'request_id': 'req-4c0b42a2-16a2-449b-ab5f-8f3614b8422e'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:55:55.112739 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-4c0b42a2-16a2-449b-ab5f-8f3614b8422e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eff33feb39fd4aa288279e4eab944a6e', 'request_id': 'req-4c0b42a2-16a2-449b-ab5f-8f3614b8422e'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:55:55.117378 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 965/1931] 10.222.0.57 () {60 vars in 1153 bytes} [Fri Sep 16 07:55:55 2022] POST /identity/v3/projects => generated 379 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 07:55:55.119852 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d191f62-1fd1-4538-9814-e384f023799a admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:55:55.127469 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-4c0b42a2-16a2-449b-ab5f-8f3614b8422e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eff33feb39fd4aa288279e4eab944a6e', 'request_id': 'req-4c0b42a2-16a2-449b-ab5f-8f3614b8422e'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:55:55.169234 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-4c0b42a2-16a2-449b-ab5f-8f3614b8422e admin admin] The token cache is being invalidate because project eff33feb39fd4aa288279e4eab944a6e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81430) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 07:55:55.172704 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-4c0b42a2-16a2-449b-ab5f-8f3614b8422e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:55:55.174932 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-4c0b42a2-16a2-449b-ab5f-8f3614b8422e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:55:55.178805 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 967/1932] 10.222.0.57 () {58 vars in 1233 bytes} [Fri Sep 16 07:55:54 2022] DELETE /identity/v3/projects/eff33feb39fd4aa288279e4eab944a6e => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 07:55:55.181408 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0b42a2-16a2-449b-ab5f-8f3614b8422e admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:55:55.185215 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-4c0b42a2-16a2-449b-ab5f-8f3614b8422e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:55:55.290384 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d191f62-1fd1-4538-9814-e384f023799a admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:55:55.294310 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0b42a2-16a2-449b-ab5f-8f3614b8422e admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:55:55.297104 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed8ddb1-d63d-4b1e-9edb-e4507cc94ed9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:55:55.297737 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed8ddb1-d63d-4b1e-9edb-e4507cc94ed9 admin admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:55.298111 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed8ddb1-d63d-4b1e-9edb-e4507cc94ed9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:55.298384 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed8ddb1-d63d-4b1e-9edb-e4507cc94ed9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:55.299451 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed8ddb1-d63d-4b1e-9edb-e4507cc94ed9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:55:55.300378 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f30539-31c7-4740-a351-c749f8c38e45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:55:55.301070 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f30539-31c7-4740-a351-c749f8c38e45 admin admin] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:55.301409 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed8ddb1-d63d-4b1e-9edb-e4507cc94ed9 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:55:55.301874 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f30539-31c7-4740-a351-c749f8c38e45 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:55.302153 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f30539-31c7-4740-a351-c749f8c38e45 admin admin] PATH_INFO: `/v3/users` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:55.302794 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f30539-31c7-4740-a351-c749f8c38e45 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:55:55.305405 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f30539-31c7-4740-a351-c749f8c38e45 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:55:55.333044 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 966/1933] 10.222.0.57 () {58 vars in 1122 bytes} [Fri Sep 16 07:55:55 2022] GET /identity/v3/roles => generated 1420 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 07:55:55.333044 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e0bfe8-48db-41c2-b898-6f4d4b60bff0 None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:55.333044 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e0bfe8-48db-41c2-b898-6f4d4b60bff0 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:55.333044 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e0bfe8-48db-41c2-b898-6f4d4b60bff0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:55.336824 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 968/1934] 10.222.0.57 () {60 vars in 1144 bytes} [Fri Sep 16 07:55:55 2022] POST /identity/v3/users => generated 290 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 07:55:55.339983 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f30539-31c7-4740-a351-c749f8c38e45 admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:55:55.340615 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-e2f30539-31c7-4740-a351-c749f8c38e45 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:55:55.358564 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f30539-31c7-4740-a351-c749f8c38e45 admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:55:55.366468 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be34a2b-4f17-4ec9-a6a0-7f9edcdc19f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:55:55.366919 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-f0e0bfe8-48db-41c2-b898-6f4d4b60bff0 None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:55:55.367109 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be34a2b-4f17-4ec9-a6a0-7f9edcdc19f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:55.367475 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be34a2b-4f17-4ec9-a6a0-7f9edcdc19f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:55.367754 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be34a2b-4f17-4ec9-a6a0-7f9edcdc19f4 admin admin] PATH_INFO: `/v3/projects/ba78359a0aff4be59da152976a6bb0e0` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:55.369115 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-f0e0bfe8-48db-41c2-b898-6f4d4b60bff0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:55:55.369806 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be34a2b-4f17-4ec9-a6a0-7f9edcdc19f4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ba78359a0aff4be59da152976a6bb0e0)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:55:55.372634 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be34a2b-4f17-4ec9-a6a0-7f9edcdc19f4 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:55:55.387583 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 967/1935] 10.222.0.57 () {58 vars in 958 bytes} [Fri Sep 16 07:55:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 07:55:55.387583 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e0bfe8-48db-41c2-b898-6f4d4b60bff0 None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:55:55.387583 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-f0e0bfe8-48db-41c2-b898-6f4d4b60bff0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:55:55.400412 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e0bfe8-48db-41c2-b898-6f4d4b60bff0 None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:55:55.406295 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b22f63-7fc1-4a0c-8420-80636e08703e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:55:55.406908 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b22f63-7fc1-4a0c-8420-80636e08703e admin admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:55.407183 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b22f63-7fc1-4a0c-8420-80636e08703e admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:55.407797 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b22f63-7fc1-4a0c-8420-80636e08703e admin admin] PATH_INFO: `/v3/roles` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:55.408847 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b22f63-7fc1-4a0c-8420-80636e08703e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:55:55.410994 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b22f63-7fc1-4a0c-8420-80636e08703e admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:55:55.428095 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 968/1936] 10.222.0.57 () {58 vars in 1122 bytes} [Fri Sep 16 07:55:55 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 07:55:55.428095 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b22f63-7fc1-4a0c-8420-80636e08703e admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:55:55.437334 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b22f63-7fc1-4a0c-8420-80636e08703e admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:55:55.456620 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-4be34a2b-4f17-4ec9-a6a0-7f9edcdc19f4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ba78359a0aff4be59da152976a6bb0e0', 'request_id': 'req-4be34a2b-4f17-4ec9-a6a0-7f9edcdc19f4'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:55:55.466541 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-4be34a2b-4f17-4ec9-a6a0-7f9edcdc19f4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ba78359a0aff4be59da152976a6bb0e0', 'request_id': 'req-4be34a2b-4f17-4ec9-a6a0-7f9edcdc19f4'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:55:55.476228 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-4be34a2b-4f17-4ec9-a6a0-7f9edcdc19f4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ba78359a0aff4be59da152976a6bb0e0', 'request_id': 'req-4be34a2b-4f17-4ec9-a6a0-7f9edcdc19f4'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:55:55.495611 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-4be34a2b-4f17-4ec9-a6a0-7f9edcdc19f4 admin admin] The token cache is being invalidate because project ba78359a0aff4be59da152976a6bb0e0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81430) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 07:55:55.495919 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-4be34a2b-4f17-4ec9-a6a0-7f9edcdc19f4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:55:55.496575 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-4be34a2b-4f17-4ec9-a6a0-7f9edcdc19f4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:55:55.501885 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 969/1937] 10.222.0.57 () {58 vars in 1233 bytes} [Fri Sep 16 07:55:55 2022] DELETE /identity/v3/projects/ba78359a0aff4be59da152976a6bb0e0 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 07:55:55.501885 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0447bbaf-a5fd-435a-ab33-cb1cb5d2d194 None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:55.501885 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0447bbaf-a5fd-435a-ab33-cb1cb5d2d194 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:55.501885 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0447bbaf-a5fd-435a-ab33-cb1cb5d2d194 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:55.521033 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-0447bbaf-a5fd-435a-ab33-cb1cb5d2d194 None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:55:55.522249 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-0447bbaf-a5fd-435a-ab33-cb1cb5d2d194 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:55:55.532749 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=81,keystone:DELETE=14,keystone:INSERT=5 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:55:55.535313 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9acfa9a-7b22-4f7c-b574-ec56c5de1c50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:55:55.535876 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9acfa9a-7b22-4f7c-b574-ec56c5de1c50 admin admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:55.536162 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9acfa9a-7b22-4f7c-b574-ec56c5de1c50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:55.536480 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9acfa9a-7b22-4f7c-b574-ec56c5de1c50 admin admin] PATH_INFO: `/v3/roles` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:55.537046 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9acfa9a-7b22-4f7c-b574-ec56c5de1c50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:55:55.538894 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9acfa9a-7b22-4f7c-b574-ec56c5de1c50 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:55:55.551446 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 969/1938] 10.222.0.57 () {58 vars in 1122 bytes} [Fri Sep 16 07:55:55 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 07:55:55.552810 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9acfa9a-7b22-4f7c-b574-ec56c5de1c50 admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:55:55.556210 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-a9acfa9a-7b22-4f7c-b574-ec56c5de1c50 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:55:55.573038 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9acfa9a-7b22-4f7c-b574-ec56c5de1c50 admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:55:55.582097 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8479630c-ba01-403b-8676-dcc084675b14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:55:55.583244 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8479630c-ba01-403b-8676-dcc084675b14 admin admin] REQUEST_METHOD: `PUT` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:55.583663 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8479630c-ba01-403b-8676-dcc084675b14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:55.584081 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8479630c-ba01-403b-8676-dcc084675b14 admin admin] PATH_INFO: `/v3/projects/5748e774c76641c7beb85de268fba631/users/6c0b659cf8df4c67bfd08a21e1bfd4ac/roles/4818d38cf2564825b312e66c9eb24762` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:55.601402 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 970/1939] 10.222.0.57 () {58 vars in 958 bytes} [Fri Sep 16 07:55:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 07:55:55.601402 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0447bbaf-a5fd-435a-ab33-cb1cb5d2d194 None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:55:55.603613 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-0447bbaf-a5fd-435a-ab33-cb1cb5d2d194 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:55:55.609903 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8479630c-ba01-403b-8676-dcc084675b14 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5748e774c76641c7beb85de268fba631, user_id=6c0b659cf8df4c67bfd08a21e1bfd4ac, role_id=4818d38cf2564825b312e66c9eb24762)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:55:55.615699 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8479630c-ba01-403b-8676-dcc084675b14 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:55:55.621257 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0447bbaf-a5fd-435a-ab33-cb1cb5d2d194 None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:55:55.637939 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5d6d4e-33cd-457d-b91e-54fcf8279ac8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:55:55.637939 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5d6d4e-33cd-457d-b91e-54fcf8279ac8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:55.637939 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5d6d4e-33cd-457d-b91e-54fcf8279ac8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:55.637939 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5d6d4e-33cd-457d-b91e-54fcf8279ac8 admin admin] PATH_INFO: `/v3/users/0f640bf716a04900a4590d84581da2fc` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:55.638366 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5d6d4e-33cd-457d-b91e-54fcf8279ac8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0f640bf716a04900a4590d84581da2fc)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:55:55.638366 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5d6d4e-33cd-457d-b91e-54fcf8279ac8 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:55:55.645904 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 970/1940] 10.222.0.57 () {60 vars in 1483 bytes} [Fri Sep 16 07:55:55 2022] PUT /identity/v3/projects/5748e774c76641c7beb85de268fba631/users/6c0b659cf8df4c67bfd08a21e1bfd4ac/roles/4818d38cf2564825b312e66c9eb24762 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 07:55:55.646460 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8479630c-ba01-403b-8676-dcc084675b14 admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:55:55.648676 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-8479630c-ba01-403b-8676-dcc084675b14 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:55:55.710616 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-da5d6d4e-33cd-457d-b91e-54fcf8279ac8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0f640bf716a04900a4590d84581da2fc'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:55:55.711328 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-da5d6d4e-33cd-457d-b91e-54fcf8279ac8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0f640bf716a04900a4590d84581da2fc'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:55:55.711467 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:55:55.719579 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-da5d6d4e-33cd-457d-b91e-54fcf8279ac8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0f640bf716a04900a4590d84581da2fc'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:55:55.730250 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8479630c-ba01-403b-8676-dcc084675b14 admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:55:55.731747 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-da5d6d4e-33cd-457d-b91e-54fcf8279ac8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0f640bf716a04900a4590d84581da2fc'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:55:55.734814 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb44ea70-35fc-4341-9b9c-d9c01ee568b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:55:55.735416 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb44ea70-35fc-4341-9b9c-d9c01ee568b9 admin admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:55.736322 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb44ea70-35fc-4341-9b9c-d9c01ee568b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:55.736599 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb44ea70-35fc-4341-9b9c-d9c01ee568b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:55.737314 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb44ea70-35fc-4341-9b9c-d9c01ee568b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:55:55.738924 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb44ea70-35fc-4341-9b9c-d9c01ee568b9 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:55:55.739139 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-da5d6d4e-33cd-457d-b91e-54fcf8279ac8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0f640bf716a04900a4590d84581da2fc'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:55:55.745280 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 971/1941] 10.222.0.57 () {58 vars in 1224 bytes} [Fri Sep 16 07:55:55 2022] DELETE /identity/v3/users/0f640bf716a04900a4590d84581da2fc => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 07:55:55.746172 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5d6d4e-33cd-457d-b91e-54fcf8279ac8 admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:55:55.747744 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-da5d6d4e-33cd-457d-b91e-54fcf8279ac8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:55:55.753859 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 971/1942] 10.222.0.57 () {58 vars in 1122 bytes} [Fri Sep 16 07:55:55 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 07:55:55.753859 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8e92b5-acc9-40c3-b012-13390320068d None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:55.753859 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8e92b5-acc9-40c3-b012-13390320068d None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:55.753859 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8e92b5-acc9-40c3-b012-13390320068d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:55.788663 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-0c8e92b5-acc9-40c3-b012-13390320068d None None] MFA Rules not processed for user `6c0b659cf8df4c67bfd08a21e1bfd4ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:55:55.790484 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-0c8e92b5-acc9-40c3-b012-13390320068d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:55:55.851622 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5d6d4e-33cd-457d-b91e-54fcf8279ac8 admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:55:55.858107 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1dae735-dcd9-4c78-9526-21be7fb60c2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:55:55.858733 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dae735-dcd9-4c78-9526-21be7fb60c2f admin admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:55.859011 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dae735-dcd9-4c78-9526-21be7fb60c2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:55.859389 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dae735-dcd9-4c78-9526-21be7fb60c2f admin admin] PATH_INFO: `/v3/domains` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:55.860053 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1dae735-dcd9-4c78-9526-21be7fb60c2f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:55:55.861021 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1dae735-dcd9-4c78-9526-21be7fb60c2f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:55:55.863262 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1dae735-dcd9-4c78-9526-21be7fb60c2f admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:55:55.884484 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 972/1943] 10.222.0.57 () {58 vars in 1153 bytes} [Fri Sep 16 07:55:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:55:55.884484 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1dae735-dcd9-4c78-9526-21be7fb60c2f admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:55:55.886560 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-a1dae735-dcd9-4c78-9526-21be7fb60c2f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:55:55.905762 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 972/1944] 10.222.0.57 () {58 vars in 958 bytes} [Fri Sep 16 07:55:55 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 07:55:55.906282 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1dae735-dcd9-4c78-9526-21be7fb60c2f admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:55:55.906364 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8e92b5-acc9-40c3-b012-13390320068d None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:55:55.911362 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588729d9-9119-40d9-9327-795cfd59961e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:55:55.912041 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588729d9-9119-40d9-9327-795cfd59961e admin admin] REQUEST_METHOD: `PUT` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:55.912746 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588729d9-9119-40d9-9327-795cfd59961e admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:55.912746 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588729d9-9119-40d9-9327-795cfd59961e admin admin] PATH_INFO: `/v3/projects/1004a23df546471688a31c8a1f69089d/users/65e9317aa7bd4a3481e24ac01df07e96/roles/4818d38cf2564825b312e66c9eb24762` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:55.917279 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8e92b5-acc9-40c3-b012-13390320068d None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:55:55.923910 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d4bf57-4c93-42c1-8e0b-b9eff7fe95b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:55:55.924539 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d4bf57-4c93-42c1-8e0b-b9eff7fe95b2 admin admin] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:55.924816 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d4bf57-4c93-42c1-8e0b-b9eff7fe95b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:55.925085 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d4bf57-4c93-42c1-8e0b-b9eff7fe95b2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:55.925761 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d4bf57-4c93-42c1-8e0b-b9eff7fe95b2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:55:55.927672 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d4bf57-4c93-42c1-8e0b-b9eff7fe95b2 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:55:55.936094 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588729d9-9119-40d9-9327-795cfd59961e admin admin] RBAC: Authorizing `identity:create_grant(project_id=1004a23df546471688a31c8a1f69089d, user_id=65e9317aa7bd4a3481e24ac01df07e96, role_id=4818d38cf2564825b312e66c9eb24762)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:55:55.940435 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588729d9-9119-40d9-9327-795cfd59961e admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:55:55.956591 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:55:55.979373 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 973/1945] 10.222.0.57 () {60 vars in 1483 bytes} [Fri Sep 16 07:55:55 2022] PUT /identity/v3/projects/1004a23df546471688a31c8a1f69089d/users/65e9317aa7bd4a3481e24ac01df07e96/roles/4818d38cf2564825b312e66c9eb24762 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 07:55:55.988567 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588729d9-9119-40d9-9327-795cfd59961e admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:55:55.991147 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-588729d9-9119-40d9-9327-795cfd59961e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:55:55.993513 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 973/1946] 10.222.0.57 () {60 vars in 1153 bytes} [Fri Sep 16 07:55:55 2022] POST /identity/v3/projects => generated 399 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 07:55:55.997170 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9827d1f6-2596-41fd-abdf-9406bff67ccf None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:56.009868 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9827d1f6-2596-41fd-abdf-9406bff67ccf None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:56.010452 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9827d1f6-2596-41fd-abdf-9406bff67ccf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:56.065474 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-9827d1f6-2596-41fd-abdf-9406bff67ccf None None] MFA Rules not processed for user `65e9317aa7bd4a3481e24ac01df07e96`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:55:56.067125 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-9827d1f6-2596-41fd-abdf-9406bff67ccf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:55:56.109954 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588729d9-9119-40d9-9327-795cfd59961e admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:55:56.187290 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 974/1947] 10.222.0.57 () {58 vars in 958 bytes} [Fri Sep 16 07:55:55 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 07:55:56.187942 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9827d1f6-2596-41fd-abdf-9406bff67ccf None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:55:56.197983 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecee50f5-56cf-45f0-a1a1-fb0c6dbf5490 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:55:56.202498 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecee50f5-56cf-45f0-a1a1-fb0c6dbf5490 admin admin] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:56.202863 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecee50f5-56cf-45f0-a1a1-fb0c6dbf5490 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:56.203200 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecee50f5-56cf-45f0-a1a1-fb0c6dbf5490 admin admin] PATH_INFO: `/v3/projects` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:56.203942 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecee50f5-56cf-45f0-a1a1-fb0c6dbf5490 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:55:56.205911 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecee50f5-56cf-45f0-a1a1-fb0c6dbf5490 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:55:56.244240 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 974/1948] 10.222.0.57 () {60 vars in 1153 bytes} [Fri Sep 16 07:55:55 2022] POST /identity/v3/projects => generated 379 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 07:55:56.245448 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecee50f5-56cf-45f0-a1a1-fb0c6dbf5490 admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:55:56.245984 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:55:56.247296 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-ecee50f5-56cf-45f0-a1a1-fb0c6dbf5490 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:55:56.274941 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9827d1f6-2596-41fd-abdf-9406bff67ccf None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:55:56.314609 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecee50f5-56cf-45f0-a1a1-fb0c6dbf5490 admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:55:56.319344 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e0bc41-5fdb-4638-acbe-8018c51ef598 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:55:56.319980 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e0bc41-5fdb-4638-acbe-8018c51ef598 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:56.320266 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e0bc41-5fdb-4638-acbe-8018c51ef598 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:56.320536 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e0bc41-5fdb-4638-acbe-8018c51ef598 admin admin] PATH_INFO: `/v3/projects/e213128b05864ee8b2358ecb4c9677f7` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:56.321658 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e0bc41-5fdb-4638-acbe-8018c51ef598 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e213128b05864ee8b2358ecb4c9677f7)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:55:56.323591 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e0bc41-5fdb-4638-acbe-8018c51ef598 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:55:56.333289 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7654b6f-cdec-4bfb-b487-2ec6506d6b55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:55:56.333931 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7654b6f-cdec-4bfb-b487-2ec6506d6b55 admin admin] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:56.334213 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7654b6f-cdec-4bfb-b487-2ec6506d6b55 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:56.334485 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7654b6f-cdec-4bfb-b487-2ec6506d6b55 admin admin] PATH_INFO: `/v3/users` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:56.335291 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7654b6f-cdec-4bfb-b487-2ec6506d6b55 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:55:56.337556 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7654b6f-cdec-4bfb-b487-2ec6506d6b55 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:55:56.359988 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 975/1949] 10.222.0.57 () {60 vars in 1144 bytes} [Fri Sep 16 07:55:56 2022] POST /identity/v3/users => generated 300 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 07:55:56.361061 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7654b6f-cdec-4bfb-b487-2ec6506d6b55 admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:55:56.364597 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=97,keystone:INSERT=1,keystone:DELETE=2 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:55:56.372113 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7654b6f-cdec-4bfb-b487-2ec6506d6b55 admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:55:56.379434 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-61e0bc41-5fdb-4638-acbe-8018c51ef598 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e213128b05864ee8b2358ecb4c9677f7', 'request_id': 'req-61e0bc41-5fdb-4638-acbe-8018c51ef598'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:55:56.387456 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-61e0bc41-5fdb-4638-acbe-8018c51ef598 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e213128b05864ee8b2358ecb4c9677f7', 'request_id': 'req-61e0bc41-5fdb-4638-acbe-8018c51ef598'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:55:56.393871 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-61e0bc41-5fdb-4638-acbe-8018c51ef598 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e213128b05864ee8b2358ecb4c9677f7', 'request_id': 'req-61e0bc41-5fdb-4638-acbe-8018c51ef598'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:55:56.405168 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-61e0bc41-5fdb-4638-acbe-8018c51ef598 admin admin] The token cache is being invalidate because project e213128b05864ee8b2358ecb4c9677f7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81430) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 07:55:56.405457 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-61e0bc41-5fdb-4638-acbe-8018c51ef598 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:55:56.406147 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-61e0bc41-5fdb-4638-acbe-8018c51ef598 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:55:56.408597 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 975/1950] 10.222.0.57 () {58 vars in 1233 bytes} [Fri Sep 16 07:55:56 2022] DELETE /identity/v3/projects/e213128b05864ee8b2358ecb4c9677f7 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 07:55:56.409279 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e0bc41-5fdb-4638-acbe-8018c51ef598 admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:55:56.410669 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-61e0bc41-5fdb-4638-acbe-8018c51ef598 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:55:56.432904 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7904e1b6-316d-48b2-8d68-3f84ae5949d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:55:56.433526 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7904e1b6-316d-48b2-8d68-3f84ae5949d2 admin admin] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:56.433907 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7904e1b6-316d-48b2-8d68-3f84ae5949d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:56.434204 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7904e1b6-316d-48b2-8d68-3f84ae5949d2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:56.435495 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7904e1b6-316d-48b2-8d68-3f84ae5949d2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:55:56.437795 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7904e1b6-316d-48b2-8d68-3f84ae5949d2 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:55:56.471129 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 976/1951] 10.222.0.57 () {60 vars in 1153 bytes} [Fri Sep 16 07:55:56 2022] POST /identity/v3/projects => generated 379 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 07:55:56.472537 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7904e1b6-316d-48b2-8d68-3f84ae5949d2 admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:55:56.475750 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-7904e1b6-316d-48b2-8d68-3f84ae5949d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:55:56.480113 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e0bc41-5fdb-4638-acbe-8018c51ef598 admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:55:56.553855 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7904e1b6-316d-48b2-8d68-3f84ae5949d2 admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:55:56.557060 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cf42ee-090c-4f53-8c7c-b0e47cde3dda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:55:56.558464 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cf42ee-090c-4f53-8c7c-b0e47cde3dda admin admin] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:56.558823 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cf42ee-090c-4f53-8c7c-b0e47cde3dda admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:56.559105 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cf42ee-090c-4f53-8c7c-b0e47cde3dda admin admin] PATH_INFO: `/v3/users` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:56.559203 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74e91c3-b92f-4eda-8c18-45b7cf9a5073 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:55:56.559737 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cf42ee-090c-4f53-8c7c-b0e47cde3dda admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:55:56.559855 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74e91c3-b92f-4eda-8c18-45b7cf9a5073 admin admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:56.560049 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74e91c3-b92f-4eda-8c18-45b7cf9a5073 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:56.560322 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74e91c3-b92f-4eda-8c18-45b7cf9a5073 admin admin] PATH_INFO: `/v3/roles` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:56.560964 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74e91c3-b92f-4eda-8c18-45b7cf9a5073 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:55:56.561782 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cf42ee-090c-4f53-8c7c-b0e47cde3dda admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:55:56.562740 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74e91c3-b92f-4eda-8c18-45b7cf9a5073 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:55:56.564432 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:55:56.576161 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 977/1952] 10.222.0.57 () {58 vars in 1122 bytes} [Fri Sep 16 07:55:56 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 07:55:56.577974 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b50a3bb-f898-4346-abc5-c7ff0d2b505b None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:56.578351 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b50a3bb-f898-4346-abc5-c7ff0d2b505b None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:56.578783 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b50a3bb-f898-4346-abc5-c7ff0d2b505b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:56.589224 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 976/1953] 10.222.0.57 () {60 vars in 1144 bytes} [Fri Sep 16 07:55:56 2022] POST /identity/v3/users => generated 290 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 07:55:56.590523 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cf42ee-090c-4f53-8c7c-b0e47cde3dda admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:55:56.592278 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-e4cf42ee-090c-4f53-8c7c-b0e47cde3dda admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:55:56.603257 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-5b50a3bb-f898-4346-abc5-c7ff0d2b505b None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:55:56.605778 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-5b50a3bb-f898-4346-abc5-c7ff0d2b505b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:55:56.612795 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 978/1954] 10.222.0.57 () {58 vars in 958 bytes} [Fri Sep 16 07:55:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 07:55:56.613638 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b50a3bb-f898-4346-abc5-c7ff0d2b505b None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:55:56.621543 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cf42ee-090c-4f53-8c7c-b0e47cde3dda admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:55:56.625442 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b50a3bb-f898-4346-abc5-c7ff0d2b505b None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:55:56.627559 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fe7a6f-837f-4dba-82eb-fa4137d9bde8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:55:56.628174 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fe7a6f-837f-4dba-82eb-fa4137d9bde8 admin admin] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:56.628486 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fe7a6f-837f-4dba-82eb-fa4137d9bde8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:56.628760 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fe7a6f-837f-4dba-82eb-fa4137d9bde8 admin admin] PATH_INFO: `/v3/users` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:56.629515 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fe7a6f-837f-4dba-82eb-fa4137d9bde8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:55:56.630521 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4624e806-ca9a-4285-b889-1ed54fb325da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:55:56.631120 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4624e806-ca9a-4285-b889-1ed54fb325da admin admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:56.631449 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4624e806-ca9a-4285-b889-1ed54fb325da admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:56.631545 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fe7a6f-837f-4dba-82eb-fa4137d9bde8 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:55:56.631714 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4624e806-ca9a-4285-b889-1ed54fb325da admin admin] PATH_INFO: `/v3/roles` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:56.632443 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4624e806-ca9a-4285-b889-1ed54fb325da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:55:56.634094 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4624e806-ca9a-4285-b889-1ed54fb325da admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:55:56.646989 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 979/1955] 10.222.0.57 () {58 vars in 1122 bytes} [Fri Sep 16 07:55:56 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 07:55:56.650445 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4624e806-ca9a-4285-b889-1ed54fb325da admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:55:56.673242 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 977/1956] 10.222.0.57 () {60 vars in 1144 bytes} [Fri Sep 16 07:55:56 2022] POST /identity/v3/users => generated 296 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 07:55:56.675282 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926c6889-f455-42fc-874a-fd2c26c7f294 None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:56.675561 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926c6889-f455-42fc-874a-fd2c26c7f294 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:56.675841 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926c6889-f455-42fc-874a-fd2c26c7f294 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:56.687955 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4624e806-ca9a-4285-b889-1ed54fb325da admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:55:56.693673 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63cc712-7508-44b0-a281-0e75be11f39d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:55:56.694835 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63cc712-7508-44b0-a281-0e75be11f39d admin admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:56.695321 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63cc712-7508-44b0-a281-0e75be11f39d admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:56.695881 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63cc712-7508-44b0-a281-0e75be11f39d admin admin] PATH_INFO: `/v3/roles` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:56.696722 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63cc712-7508-44b0-a281-0e75be11f39d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:55:56.699036 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63cc712-7508-44b0-a281-0e75be11f39d admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:55:56.700773 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-926c6889-f455-42fc-874a-fd2c26c7f294 None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:55:56.702508 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-926c6889-f455-42fc-874a-fd2c26c7f294 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:55:56.711356 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 978/1957] 10.222.0.57 () {58 vars in 958 bytes} [Fri Sep 16 07:55:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 07:55:56.713747 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 980/1958] 10.222.0.57 () {58 vars in 1122 bytes} [Fri Sep 16 07:55:56 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 07:55:56.714973 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63cc712-7508-44b0-a281-0e75be11f39d admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:55:56.718003 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926c6889-f455-42fc-874a-fd2c26c7f294 None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:55:56.730776 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63cc712-7508-44b0-a281-0e75be11f39d admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:55:56.732043 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926c6889-f455-42fc-874a-fd2c26c7f294 None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:55:56.737163 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e364b1eb-030f-4136-b633-41ac1d78235e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:55:56.737317 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cefa0f-5f15-4621-bc42-03d9eb6cee2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:55:56.738079 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cefa0f-5f15-4621-bc42-03d9eb6cee2f admin admin] REQUEST_METHOD: `PUT` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:56.738320 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cefa0f-5f15-4621-bc42-03d9eb6cee2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:56.738597 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cefa0f-5f15-4621-bc42-03d9eb6cee2f admin admin] PATH_INFO: `/v3/projects/a39c9adc042642998251867dc7528fcd/users/0516d93854fc4c489cb85cf7457ee9b4/roles/4818d38cf2564825b312e66c9eb24762` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:56.741062 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e364b1eb-030f-4136-b633-41ac1d78235e admin admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:56.743370 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e364b1eb-030f-4136-b633-41ac1d78235e admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:56.744414 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e364b1eb-030f-4136-b633-41ac1d78235e admin admin] PATH_INFO: `/v3/roles` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:56.745785 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e364b1eb-030f-4136-b633-41ac1d78235e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:55:56.748235 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e364b1eb-030f-4136-b633-41ac1d78235e admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:55:56.765530 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 981/1959] 10.222.0.57 () {58 vars in 1122 bytes} [Fri Sep 16 07:55:56 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 07:55:56.767917 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e364b1eb-030f-4136-b633-41ac1d78235e admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:55:56.769937 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83cefa0f-5f15-4621-bc42-03d9eb6cee2f admin admin] RBAC: Authorizing `identity:create_grant(project_id=a39c9adc042642998251867dc7528fcd, user_id=0516d93854fc4c489cb85cf7457ee9b4, role_id=4818d38cf2564825b312e66c9eb24762)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:55:56.772739 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83cefa0f-5f15-4621-bc42-03d9eb6cee2f admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:55:56.780444 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e364b1eb-030f-4136-b633-41ac1d78235e admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:55:56.792460 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00aadbf-6c37-4c34-b622-d1ebfdaa5850 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:55:56.794119 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00aadbf-6c37-4c34-b622-d1ebfdaa5850 admin admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:56.794354 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00aadbf-6c37-4c34-b622-d1ebfdaa5850 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:56.794620 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00aadbf-6c37-4c34-b622-d1ebfdaa5850 admin admin] PATH_INFO: `/v3/roles` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:56.795515 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00aadbf-6c37-4c34-b622-d1ebfdaa5850 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:55:56.797944 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00aadbf-6c37-4c34-b622-d1ebfdaa5850 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:55:56.802311 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 979/1960] 10.222.0.57 () {60 vars in 1483 bytes} [Fri Sep 16 07:55:56 2022] PUT /identity/v3/projects/a39c9adc042642998251867dc7528fcd/users/0516d93854fc4c489cb85cf7457ee9b4/roles/4818d38cf2564825b312e66c9eb24762 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 07:55:56.804892 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cefa0f-5f15-4621-bc42-03d9eb6cee2f admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:55:56.826446 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=87,keystone:DELETE=5,keystone:INSERT=8 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:55:56.829886 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 982/1961] 10.222.0.57 () {58 vars in 1122 bytes} [Fri Sep 16 07:55:56 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 07:55:56.834135 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00aadbf-6c37-4c34-b622-d1ebfdaa5850 admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:55:56.853860 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00aadbf-6c37-4c34-b622-d1ebfdaa5850 admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:55:56.915882 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cefa0f-5f15-4621-bc42-03d9eb6cee2f admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:55:56.921306 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fff9ce-6663-4a14-a409-18bcb170cef8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:55:56.922224 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fff9ce-6663-4a14-a409-18bcb170cef8 admin admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:56.922564 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fff9ce-6663-4a14-a409-18bcb170cef8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:56.922850 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fff9ce-6663-4a14-a409-18bcb170cef8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:56.923956 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88fff9ce-6663-4a14-a409-18bcb170cef8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:55:56.924605 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88fff9ce-6663-4a14-a409-18bcb170cef8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:55:56.926262 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88fff9ce-6663-4a14-a409-18bcb170cef8 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:55:56.958429 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc0fd47-83b2-4a1b-a23f-842a568744e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:55:56.959110 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc0fd47-83b2-4a1b-a23f-842a568744e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:56.959387 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc0fd47-83b2-4a1b-a23f-842a568744e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:56.959661 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc0fd47-83b2-4a1b-a23f-842a568744e1 admin admin] PATH_INFO: `/v3/projects/884ee5bee6b3440ab3e54b84f1cb50a6/users/699d71968f0c462d9b49033d36cc642a/roles/567db03c91854ad9af1e9a87ec1bd275` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:56.961791 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 980/1962] 10.222.0.57 () {58 vars in 1153 bytes} [Fri Sep 16 07:55:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:55:56.967128 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de209d0-a70e-4519-94ba-c739582a4abc None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:56.967416 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de209d0-a70e-4519-94ba-c739582a4abc None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:56.967684 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de209d0-a70e-4519-94ba-c739582a4abc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:56.982625 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc0fd47-83b2-4a1b-a23f-842a568744e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=884ee5bee6b3440ab3e54b84f1cb50a6, user_id=699d71968f0c462d9b49033d36cc642a, role_id=567db03c91854ad9af1e9a87ec1bd275)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:55:56.986170 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc0fd47-83b2-4a1b-a23f-842a568744e1 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:55:57.007017 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 983/1963] 10.222.0.57 () {60 vars in 1483 bytes} [Fri Sep 16 07:55:56 2022] PUT /identity/v3/projects/884ee5bee6b3440ab3e54b84f1cb50a6/users/699d71968f0c462d9b49033d36cc642a/roles/567db03c91854ad9af1e9a87ec1bd275 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 07:55:57.007900 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc0fd47-83b2-4a1b-a23f-842a568744e1 admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:55:57.014968 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-0de209d0-a70e-4519-94ba-c739582a4abc None None] MFA Rules not processed for user `0516d93854fc4c489cb85cf7457ee9b4`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:55:57.016764 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-0de209d0-a70e-4519-94ba-c739582a4abc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:55:57.091820 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc0fd47-83b2-4a1b-a23f-842a568744e1 admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:55:57.104109 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3213903f-b14a-49df-88dd-f4a8c0af89b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:55:57.104788 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3213903f-b14a-49df-88dd-f4a8c0af89b7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:57.105055 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3213903f-b14a-49df-88dd-f4a8c0af89b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:57.105373 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3213903f-b14a-49df-88dd-f4a8c0af89b7 admin admin] PATH_INFO: `/v3/projects/653ede4d0cad415eb0580937c32471ee/users/5d3ba6a628e444d8aa65f245c83dcf6a/roles/4818d38cf2564825b312e66c9eb24762` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:57.115762 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 981/1964] 10.222.0.57 () {58 vars in 958 bytes} [Fri Sep 16 07:55:56 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 07:55:57.117618 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de209d0-a70e-4519-94ba-c739582a4abc None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:55:57.131773 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de209d0-a70e-4519-94ba-c739582a4abc None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:55:57.150209 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1c68b3-123a-4390-a2c7-0214ed8ed4a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:55:57.150887 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1c68b3-123a-4390-a2c7-0214ed8ed4a9 admin admin] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:57.151380 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1c68b3-123a-4390-a2c7-0214ed8ed4a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:57.151542 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1c68b3-123a-4390-a2c7-0214ed8ed4a9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:57.152304 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1c68b3-123a-4390-a2c7-0214ed8ed4a9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:55:57.154257 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1c68b3-123a-4390-a2c7-0214ed8ed4a9 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:55:57.158162 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3213903f-b14a-49df-88dd-f4a8c0af89b7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=653ede4d0cad415eb0580937c32471ee, user_id=5d3ba6a628e444d8aa65f245c83dcf6a, role_id=4818d38cf2564825b312e66c9eb24762)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:55:57.167470 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3213903f-b14a-49df-88dd-f4a8c0af89b7 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:55:57.187537 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 984/1965] 10.222.0.57 () {60 vars in 1483 bytes} [Fri Sep 16 07:55:57 2022] PUT /identity/v3/projects/653ede4d0cad415eb0580937c32471ee/users/5d3ba6a628e444d8aa65f245c83dcf6a/roles/4818d38cf2564825b312e66c9eb24762 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 07:55:57.203549 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3213903f-b14a-49df-88dd-f4a8c0af89b7 admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:55:57.231336 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:55:57.249625 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 982/1966] 10.222.0.57 () {60 vars in 1153 bytes} [Fri Sep 16 07:55:57 2022] POST /identity/v3/projects => generated 387 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 07:55:57.252687 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1c68b3-123a-4390-a2c7-0214ed8ed4a9 admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:55:57.380194 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1c68b3-123a-4390-a2c7-0214ed8ed4a9 admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:55:57.386052 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78b63c7-c8da-4b9b-a024-6cccd68cd515 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:55:57.386207 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3213903f-b14a-49df-88dd-f4a8c0af89b7 admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:55:57.389059 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78b63c7-c8da-4b9b-a024-6cccd68cd515 admin admin] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:57.389205 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78b63c7-c8da-4b9b-a024-6cccd68cd515 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:57.389446 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78b63c7-c8da-4b9b-a024-6cccd68cd515 admin admin] PATH_INFO: `/v3/projects` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:57.390295 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78b63c7-c8da-4b9b-a024-6cccd68cd515 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:55:57.393247 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78b63c7-c8da-4b9b-a024-6cccd68cd515 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:55:57.401855 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90b87ef-c5ab-4de4-8df6-2c475c113c02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:55:57.402687 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90b87ef-c5ab-4de4-8df6-2c475c113c02 admin admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:57.404056 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90b87ef-c5ab-4de4-8df6-2c475c113c02 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:57.404339 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90b87ef-c5ab-4de4-8df6-2c475c113c02 admin admin] PATH_INFO: `/v3/roles` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:57.406458 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90b87ef-c5ab-4de4-8df6-2c475c113c02 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:55:57.412318 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90b87ef-c5ab-4de4-8df6-2c475c113c02 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:55:57.418001 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:55:57.435756 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 985/1967] 10.222.0.57 () {58 vars in 1122 bytes} [Fri Sep 16 07:55:57 2022] GET /identity/v3/roles => generated 1420 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 07:55:57.437368 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425cea03-f802-4457-966a-bd8117bfd3db None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:57.437897 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425cea03-f802-4457-966a-bd8117bfd3db None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:57.438409 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425cea03-f802-4457-966a-bd8117bfd3db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:57.448141 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 983/1968] 10.222.0.57 () {60 vars in 1153 bytes} [Fri Sep 16 07:55:57 2022] POST /identity/v3/projects => generated 401 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 07:55:57.448141 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78b63c7-c8da-4b9b-a024-6cccd68cd515 admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:55:57.490050 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-425cea03-f802-4457-966a-bd8117bfd3db None None] MFA Rules not processed for user `5d3ba6a628e444d8aa65f245c83dcf6a`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:55:57.492740 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-425cea03-f802-4457-966a-bd8117bfd3db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:55:57.567783 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78b63c7-c8da-4b9b-a024-6cccd68cd515 admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:55:57.575927 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24870adf-3901-49f0-894d-c95d647f22e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:55:57.577936 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24870adf-3901-49f0-894d-c95d647f22e6 admin admin] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:57.578289 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24870adf-3901-49f0-894d-c95d647f22e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:57.578573 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24870adf-3901-49f0-894d-c95d647f22e6 admin admin] PATH_INFO: `/v3/users` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:57.580735 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24870adf-3901-49f0-894d-c95d647f22e6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:55:57.594237 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24870adf-3901-49f0-894d-c95d647f22e6 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:55:57.605294 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 986/1969] 10.222.0.57 () {58 vars in 958 bytes} [Fri Sep 16 07:55:57 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 07:55:57.606462 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425cea03-f802-4457-966a-bd8117bfd3db None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:55:57.620919 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425cea03-f802-4457-966a-bd8117bfd3db None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:55:57.622180 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 984/1970] 10.222.0.57 () {60 vars in 1144 bytes} [Fri Sep 16 07:55:57 2022] POST /identity/v3/users => generated 294 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 07:55:57.623491 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24870adf-3901-49f0-894d-c95d647f22e6 admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:55:57.627096 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e781200c-dcb7-40be-b911-3d84b2716bdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:55:57.627981 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e781200c-dcb7-40be-b911-3d84b2716bdf admin admin] REQUEST_METHOD: `PUT` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:57.628519 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e781200c-dcb7-40be-b911-3d84b2716bdf admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:57.628805 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e781200c-dcb7-40be-b911-3d84b2716bdf admin admin] PATH_INFO: `/v3/projects/884ee5bee6b3440ab3e54b84f1cb50a6/users/699d71968f0c462d9b49033d36cc642a/roles/567db03c91854ad9af1e9a87ec1bd275` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:57.631079 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e781200c-dcb7-40be-b911-3d84b2716bdf admin admin] RBAC: Authorizing `identity:create_grant(project_id=884ee5bee6b3440ab3e54b84f1cb50a6, user_id=699d71968f0c462d9b49033d36cc642a, role_id=567db03c91854ad9af1e9a87ec1bd275)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:55:57.634474 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e781200c-dcb7-40be-b911-3d84b2716bdf admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:55:57.638475 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24870adf-3901-49f0-894d-c95d647f22e6 admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:55:57.645638 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b6ee6b-fb28-478a-ab15-d3c03ad3f43b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:55:57.646732 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b6ee6b-fb28-478a-ab15-d3c03ad3f43b admin admin] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:57.647199 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b6ee6b-fb28-478a-ab15-d3c03ad3f43b admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:57.647656 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b6ee6b-fb28-478a-ab15-d3c03ad3f43b admin admin] PATH_INFO: `/v3/users` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:57.647815 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 987/1971] 10.222.0.57 () {60 vars in 1483 bytes} [Fri Sep 16 07:55:57 2022] PUT /identity/v3/projects/884ee5bee6b3440ab3e54b84f1cb50a6/users/699d71968f0c462d9b49033d36cc642a/roles/567db03c91854ad9af1e9a87ec1bd275 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 07:55:57.648725 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b6ee6b-fb28-478a-ab15-d3c03ad3f43b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:55:57.648886 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e781200c-dcb7-40be-b911-3d84b2716bdf admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:55:57.651476 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b6ee6b-fb28-478a-ab15-d3c03ad3f43b admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:55:57.708903 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 985/1972] 10.222.0.57 () {60 vars in 1144 bytes} [Fri Sep 16 07:55:57 2022] POST /identity/v3/users => generated 307 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 07:55:57.714704 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b6ee6b-fb28-478a-ab15-d3c03ad3f43b admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:55:57.733106 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b6ee6b-fb28-478a-ab15-d3c03ad3f43b admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:55:57.760659 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e781200c-dcb7-40be-b911-3d84b2716bdf admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:55:57.773610 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9275f6f8-6bad-4664-a450-3ac16080c530 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:55:57.774861 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9275f6f8-6bad-4664-a450-3ac16080c530 admin admin] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:57.775245 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9275f6f8-6bad-4664-a450-3ac16080c530 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:57.776072 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9275f6f8-6bad-4664-a450-3ac16080c530 admin admin] PATH_INFO: `/v3/projects` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:57.776632 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9275f6f8-6bad-4664-a450-3ac16080c530 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:55:57.778750 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9275f6f8-6bad-4664-a450-3ac16080c530 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:55:57.820468 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 988/1973] 10.222.0.57 () {60 vars in 1153 bytes} [Fri Sep 16 07:55:57 2022] POST /identity/v3/projects => generated 375 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 07:55:57.820468 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c857581c-bfdc-4bc5-b930-51cf86e064aa None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:57.820468 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c857581c-bfdc-4bc5-b930-51cf86e064aa None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:57.820468 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c857581c-bfdc-4bc5-b930-51cf86e064aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:57.825550 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e1fb99-9a88-4bc0-8577-9d3fa4cc4924 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:55:57.826267 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e1fb99-9a88-4bc0-8577-9d3fa4cc4924 admin admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:57.826747 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e1fb99-9a88-4bc0-8577-9d3fa4cc4924 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:57.826925 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e1fb99-9a88-4bc0-8577-9d3fa4cc4924 admin admin] PATH_INFO: `/v3/roles` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:57.827586 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e1fb99-9a88-4bc0-8577-9d3fa4cc4924 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:55:57.829880 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e1fb99-9a88-4bc0-8577-9d3fa4cc4924 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:55:57.841592 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 986/1974] 10.222.0.57 () {58 vars in 1122 bytes} [Fri Sep 16 07:55:57 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 07:55:57.845111 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e1fb99-9a88-4bc0-8577-9d3fa4cc4924 admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:55:57.847106 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:55:57.855445 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e1fb99-9a88-4bc0-8577-9d3fa4cc4924 admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:55:57.866288 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-c857581c-bfdc-4bc5-b930-51cf86e064aa None None] MFA Rules not processed for user `699d71968f0c462d9b49033d36cc642a`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:55:57.867752 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-c857581c-bfdc-4bc5-b930-51cf86e064aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:55:57.932835 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b160ee-d0bf-48ee-94a9-561e32462b77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:55:57.934079 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b160ee-d0bf-48ee-94a9-561e32462b77 admin admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:57.934406 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b160ee-d0bf-48ee-94a9-561e32462b77 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:57.935183 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b160ee-d0bf-48ee-94a9-561e32462b77 admin admin] PATH_INFO: `/v3/roles` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:57.936096 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b160ee-d0bf-48ee-94a9-561e32462b77 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:55:57.937686 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b160ee-d0bf-48ee-94a9-561e32462b77 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:55:57.945470 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:55:57.954423 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 987/1975] 10.222.0.57 () {58 vars in 1122 bytes} [Fri Sep 16 07:55:57 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 07:55:57.956564 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b160ee-d0bf-48ee-94a9-561e32462b77 admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:55:57.960591 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 989/1976] 10.222.0.57 () {58 vars in 958 bytes} [Fri Sep 16 07:55:57 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 07:55:57.962049 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c857581c-bfdc-4bc5-b930-51cf86e064aa None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:55:57.974447 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b160ee-d0bf-48ee-94a9-561e32462b77 admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:55:57.978848 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c857581c-bfdc-4bc5-b930-51cf86e064aa None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:55:57.979181 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c923c3d5-2d80-4b0b-918f-217ecf3b48ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:55:57.979787 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c923c3d5-2d80-4b0b-918f-217ecf3b48ad admin admin] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:57.980067 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c923c3d5-2d80-4b0b-918f-217ecf3b48ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:57.980337 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c923c3d5-2d80-4b0b-918f-217ecf3b48ad admin admin] PATH_INFO: `/v3/users` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:57.980961 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c923c3d5-2d80-4b0b-918f-217ecf3b48ad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:55:57.982885 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c923c3d5-2d80-4b0b-918f-217ecf3b48ad admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:55:57.983895 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036fea4c-c1f8-4ce7-850f-cf724756d87c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:55:57.984603 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036fea4c-c1f8-4ce7-850f-cf724756d87c admin admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:57.985013 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036fea4c-c1f8-4ce7-850f-cf724756d87c admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:57.985943 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036fea4c-c1f8-4ce7-850f-cf724756d87c admin admin] PATH_INFO: `/v3/roles` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:57.986872 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036fea4c-c1f8-4ce7-850f-cf724756d87c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:55:57.988783 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036fea4c-c1f8-4ce7-850f-cf724756d87c admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:55:58.000986 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 990/1977] 10.222.0.57 () {58 vars in 1122 bytes} [Fri Sep 16 07:55:57 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 07:55:58.002559 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036fea4c-c1f8-4ce7-850f-cf724756d87c admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:55:58.014286 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 988/1978] 10.222.0.57 () {60 vars in 1144 bytes} [Fri Sep 16 07:55:57 2022] POST /identity/v3/users => generated 294 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 07:55:58.014286 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c923c3d5-2d80-4b0b-918f-217ecf3b48ad admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:55:58.014572 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036fea4c-c1f8-4ce7-850f-cf724756d87c admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:55:58.015692 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-c923c3d5-2d80-4b0b-918f-217ecf3b48ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:55:58.019752 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d93724-67f4-4156-ab57-06cde6b9e45b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:55:58.020497 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d93724-67f4-4156-ab57-06cde6b9e45b admin admin] REQUEST_METHOD: `PUT` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:58.021015 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d93724-67f4-4156-ab57-06cde6b9e45b admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:58.021365 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d93724-67f4-4156-ab57-06cde6b9e45b admin admin] PATH_INFO: `/v3/projects/5318bccb8ffc476183c3a3e54443d878/users/943ae22f63f345008f7d539cca064ee6/roles/567db03c91854ad9af1e9a87ec1bd275` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:58.042068 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d93724-67f4-4156-ab57-06cde6b9e45b admin admin] RBAC: Authorizing `identity:create_grant(project_id=5318bccb8ffc476183c3a3e54443d878, user_id=943ae22f63f345008f7d539cca064ee6, role_id=567db03c91854ad9af1e9a87ec1bd275)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:55:58.044763 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d93724-67f4-4156-ab57-06cde6b9e45b admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:55:58.060938 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 991/1979] 10.222.0.57 () {60 vars in 1483 bytes} [Fri Sep 16 07:55:58 2022] PUT /identity/v3/projects/5318bccb8ffc476183c3a3e54443d878/users/943ae22f63f345008f7d539cca064ee6/roles/567db03c91854ad9af1e9a87ec1bd275 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 07:55:58.061560 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d93724-67f4-4156-ab57-06cde6b9e45b admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:55:58.089154 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c923c3d5-2d80-4b0b-918f-217ecf3b48ad admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:55:58.148179 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d93724-67f4-4156-ab57-06cde6b9e45b admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:55:58.152169 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ad6bbf-4c15-4602-968e-4b6c5b805976 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544bf6be4c24454a013ca110c43cef2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4735f453c0c24cc4a1c14e9ac84a0b46', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:55:58.152893 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ad6bbf-4c15-4602-968e-4b6c5b805976 service cinder] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:58.153218 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ad6bbf-4c15-4602-968e-4b6c5b805976 service cinder] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:58.153522 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ad6bbf-4c15-4602-968e-4b6c5b805976 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:58.153765 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450a6b4f-0cd0-45d9-95eb-09dece2026a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:55:58.154549 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450a6b4f-0cd0-45d9-95eb-09dece2026a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:58.154833 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450a6b4f-0cd0-45d9-95eb-09dece2026a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:58.155103 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450a6b4f-0cd0-45d9-95eb-09dece2026a2 admin admin] PATH_INFO: `/v3/projects/7f4eb8ffb6684b1389002fcddf75819f/users/5838ea7581c341c09d4585a94570301c/roles/4818d38cf2564825b312e66c9eb24762` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:58.155582 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-76ad6bbf-4c15-4602-968e-4b6c5b805976 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:55:58.170464 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450a6b4f-0cd0-45d9-95eb-09dece2026a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f4eb8ffb6684b1389002fcddf75819f, user_id=5838ea7581c341c09d4585a94570301c, role_id=4818d38cf2564825b312e66c9eb24762)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:55:58.173653 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450a6b4f-0cd0-45d9-95eb-09dece2026a2 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:55:58.188015 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 992/1980] 10.222.0.57 () {60 vars in 1483 bytes} [Fri Sep 16 07:55:58 2022] PUT /identity/v3/projects/7f4eb8ffb6684b1389002fcddf75819f/users/5838ea7581c341c09d4585a94570301c/roles/4818d38cf2564825b312e66c9eb24762 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 07:55:58.198583 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450a6b4f-0cd0-45d9-95eb-09dece2026a2 admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:55:58.225546 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ad6bbf-4c15-4602-968e-4b6c5b805976 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:55:58.227025 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ad6bbf-4c15-4602-968e-4b6c5b805976 service cinder] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:55:58.237763 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 989/1981] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Sep 16 07:55:58 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 07:55:58.240264 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ad6bbf-4c15-4602-968e-4b6c5b805976 service cinder] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:55:58.250340 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:55:58.251436 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ad6bbf-4c15-4602-968e-4b6c5b805976 service cinder] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:55:58.279203 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450a6b4f-0cd0-45d9-95eb-09dece2026a2 admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:55:58.284859 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c3f8d9-419c-402c-a37f-994d6366ff5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:55:58.285481 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c3f8d9-419c-402c-a37f-994d6366ff5b admin admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:58.285784 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c3f8d9-419c-402c-a37f-994d6366ff5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:58.286061 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c3f8d9-419c-402c-a37f-994d6366ff5b admin admin] PATH_INFO: `/v3/roles` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:58.287148 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c3f8d9-419c-402c-a37f-994d6366ff5b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:55:58.288420 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c3f8d9-419c-402c-a37f-994d6366ff5b admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:55:58.303545 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 993/1982] 10.222.0.57 () {58 vars in 1122 bytes} [Fri Sep 16 07:55:58 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 07:55:58.306212 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53123b17-b0a7-4652-8a71-155fb1da4a4a None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:58.306510 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53123b17-b0a7-4652-8a71-155fb1da4a4a None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:58.306792 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53123b17-b0a7-4652-8a71-155fb1da4a4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:58.321426 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:55:58.335990 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d640d1-4749-44e3-ab38-2665b9503e22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:55:58.336611 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d640d1-4749-44e3-ab38-2665b9503e22 admin admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:58.336889 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d640d1-4749-44e3-ab38-2665b9503e22 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:58.337160 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d640d1-4749-44e3-ab38-2665b9503e22 admin admin] PATH_INFO: `/v3/roles` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:58.337864 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d640d1-4749-44e3-ab38-2665b9503e22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:55:58.340881 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d640d1-4749-44e3-ab38-2665b9503e22 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:55:58.341956 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-53123b17-b0a7-4652-8a71-155fb1da4a4a None None] MFA Rules not processed for user `5838ea7581c341c09d4585a94570301c`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:55:58.343484 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-53123b17-b0a7-4652-8a71-155fb1da4a4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:55:58.356563 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 990/1983] 10.222.0.57 () {58 vars in 1122 bytes} [Fri Sep 16 07:55:58 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 07:55:58.357615 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d640d1-4749-44e3-ab38-2665b9503e22 admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:55:58.373824 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d640d1-4749-44e3-ab38-2665b9503e22 admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:55:58.381104 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4526f7-24f4-429a-a01d-6fb738ee5fab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:55:58.382436 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4526f7-24f4-429a-a01d-6fb738ee5fab admin admin] REQUEST_METHOD: `PUT` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:58.382966 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4526f7-24f4-429a-a01d-6fb738ee5fab admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:58.383075 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4526f7-24f4-429a-a01d-6fb738ee5fab admin admin] PATH_INFO: `/v3/projects/7fb2f27781e14cf59e44c070dcfec8ab/users/44f92456b8f84c60894c1d04aef834ee/roles/567db03c91854ad9af1e9a87ec1bd275` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:58.404678 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4526f7-24f4-429a-a01d-6fb738ee5fab admin admin] RBAC: Authorizing `identity:create_grant(project_id=7fb2f27781e14cf59e44c070dcfec8ab, user_id=44f92456b8f84c60894c1d04aef834ee, role_id=567db03c91854ad9af1e9a87ec1bd275)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:55:58.408692 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4526f7-24f4-429a-a01d-6fb738ee5fab admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:55:58.430365 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 991/1984] 10.222.0.57 () {60 vars in 1483 bytes} [Fri Sep 16 07:55:58 2022] PUT /identity/v3/projects/7fb2f27781e14cf59e44c070dcfec8ab/users/44f92456b8f84c60894c1d04aef834ee/roles/567db03c91854ad9af1e9a87ec1bd275 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 07:55:58.430984 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4526f7-24f4-429a-a01d-6fb738ee5fab admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:55:58.449031 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 994/1985] 10.222.0.57 () {58 vars in 958 bytes} [Fri Sep 16 07:55:58 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 07:55:58.452917 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53123b17-b0a7-4652-8a71-155fb1da4a4a None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:55:58.466363 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53123b17-b0a7-4652-8a71-155fb1da4a4a None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:55:58.521562 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4526f7-24f4-429a-a01d-6fb738ee5fab admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:55:58.529239 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd50505-9eb0-4bc1-af66-1c0958880060 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:55:58.529972 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd50505-9eb0-4bc1-af66-1c0958880060 admin admin] REQUEST_METHOD: `PUT` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:58.530253 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd50505-9eb0-4bc1-af66-1c0958880060 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:58.530525 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd50505-9eb0-4bc1-af66-1c0958880060 admin admin] PATH_INFO: `/v3/projects/5318bccb8ffc476183c3a3e54443d878/users/943ae22f63f345008f7d539cca064ee6/roles/567db03c91854ad9af1e9a87ec1bd275` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:58.532634 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd50505-9eb0-4bc1-af66-1c0958880060 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5318bccb8ffc476183c3a3e54443d878, user_id=943ae22f63f345008f7d539cca064ee6, role_id=567db03c91854ad9af1e9a87ec1bd275)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:55:58.534419 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bd772b-25fb-4934-b60b-52ce4041fd43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:55:58.535568 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bd772b-25fb-4934-b60b-52ce4041fd43 admin admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:58.535678 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd50505-9eb0-4bc1-af66-1c0958880060 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:55:58.536166 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bd772b-25fb-4934-b60b-52ce4041fd43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:58.536632 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bd772b-25fb-4934-b60b-52ce4041fd43 admin admin] PATH_INFO: `/v3/roles` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:58.537461 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92bd772b-25fb-4934-b60b-52ce4041fd43 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:55:58.539373 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92bd772b-25fb-4934-b60b-52ce4041fd43 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:55:58.557472 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 992/1986] 10.222.0.57 () {60 vars in 1483 bytes} [Fri Sep 16 07:55:58 2022] PUT /identity/v3/projects/5318bccb8ffc476183c3a3e54443d878/users/943ae22f63f345008f7d539cca064ee6/roles/567db03c91854ad9af1e9a87ec1bd275 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 07:55:58.559102 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd50505-9eb0-4bc1-af66-1c0958880060 admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:55:58.570574 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 995/1987] 10.222.0.57 () {58 vars in 1122 bytes} [Fri Sep 16 07:55:58 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 07:55:58.572519 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254b2b2c-adf0-47b7-89da-b2ea14bb56bf None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:58.572519 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254b2b2c-adf0-47b7-89da-b2ea14bb56bf None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:58.572519 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254b2b2c-adf0-47b7-89da-b2ea14bb56bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:58.633800 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-254b2b2c-adf0-47b7-89da-b2ea14bb56bf None None] MFA Rules not processed for user `943ae22f63f345008f7d539cca064ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:55:58.635029 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-254b2b2c-adf0-47b7-89da-b2ea14bb56bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:55:58.716815 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:55:58.734101 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd50505-9eb0-4bc1-af66-1c0958880060 admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:55:58.742115 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a49eb8-2e63-4f62-a0f6-b75ba56cda8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:55:58.743419 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a49eb8-2e63-4f62-a0f6-b75ba56cda8a admin admin] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:58.743799 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a49eb8-2e63-4f62-a0f6-b75ba56cda8a admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:58.744361 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a49eb8-2e63-4f62-a0f6-b75ba56cda8a admin admin] PATH_INFO: `/v3/projects` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:58.745468 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a49eb8-2e63-4f62-a0f6-b75ba56cda8a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:55:58.746215 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 996/1988] 10.222.0.57 () {58 vars in 958 bytes} [Fri Sep 16 07:55:58 2022] POST /identity/v3/auth/tokens => generated 3345 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 07:55:58.746994 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254b2b2c-adf0-47b7-89da-b2ea14bb56bf None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:55:58.752934 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a49eb8-2e63-4f62-a0f6-b75ba56cda8a admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:55:58.761782 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254b2b2c-adf0-47b7-89da-b2ea14bb56bf None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:55:58.768229 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b53bae-e3e2-403e-8114-7fb2126152fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:55:58.769311 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b53bae-e3e2-403e-8114-7fb2126152fc admin admin] REQUEST_METHOD: `PUT` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:58.769737 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b53bae-e3e2-403e-8114-7fb2126152fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:58.770329 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b53bae-e3e2-403e-8114-7fb2126152fc admin admin] PATH_INFO: `/v3/projects/7fb2f27781e14cf59e44c070dcfec8ab/users/44f92456b8f84c60894c1d04aef834ee/roles/567db03c91854ad9af1e9a87ec1bd275` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:58.772465 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b53bae-e3e2-403e-8114-7fb2126152fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=7fb2f27781e14cf59e44c070dcfec8ab, user_id=44f92456b8f84c60894c1d04aef834ee, role_id=567db03c91854ad9af1e9a87ec1bd275)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:55:58.775689 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b53bae-e3e2-403e-8114-7fb2126152fc admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:55:58.790524 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 997/1989] 10.222.0.57 () {60 vars in 1483 bytes} [Fri Sep 16 07:55:58 2022] PUT /identity/v3/projects/7fb2f27781e14cf59e44c070dcfec8ab/users/44f92456b8f84c60894c1d04aef834ee/roles/567db03c91854ad9af1e9a87ec1bd275 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 07:55:58.791626 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b53bae-e3e2-403e-8114-7fb2126152fc admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:55:58.794750 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 993/1990] 10.222.0.57 () {60 vars in 1153 bytes} [Fri Sep 16 07:55:58 2022] POST /identity/v3/projects => generated 385 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 07:55:58.804450 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a49eb8-2e63-4f62-a0f6-b75ba56cda8a admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:55:58.903830 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:55:58.921001 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b53bae-e3e2-403e-8114-7fb2126152fc admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:55:58.948725 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a49eb8-2e63-4f62-a0f6-b75ba56cda8a admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:55:58.967134 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc63aaa0-5dfb-4e67-ad7a-baa049fa9061 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:55:58.968184 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc63aaa0-5dfb-4e67-ad7a-baa049fa9061 admin admin] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:58.968690 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc63aaa0-5dfb-4e67-ad7a-baa049fa9061 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:58.969169 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc63aaa0-5dfb-4e67-ad7a-baa049fa9061 admin admin] PATH_INFO: `/v3/users` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:58.972224 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc63aaa0-5dfb-4e67-ad7a-baa049fa9061 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:55:58.978859 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc63aaa0-5dfb-4e67-ad7a-baa049fa9061 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:55:59.006578 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce4e4e8-a335-453b-9b87-3189663279ce service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544bf6be4c24454a013ca110c43cef2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4735f453c0c24cc4a1c14e9ac84a0b46', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:55:59.007350 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce4e4e8-a335-453b-9b87-3189663279ce service cinder] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:59.007646 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce4e4e8-a335-453b-9b87-3189663279ce service cinder] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:59.007951 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce4e4e8-a335-453b-9b87-3189663279ce service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:59.017444 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 994/1991] 10.222.0.57 () {60 vars in 1144 bytes} [Fri Sep 16 07:55:58 2022] POST /identity/v3/users => generated 299 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 07:55:59.019462 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf835c43-d5a9-4d8a-ac12-267158fdebc1 None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:59.028235 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf835c43-d5a9-4d8a-ac12-267158fdebc1 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:59.028613 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf835c43-d5a9-4d8a-ac12-267158fdebc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:59.072396 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-cf835c43-d5a9-4d8a-ac12-267158fdebc1 None None] MFA Rules not processed for user `44f92456b8f84c60894c1d04aef834ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:55:59.073670 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-cf835c43-d5a9-4d8a-ac12-267158fdebc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:55:59.094445 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce4e4e8-a335-453b-9b87-3189663279ce service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:55:59.097215 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce4e4e8-a335-453b-9b87-3189663279ce service cinder] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:55:59.110093 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 998/1992] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Sep 16 07:55:58 2022] GET /identity/v3/auth/tokens => generated 3345 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 07:55:59.111424 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce4e4e8-a335-453b-9b87-3189663279ce service cinder] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:55:59.128064 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce4e4e8-a335-453b-9b87-3189663279ce service cinder] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:55:59.133859 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6be33a3-d6ac-4621-9f6d-a55851a3acd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:55:59.134474 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6be33a3-d6ac-4621-9f6d-a55851a3acd7 admin admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:59.145757 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6be33a3-d6ac-4621-9f6d-a55851a3acd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:59.145757 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6be33a3-d6ac-4621-9f6d-a55851a3acd7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:59.145757 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6be33a3-d6ac-4621-9f6d-a55851a3acd7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:55:59.145757 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6be33a3-d6ac-4621-9f6d-a55851a3acd7 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:55:59.152491 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 999/1993] 10.222.0.57 () {58 vars in 1122 bytes} [Fri Sep 16 07:55:59 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 07:55:59.153351 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6be33a3-d6ac-4621-9f6d-a55851a3acd7 admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:55:59.166946 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6be33a3-d6ac-4621-9f6d-a55851a3acd7 admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:55:59.173815 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79879d9e-ba09-4ec3-9068-a44716ce50e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:55:59.174481 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79879d9e-ba09-4ec3-9068-a44716ce50e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:59.174750 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79879d9e-ba09-4ec3-9068-a44716ce50e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:59.175022 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79879d9e-ba09-4ec3-9068-a44716ce50e8 admin admin] PATH_INFO: `/v3/projects/d5d57cb8aa7e43a68be461f7fe32e6df/users/ada6a13b48334b8bb905042624a3852a/roles/567db03c91854ad9af1e9a87ec1bd275` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:59.202790 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79879d9e-ba09-4ec3-9068-a44716ce50e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d5d57cb8aa7e43a68be461f7fe32e6df, user_id=ada6a13b48334b8bb905042624a3852a, role_id=567db03c91854ad9af1e9a87ec1bd275)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:55:59.212628 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79879d9e-ba09-4ec3-9068-a44716ce50e8 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:55:59.217680 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 995/1994] 10.222.0.57 () {58 vars in 958 bytes} [Fri Sep 16 07:55:59 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 07:55:59.232377 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf835c43-d5a9-4d8a-ac12-267158fdebc1 None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:55:59.247182 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf835c43-d5a9-4d8a-ac12-267158fdebc1 None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:55:59.252660 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1000/1995] 10.222.0.57 () {60 vars in 1483 bytes} [Fri Sep 16 07:55:59 2022] PUT /identity/v3/projects/d5d57cb8aa7e43a68be461f7fe32e6df/users/ada6a13b48334b8bb905042624a3852a/roles/567db03c91854ad9af1e9a87ec1bd275 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 07:55:59.253940 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79879d9e-ba09-4ec3-9068-a44716ce50e8 admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:55:59.263965 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:55:59.339160 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd36cb28-1a8b-4678-acfe-e34984cd64d3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544bf6be4c24454a013ca110c43cef2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4735f453c0c24cc4a1c14e9ac84a0b46', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:55:59.340270 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd36cb28-1a8b-4678-acfe-e34984cd64d3 service cinder] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:59.340785 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd36cb28-1a8b-4678-acfe-e34984cd64d3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:59.341243 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd36cb28-1a8b-4678-acfe-e34984cd64d3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:59.357770 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79879d9e-ba09-4ec3-9068-a44716ce50e8 admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:55:59.364600 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1fcd40-7e85-4365-8ff4-08cf5ac2e2e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:55:59.365324 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1fcd40-7e85-4365-8ff4-08cf5ac2e2e7 admin admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:59.365667 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1fcd40-7e85-4365-8ff4-08cf5ac2e2e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:59.366704 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1fcd40-7e85-4365-8ff4-08cf5ac2e2e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:59.367426 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1fcd40-7e85-4365-8ff4-08cf5ac2e2e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:55:59.369905 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1fcd40-7e85-4365-8ff4-08cf5ac2e2e7 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:55:59.385892 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1001/1996] 10.222.0.57 () {58 vars in 1122 bytes} [Fri Sep 16 07:55:59 2022] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 07:55:59.386782 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1fcd40-7e85-4365-8ff4-08cf5ac2e2e7 admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:55:59.388658 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-be1fcd40-7e85-4365-8ff4-08cf5ac2e2e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:55:59.401257 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1fcd40-7e85-4365-8ff4-08cf5ac2e2e7 admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:55:59.405161 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5562e2bd-14dc-40bd-9f95-3df0626127c8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544bf6be4c24454a013ca110c43cef2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4735f453c0c24cc4a1c14e9ac84a0b46', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:55:59.405790 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5562e2bd-14dc-40bd-9f95-3df0626127c8 service cinder] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:59.406085 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5562e2bd-14dc-40bd-9f95-3df0626127c8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:59.406384 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5562e2bd-14dc-40bd-9f95-3df0626127c8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:59.419439 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd36cb28-1a8b-4678-acfe-e34984cd64d3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:55:59.420814 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd36cb28-1a8b-4678-acfe-e34984cd64d3 service cinder] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:55:59.438073 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 996/1997] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Sep 16 07:55:59 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 07:55:59.441349 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd36cb28-1a8b-4678-acfe-e34984cd64d3 service cinder] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:55:59.455813 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd36cb28-1a8b-4678-acfe-e34984cd64d3 service cinder] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:55:59.461388 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf79eb3-f38f-4289-b796-7965202a41a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:55:59.462144 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf79eb3-f38f-4289-b796-7965202a41a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:59.462499 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf79eb3-f38f-4289-b796-7965202a41a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:59.462837 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf79eb3-f38f-4289-b796-7965202a41a0 admin admin] PATH_INFO: `/v3/projects/d5d57cb8aa7e43a68be461f7fe32e6df/users/ada6a13b48334b8bb905042624a3852a/roles/567db03c91854ad9af1e9a87ec1bd275` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:59.466418 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf79eb3-f38f-4289-b796-7965202a41a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d5d57cb8aa7e43a68be461f7fe32e6df, user_id=ada6a13b48334b8bb905042624a3852a, role_id=567db03c91854ad9af1e9a87ec1bd275)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:55:59.469096 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf79eb3-f38f-4289-b796-7965202a41a0 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:55:59.474953 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:55:59.484544 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5562e2bd-14dc-40bd-9f95-3df0626127c8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:55:59.486925 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5562e2bd-14dc-40bd-9f95-3df0626127c8 service cinder] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:55:59.496472 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 997/1998] 10.222.0.57 () {60 vars in 1483 bytes} [Fri Sep 16 07:55:59 2022] PUT /identity/v3/projects/d5d57cb8aa7e43a68be461f7fe32e6df/users/ada6a13b48334b8bb905042624a3852a/roles/567db03c91854ad9af1e9a87ec1bd275 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 07:55:59.497477 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf79eb3-f38f-4289-b796-7965202a41a0 admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:55:59.500085 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1002/1999] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Sep 16 07:55:59 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 07:55:59.524882 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22db598-f0a3-4bae-b409-eff17949f970 None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:59.525293 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22db598-f0a3-4bae-b409-eff17949f970 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:59.525555 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22db598-f0a3-4bae-b409-eff17949f970 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:59.585716 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf79eb3-f38f-4289-b796-7965202a41a0 admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:55:59.591358 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054dcdbc-be81-48d5-9b4b-242054f886dc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544bf6be4c24454a013ca110c43cef2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4735f453c0c24cc4a1c14e9ac84a0b46', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:55:59.592354 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054dcdbc-be81-48d5-9b4b-242054f886dc service cinder] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:59.592758 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054dcdbc-be81-48d5-9b4b-242054f886dc service cinder] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:59.603608 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054dcdbc-be81-48d5-9b4b-242054f886dc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:59.605679 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-054dcdbc-be81-48d5-9b4b-242054f886dc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:55:59.633950 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-d22db598-f0a3-4bae-b409-eff17949f970 None None] MFA Rules not processed for user `ada6a13b48334b8bb905042624a3852a`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:55:59.635204 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-d22db598-f0a3-4bae-b409-eff17949f970 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:55:59.705343 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054dcdbc-be81-48d5-9b4b-242054f886dc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:55:59.706830 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054dcdbc-be81-48d5-9b4b-242054f886dc service cinder] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:55:59.733591 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 998/2000] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Sep 16 07:55:59 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 07:55:59.749892 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1003/2001] 10.222.0.57 () {58 vars in 958 bytes} [Fri Sep 16 07:55:59 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 07:55:59.836636 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054dcdbc-be81-48d5-9b4b-242054f886dc service cinder] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:55:59.846165 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054dcdbc-be81-48d5-9b4b-242054f886dc service cinder] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:55:59.849950 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905b43e5-a69b-4b17-96ab-928b7df694b2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544bf6be4c24454a013ca110c43cef2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4735f453c0c24cc4a1c14e9ac84a0b46', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:55:59.850564 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905b43e5-a69b-4b17-96ab-928b7df694b2 service cinder] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:59.850851 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905b43e5-a69b-4b17-96ab-928b7df694b2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:59.851127 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905b43e5-a69b-4b17-96ab-928b7df694b2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:55:59.862104 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905b43e5-a69b-4b17-96ab-928b7df694b2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:55:59.863653 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905b43e5-a69b-4b17-96ab-928b7df694b2 service cinder] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:55:59.885384 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 999/2002] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Sep 16 07:55:59 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 07:55:59.906640 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22db598-f0a3-4bae-b409-eff17949f970 None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:55:59.909746 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905b43e5-a69b-4b17-96ab-928b7df694b2 service cinder] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:55:59.938594 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22db598-f0a3-4bae-b409-eff17949f970 None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:55:59.953012 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c99e4b-b554-4568-8ba4-0de900741e1e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544bf6be4c24454a013ca110c43cef2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4735f453c0c24cc4a1c14e9ac84a0b46', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:55:59.953652 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c99e4b-b554-4568-8ba4-0de900741e1e service cinder] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:55:59.955563 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c99e4b-b554-4568-8ba4-0de900741e1e service cinder] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:55:59.955860 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c99e4b-b554-4568-8ba4-0de900741e1e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:00.049263 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:56:00.091119 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905b43e5-a69b-4b17-96ab-928b7df694b2 service cinder] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:56:00.110031 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acdc84c-64cb-4aae-a5fc-c6ea5a28a75d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:56:00.110738 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acdc84c-64cb-4aae-a5fc-c6ea5a28a75d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:00.111018 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acdc84c-64cb-4aae-a5fc-c6ea5a28a75d admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:00.111298 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acdc84c-64cb-4aae-a5fc-c6ea5a28a75d admin admin] PATH_INFO: `/v3/users/5838ea7581c341c09d4585a94570301c` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:00.112784 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1acdc84c-64cb-4aae-a5fc-c6ea5a28a75d admin admin] RBAC: Authorizing `identity:delete_user(user_id=5838ea7581c341c09d4585a94570301c)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:56:00.118553 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1acdc84c-64cb-4aae-a5fc-c6ea5a28a75d admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:56:00.144542 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c99e4b-b554-4568-8ba4-0de900741e1e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:56:00.148392 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c99e4b-b554-4568-8ba4-0de900741e1e service cinder] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:56:00.214244 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1004/2003] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Sep 16 07:55:59 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 07:56:00.258705 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:56:00.272436 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-1acdc84c-64cb-4aae-a5fc-c6ea5a28a75d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5838ea7581c341c09d4585a94570301c'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:56:00.273914 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-1acdc84c-64cb-4aae-a5fc-c6ea5a28a75d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5838ea7581c341c09d4585a94570301c'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:56:00.296469 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-1acdc84c-64cb-4aae-a5fc-c6ea5a28a75d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5838ea7581c341c09d4585a94570301c'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:56:00.317631 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-1acdc84c-64cb-4aae-a5fc-c6ea5a28a75d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5838ea7581c341c09d4585a94570301c'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:56:00.332552 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-1acdc84c-64cb-4aae-a5fc-c6ea5a28a75d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5838ea7581c341c09d4585a94570301c'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:56:00.352233 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1000/2004] 10.222.0.57 () {58 vars in 1224 bytes} [Fri Sep 16 07:55:59 2022] DELETE /identity/v3/users/5838ea7581c341c09d4585a94570301c => generated 0 bytes in 444 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 07:56:00.357367 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceff4e65-b42b-402c-9299-b0d959becad7 None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:00.357790 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceff4e65-b42b-402c-9299-b0d959becad7 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:00.358192 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceff4e65-b42b-402c-9299-b0d959becad7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:00.421024 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-ceff4e65-b42b-402c-9299-b0d959becad7 None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:56:00.421593 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-ceff4e65-b42b-402c-9299-b0d959becad7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:56:00.606496 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1005/2005] 10.222.0.57 () {58 vars in 958 bytes} [Fri Sep 16 07:56:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 07:56:00.620395 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acdc84c-64cb-4aae-a5fc-c6ea5a28a75d admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:56:00.622424 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-1acdc84c-64cb-4aae-a5fc-c6ea5a28a75d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:56:00.761342 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acdc84c-64cb-4aae-a5fc-c6ea5a28a75d admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:56:00.774717 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5dcb40a-0d47-413a-b861-9b1c821ed45c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1062e457207a41e4ba4f0a0c4bf36f1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4735f453c0c24cc4a1c14e9ac84a0b46', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:56:00.775490 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dcb40a-0d47-413a-b861-9b1c821ed45c service neutron] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:00.775746 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dcb40a-0d47-413a-b861-9b1c821ed45c service neutron] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:00.776016 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dcb40a-0d47-413a-b861-9b1c821ed45c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:00.787698 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5dcb40a-0d47-413a-b861-9b1c821ed45c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:56:00.789443 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5dcb40a-0d47-413a-b861-9b1c821ed45c service neutron] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:56:00.805757 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1001/2006] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Sep 16 07:56:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 07:56:01.223667 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceff4e65-b42b-402c-9299-b0d959becad7 None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:56:01.225364 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-ceff4e65-b42b-402c-9299-b0d959becad7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:56:01.247139 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceff4e65-b42b-402c-9299-b0d959becad7 None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:56:01.255994 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701740fe-3dd2-42b5-ab02-ac9225d1b0c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:56:01.256954 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701740fe-3dd2-42b5-ab02-ac9225d1b0c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:01.257374 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701740fe-3dd2-42b5-ab02-ac9225d1b0c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:01.257638 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701740fe-3dd2-42b5-ab02-ac9225d1b0c5 admin admin] PATH_INFO: `/v3/projects/7f4eb8ffb6684b1389002fcddf75819f` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:01.259657 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701740fe-3dd2-42b5-ab02-ac9225d1b0c5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7f4eb8ffb6684b1389002fcddf75819f)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:56:01.262097 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701740fe-3dd2-42b5-ab02-ac9225d1b0c5 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:56:01.314704 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-701740fe-3dd2-42b5-ab02-ac9225d1b0c5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7f4eb8ffb6684b1389002fcddf75819f', 'request_id': 'req-701740fe-3dd2-42b5-ab02-ac9225d1b0c5'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:56:01.322325 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-701740fe-3dd2-42b5-ab02-ac9225d1b0c5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7f4eb8ffb6684b1389002fcddf75819f', 'request_id': 'req-701740fe-3dd2-42b5-ab02-ac9225d1b0c5'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:56:01.331849 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-701740fe-3dd2-42b5-ab02-ac9225d1b0c5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7f4eb8ffb6684b1389002fcddf75819f', 'request_id': 'req-701740fe-3dd2-42b5-ab02-ac9225d1b0c5'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:56:01.343049 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-701740fe-3dd2-42b5-ab02-ac9225d1b0c5 admin admin] The token cache is being invalidate because project 7f4eb8ffb6684b1389002fcddf75819f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81431) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 07:56:01.343371 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-701740fe-3dd2-42b5-ab02-ac9225d1b0c5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:56:01.343953 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-701740fe-3dd2-42b5-ab02-ac9225d1b0c5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:56:01.345466 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1006/2007] 10.222.0.57 () {58 vars in 1233 bytes} [Fri Sep 16 07:56:01 2022] DELETE /identity/v3/projects/7f4eb8ffb6684b1389002fcddf75819f => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 07:56:01.349515 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5dcb40a-0d47-413a-b861-9b1c821ed45c service neutron] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:56:01.359260 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5dcb40a-0d47-413a-b861-9b1c821ed45c service neutron] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:56:01.418970 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ce198e-3340-4f35-b21d-a21137fa6814 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:56:01.419624 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ce198e-3340-4f35-b21d-a21137fa6814 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:01.419908 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ce198e-3340-4f35-b21d-a21137fa6814 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:01.420187 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ce198e-3340-4f35-b21d-a21137fa6814 admin admin] PATH_INFO: `/v3/users/ada6a13b48334b8bb905042624a3852a` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:01.421448 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ce198e-3340-4f35-b21d-a21137fa6814 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ada6a13b48334b8bb905042624a3852a)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:56:01.425369 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ce198e-3340-4f35-b21d-a21137fa6814 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:56:01.486344 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-a3ce198e-3340-4f35-b21d-a21137fa6814 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ada6a13b48334b8bb905042624a3852a'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:56:01.487289 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-a3ce198e-3340-4f35-b21d-a21137fa6814 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ada6a13b48334b8bb905042624a3852a'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:56:01.497708 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-a3ce198e-3340-4f35-b21d-a21137fa6814 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ada6a13b48334b8bb905042624a3852a'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:56:01.506101 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:56:01.517571 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-a3ce198e-3340-4f35-b21d-a21137fa6814 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ada6a13b48334b8bb905042624a3852a'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:56:01.528038 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-a3ce198e-3340-4f35-b21d-a21137fa6814 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ada6a13b48334b8bb905042624a3852a'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:56:01.536435 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1002/2008] 10.222.0.57 () {58 vars in 1224 bytes} [Fri Sep 16 07:56:01 2022] DELETE /identity/v3/users/ada6a13b48334b8bb905042624a3852a => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 07:56:01.911548 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701740fe-3dd2-42b5-ab02-ac9225d1b0c5 admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:56:01.913126 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-701740fe-3dd2-42b5-ab02-ac9225d1b0c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:56:01.927733 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701740fe-3dd2-42b5-ab02-ac9225d1b0c5 admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:56:01.993140 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:56:02.023760 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faaa5a99-ffdb-43bc-bf7f-d8de3a763d70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:56:02.024538 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faaa5a99-ffdb-43bc-bf7f-d8de3a763d70 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:02.026044 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faaa5a99-ffdb-43bc-bf7f-d8de3a763d70 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:02.026430 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faaa5a99-ffdb-43bc-bf7f-d8de3a763d70 admin admin] PATH_INFO: `/v3/projects/d5d57cb8aa7e43a68be461f7fe32e6df` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:02.028524 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faaa5a99-ffdb-43bc-bf7f-d8de3a763d70 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d5d57cb8aa7e43a68be461f7fe32e6df)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:56:02.034941 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faaa5a99-ffdb-43bc-bf7f-d8de3a763d70 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:56:02.148173 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-faaa5a99-ffdb-43bc-bf7f-d8de3a763d70 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd5d57cb8aa7e43a68be461f7fe32e6df', 'request_id': 'req-faaa5a99-ffdb-43bc-bf7f-d8de3a763d70'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:56:02.156139 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-faaa5a99-ffdb-43bc-bf7f-d8de3a763d70 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd5d57cb8aa7e43a68be461f7fe32e6df', 'request_id': 'req-faaa5a99-ffdb-43bc-bf7f-d8de3a763d70'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:56:02.169007 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-faaa5a99-ffdb-43bc-bf7f-d8de3a763d70 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd5d57cb8aa7e43a68be461f7fe32e6df', 'request_id': 'req-faaa5a99-ffdb-43bc-bf7f-d8de3a763d70'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:56:02.182162 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-faaa5a99-ffdb-43bc-bf7f-d8de3a763d70 admin admin] The token cache is being invalidate because project d5d57cb8aa7e43a68be461f7fe32e6df was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81431) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 07:56:02.182451 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-faaa5a99-ffdb-43bc-bf7f-d8de3a763d70 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:56:02.183104 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-faaa5a99-ffdb-43bc-bf7f-d8de3a763d70 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:56:02.184691 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1007/2009] 10.222.0.57 () {58 vars in 1233 bytes} [Fri Sep 16 07:56:01 2022] DELETE /identity/v3/projects/d5d57cb8aa7e43a68be461f7fe32e6df => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 07:56:02.190122 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0883d13-af80-441b-98e4-94eb90dd44f7 None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:02.190662 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0883d13-af80-441b-98e4-94eb90dd44f7 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:02.190910 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0883d13-af80-441b-98e4-94eb90dd44f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:02.215032 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-a0883d13-af80-441b-98e4-94eb90dd44f7 None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:56:02.216380 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-a0883d13-af80-441b-98e4-94eb90dd44f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:56:02.295739 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1003/2010] 10.222.0.57 () {58 vars in 958 bytes} [Fri Sep 16 07:56:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 07:56:02.297364 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20db94e-b95b-4c4b-ad30-fbcdc3172b7a None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:02.298093 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20db94e-b95b-4c4b-ad30-fbcdc3172b7a None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:02.298093 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20db94e-b95b-4c4b-ad30-fbcdc3172b7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:02.333785 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-a20db94e-b95b-4c4b-ad30-fbcdc3172b7a None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:56:02.335003 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-a20db94e-b95b-4c4b-ad30-fbcdc3172b7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:56:02.345190 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1008/2011] 10.222.0.57 () {58 vars in 958 bytes} [Fri Sep 16 07:56:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 07:56:02.349192 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0883d13-af80-441b-98e4-94eb90dd44f7 None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:56:02.359003 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0883d13-af80-441b-98e4-94eb90dd44f7 None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:56:02.364515 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d62b1bc-d1db-4c88-9e43-255c9f936532 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:56:02.365140 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d62b1bc-d1db-4c88-9e43-255c9f936532 admin admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:02.365683 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d62b1bc-d1db-4c88-9e43-255c9f936532 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:02.366152 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d62b1bc-d1db-4c88-9e43-255c9f936532 admin admin] PATH_INFO: `/v3/domains` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:02.367008 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d62b1bc-d1db-4c88-9e43-255c9f936532 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:56:02.367505 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d62b1bc-d1db-4c88-9e43-255c9f936532 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:56:02.369702 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d62b1bc-d1db-4c88-9e43-255c9f936532 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:56:02.393250 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1004/2012] 10.222.0.57 () {58 vars in 1153 bytes} [Fri Sep 16 07:56:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:56:02.398104 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20db94e-b95b-4c4b-ad30-fbcdc3172b7a None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:56:02.420573 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20db94e-b95b-4c4b-ad30-fbcdc3172b7a None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:56:02.431331 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5dc9b16-db38-4274-8e55-b5973391edbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:56:02.431954 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dc9b16-db38-4274-8e55-b5973391edbb admin admin] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:02.432233 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dc9b16-db38-4274-8e55-b5973391edbb admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:02.432504 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dc9b16-db38-4274-8e55-b5973391edbb admin admin] PATH_INFO: `/v3/projects` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:02.434159 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5dc9b16-db38-4274-8e55-b5973391edbb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:56:02.437098 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5dc9b16-db38-4274-8e55-b5973391edbb admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:56:02.478644 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1009/2013] 10.222.0.57 () {60 vars in 1153 bytes} [Fri Sep 16 07:56:02 2022] POST /identity/v3/projects => generated 383 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 16 07:56:02.479829 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d62b1bc-d1db-4c88-9e43-255c9f936532 admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:56:02.491653 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d62b1bc-d1db-4c88-9e43-255c9f936532 admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:56:02.567245 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f3da3b-f8fe-4362-8c51-e5a699f0a577 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:56:02.567245 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f3da3b-f8fe-4362-8c51-e5a699f0a577 admin admin] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:02.567245 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f3da3b-f8fe-4362-8c51-e5a699f0a577 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:02.567245 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f3da3b-f8fe-4362-8c51-e5a699f0a577 admin admin] PATH_INFO: `/v3/users` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:02.567928 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f3da3b-f8fe-4362-8c51-e5a699f0a577 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:56:02.569018 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f3da3b-f8fe-4362-8c51-e5a699f0a577 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:56:02.593417 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1005/2014] 10.222.0.57 () {60 vars in 1144 bytes} [Fri Sep 16 07:56:02 2022] POST /identity/v3/users => generated 292 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 07:56:02.595050 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5dc9b16-db38-4274-8e55-b5973391edbb admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:56:02.605859 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5dc9b16-db38-4274-8e55-b5973391edbb admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:56:02.611415 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5edb65-c92e-42d5-b54f-e1e97844eede admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:56:02.612027 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5edb65-c92e-42d5-b54f-e1e97844eede admin admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:02.612310 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5edb65-c92e-42d5-b54f-e1e97844eede admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:02.612582 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5edb65-c92e-42d5-b54f-e1e97844eede admin admin] PATH_INFO: `/v3/roles` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:02.613232 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5edb65-c92e-42d5-b54f-e1e97844eede admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:56:02.615321 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5edb65-c92e-42d5-b54f-e1e97844eede admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:56:02.627387 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1010/2015] 10.222.0.57 () {58 vars in 1122 bytes} [Fri Sep 16 07:56:02 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 16 07:56:02.631654 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f3da3b-f8fe-4362-8c51-e5a699f0a577 admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:56:02.642938 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f3da3b-f8fe-4362-8c51-e5a699f0a577 admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:56:02.648525 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead0c923-add9-4160-9063-d227160e10f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:56:02.649177 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead0c923-add9-4160-9063-d227160e10f2 admin admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:02.649427 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead0c923-add9-4160-9063-d227160e10f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:02.649699 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead0c923-add9-4160-9063-d227160e10f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:02.650395 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead0c923-add9-4160-9063-d227160e10f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:56:02.652068 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead0c923-add9-4160-9063-d227160e10f2 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:56:02.662746 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1006/2016] 10.222.0.57 () {58 vars in 1122 bytes} [Fri Sep 16 07:56:02 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 07:56:02.666940 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5edb65-c92e-42d5-b54f-e1e97844eede admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:56:02.677407 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5edb65-c92e-42d5-b54f-e1e97844eede admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:56:02.682102 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461b3e54-6c9c-4bfe-a169-a55e4ecfbdb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:56:02.682747 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461b3e54-6c9c-4bfe-a169-a55e4ecfbdb4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:02.683025 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461b3e54-6c9c-4bfe-a169-a55e4ecfbdb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:02.683296 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461b3e54-6c9c-4bfe-a169-a55e4ecfbdb4 admin admin] PATH_INFO: `/v3/projects/3be065132d6744e182cb0b5235b20a47/users/af6ec817b2084fe3b0bc5aca3a40b2db/roles/4818d38cf2564825b312e66c9eb24762` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:02.698751 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461b3e54-6c9c-4bfe-a169-a55e4ecfbdb4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3be065132d6744e182cb0b5235b20a47, user_id=af6ec817b2084fe3b0bc5aca3a40b2db, role_id=4818d38cf2564825b312e66c9eb24762)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:56:02.701416 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461b3e54-6c9c-4bfe-a169-a55e4ecfbdb4 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:56:02.714250 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1011/2017] 10.222.0.57 () {60 vars in 1483 bytes} [Fri Sep 16 07:56:02 2022] PUT /identity/v3/projects/3be065132d6744e182cb0b5235b20a47/users/af6ec817b2084fe3b0bc5aca3a40b2db/roles/4818d38cf2564825b312e66c9eb24762 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 07:56:02.725109 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bad7bde-a45a-40e4-8f13-1f71469cbe17 None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:02.725435 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bad7bde-a45a-40e4-8f13-1f71469cbe17 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:02.725802 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bad7bde-a45a-40e4-8f13-1f71469cbe17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:02.754731 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-6bad7bde-a45a-40e4-8f13-1f71469cbe17 None None] MFA Rules not processed for user `af6ec817b2084fe3b0bc5aca3a40b2db`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:56:02.755931 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-6bad7bde-a45a-40e4-8f13-1f71469cbe17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:56:02.789609 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:56:02.824830 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1007/2018] 10.222.0.57 () {58 vars in 958 bytes} [Fri Sep 16 07:56:02 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 07:56:02.829634 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461b3e54-6c9c-4bfe-a169-a55e4ecfbdb4 admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:56:02.899883 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461b3e54-6c9c-4bfe-a169-a55e4ecfbdb4 admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:56:02.904722 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7b87c3-db40-4bbd-b28b-dee83889747f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:56:02.905330 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7b87c3-db40-4bbd-b28b-dee83889747f admin admin] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:02.905605 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7b87c3-db40-4bbd-b28b-dee83889747f admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:02.905914 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7b87c3-db40-4bbd-b28b-dee83889747f admin admin] PATH_INFO: `/v3/projects` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:02.906538 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7b87c3-db40-4bbd-b28b-dee83889747f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:56:02.909533 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7b87c3-db40-4bbd-b28b-dee83889747f admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:56:02.948706 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:56:02.990349 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1012/2019] 10.222.0.57 () {60 vars in 1153 bytes} [Fri Sep 16 07:56:02 2022] POST /identity/v3/projects => generated 381 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 16 07:56:02.993148 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bad7bde-a45a-40e4-8f13-1f71469cbe17 None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:56:03.005141 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bad7bde-a45a-40e4-8f13-1f71469cbe17 None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:56:03.075661 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7998d91d-5ed5-47d2-a965-35979c420811 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:56:03.076219 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7998d91d-5ed5-47d2-a965-35979c420811 admin admin] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:03.076500 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7998d91d-5ed5-47d2-a965-35979c420811 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:03.076772 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7998d91d-5ed5-47d2-a965-35979c420811 admin admin] PATH_INFO: `/v3/users` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:03.077399 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7998d91d-5ed5-47d2-a965-35979c420811 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:56:03.079920 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7998d91d-5ed5-47d2-a965-35979c420811 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:56:03.105875 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1008/2020] 10.222.0.57 () {60 vars in 1144 bytes} [Fri Sep 16 07:56:02 2022] POST /identity/v3/users => generated 297 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 16 07:56:03.108735 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7b87c3-db40-4bbd-b28b-dee83889747f admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:56:03.120330 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7b87c3-db40-4bbd-b28b-dee83889747f admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:56:03.125487 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9adea2-fac5-474a-86be-1e6bbdcf6166 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:56:03.126194 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9adea2-fac5-474a-86be-1e6bbdcf6166 admin admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:03.126595 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9adea2-fac5-474a-86be-1e6bbdcf6166 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:03.126868 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9adea2-fac5-474a-86be-1e6bbdcf6166 admin admin] PATH_INFO: `/v3/roles` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:03.127503 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9adea2-fac5-474a-86be-1e6bbdcf6166 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:56:03.129089 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9adea2-fac5-474a-86be-1e6bbdcf6166 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:56:03.139882 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1013/2021] 10.222.0.57 () {58 vars in 1122 bytes} [Fri Sep 16 07:56:03 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 16 07:56:03.144939 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7998d91d-5ed5-47d2-a965-35979c420811 admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:56:03.154945 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7998d91d-5ed5-47d2-a965-35979c420811 admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:56:03.161027 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eaca8ed-b994-4949-b064-1a67ae6f71d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:56:03.161689 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eaca8ed-b994-4949-b064-1a67ae6f71d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:03.162021 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eaca8ed-b994-4949-b064-1a67ae6f71d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:03.162299 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eaca8ed-b994-4949-b064-1a67ae6f71d7 admin admin] PATH_INFO: `/v3/projects/df1420bbd6994222b692379cec1a6265/users/d0374c163b934acd967df84fd448bb04/roles/567db03c91854ad9af1e9a87ec1bd275` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:03.184784 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eaca8ed-b994-4949-b064-1a67ae6f71d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=df1420bbd6994222b692379cec1a6265, user_id=d0374c163b934acd967df84fd448bb04, role_id=567db03c91854ad9af1e9a87ec1bd275)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:56:03.187814 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eaca8ed-b994-4949-b064-1a67ae6f71d7 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:56:03.215785 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1009/2022] 10.222.0.57 () {60 vars in 1483 bytes} [Fri Sep 16 07:56:03 2022] PUT /identity/v3/projects/df1420bbd6994222b692379cec1a6265/users/d0374c163b934acd967df84fd448bb04/roles/567db03c91854ad9af1e9a87ec1bd275 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 07:56:03.220731 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9adea2-fac5-474a-86be-1e6bbdcf6166 admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:56:03.231431 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9adea2-fac5-474a-86be-1e6bbdcf6166 admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:56:03.298090 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17553272-d618-4a61-8d18-d465e90a355b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:56:03.298658 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17553272-d618-4a61-8d18-d465e90a355b admin admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:03.298944 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17553272-d618-4a61-8d18-d465e90a355b admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:03.299188 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17553272-d618-4a61-8d18-d465e90a355b admin admin] PATH_INFO: `/v3/roles` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:03.299816 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17553272-d618-4a61-8d18-d465e90a355b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:56:03.301572 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17553272-d618-4a61-8d18-d465e90a355b admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:56:03.311981 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1014/2023] 10.222.0.57 () {58 vars in 1122 bytes} [Fri Sep 16 07:56:03 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 07:56:03.318420 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eaca8ed-b994-4949-b064-1a67ae6f71d7 admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:56:03.332973 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eaca8ed-b994-4949-b064-1a67ae6f71d7 admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:56:03.337642 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0dce74-5e97-46ff-93a1-df7dde2216f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:56:03.338333 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0dce74-5e97-46ff-93a1-df7dde2216f3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:03.338604 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0dce74-5e97-46ff-93a1-df7dde2216f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:03.338899 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0dce74-5e97-46ff-93a1-df7dde2216f3 admin admin] PATH_INFO: `/v3/projects/df1420bbd6994222b692379cec1a6265/users/d0374c163b934acd967df84fd448bb04/roles/567db03c91854ad9af1e9a87ec1bd275` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:03.340806 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0dce74-5e97-46ff-93a1-df7dde2216f3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=df1420bbd6994222b692379cec1a6265, user_id=d0374c163b934acd967df84fd448bb04, role_id=567db03c91854ad9af1e9a87ec1bd275)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:56:03.343676 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0dce74-5e97-46ff-93a1-df7dde2216f3 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:56:03.358221 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1010/2024] 10.222.0.57 () {60 vars in 1483 bytes} [Fri Sep 16 07:56:03 2022] PUT /identity/v3/projects/df1420bbd6994222b692379cec1a6265/users/d0374c163b934acd967df84fd448bb04/roles/567db03c91854ad9af1e9a87ec1bd275 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 07:56:03.371039 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904c7724-1f18-4d71-86d1-986447af9d91 None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:03.371324 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904c7724-1f18-4d71-86d1-986447af9d91 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:03.371592 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904c7724-1f18-4d71-86d1-986447af9d91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:03.413141 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-904c7724-1f18-4d71-86d1-986447af9d91 None None] MFA Rules not processed for user `d0374c163b934acd967df84fd448bb04`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:56:03.414773 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-904c7724-1f18-4d71-86d1-986447af9d91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:56:03.506490 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1015/2025] 10.222.0.57 () {58 vars in 958 bytes} [Fri Sep 16 07:56:03 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 16 07:56:03.575073 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0dce74-5e97-46ff-93a1-df7dde2216f3 admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:56:03.577513 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-8e0dce74-5e97-46ff-93a1-df7dde2216f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:56:03.686057 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0dce74-5e97-46ff-93a1-df7dde2216f3 admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:56:03.692912 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81991fe8-5c08-4880-988d-5e1a9881017c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544bf6be4c24454a013ca110c43cef2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4735f453c0c24cc4a1c14e9ac84a0b46', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:56:03.694466 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81991fe8-5c08-4880-988d-5e1a9881017c service cinder] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:03.695086 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81991fe8-5c08-4880-988d-5e1a9881017c service cinder] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:03.695656 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81991fe8-5c08-4880-988d-5e1a9881017c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:03.707717 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81991fe8-5c08-4880-988d-5e1a9881017c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:56:03.709502 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81991fe8-5c08-4880-988d-5e1a9881017c service cinder] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:56:03.722316 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1011/2026] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Sep 16 07:56:03 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 07:56:03.879650 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904c7724-1f18-4d71-86d1-986447af9d91 None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:56:03.881221 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-904c7724-1f18-4d71-86d1-986447af9d91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:56:03.907228 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81991fe8-5c08-4880-988d-5e1a9881017c service cinder] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:56:03.908921 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-81991fe8-5c08-4880-988d-5e1a9881017c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:56:03.944084 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:56:03.958763 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904c7724-1f18-4d71-86d1-986447af9d91 None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:56:03.964549 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0c4898-6b9e-45c6-be3d-69f79ee4dcd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:56:03.965320 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0c4898-6b9e-45c6-be3d-69f79ee4dcd7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:03.965598 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0c4898-6b9e-45c6-be3d-69f79ee4dcd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:03.965994 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0c4898-6b9e-45c6-be3d-69f79ee4dcd7 admin admin] PATH_INFO: `/v3/users/0516d93854fc4c489cb85cf7457ee9b4` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:03.967285 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0c4898-6b9e-45c6-be3d-69f79ee4dcd7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0516d93854fc4c489cb85cf7457ee9b4)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:56:03.970596 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0c4898-6b9e-45c6-be3d-69f79ee4dcd7 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:56:03.977026 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:56:03.980502 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81991fe8-5c08-4880-988d-5e1a9881017c service cinder] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:56:03.985501 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed4ab7b-9292-4018-9146-c3e10e559264 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:56:03.986332 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed4ab7b-9292-4018-9146-c3e10e559264 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:03.986603 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed4ab7b-9292-4018-9146-c3e10e559264 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:03.986873 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed4ab7b-9292-4018-9146-c3e10e559264 admin admin] PATH_INFO: `/v3/users/6c0b659cf8df4c67bfd08a21e1bfd4ac` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:03.988005 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed4ab7b-9292-4018-9146-c3e10e559264 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6c0b659cf8df4c67bfd08a21e1bfd4ac)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:56:03.989995 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed4ab7b-9292-4018-9146-c3e10e559264 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:56:04.026341 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-7c0c4898-6b9e-45c6-be3d-69f79ee4dcd7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0516d93854fc4c489cb85cf7457ee9b4'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:56:04.040363 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-7c0c4898-6b9e-45c6-be3d-69f79ee4dcd7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0516d93854fc4c489cb85cf7457ee9b4'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:56:04.041187 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-7c0c4898-6b9e-45c6-be3d-69f79ee4dcd7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0516d93854fc4c489cb85cf7457ee9b4'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:56:04.042827 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-8ed4ab7b-9292-4018-9146-c3e10e559264 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6c0b659cf8df4c67bfd08a21e1bfd4ac'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:56:04.043527 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-8ed4ab7b-9292-4018-9146-c3e10e559264 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6c0b659cf8df4c67bfd08a21e1bfd4ac'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:56:04.049595 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-7c0c4898-6b9e-45c6-be3d-69f79ee4dcd7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0516d93854fc4c489cb85cf7457ee9b4'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:56:04.051992 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-8ed4ab7b-9292-4018-9146-c3e10e559264 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6c0b659cf8df4c67bfd08a21e1bfd4ac'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:56:04.058517 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-7c0c4898-6b9e-45c6-be3d-69f79ee4dcd7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0516d93854fc4c489cb85cf7457ee9b4'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:56:04.065533 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-8ed4ab7b-9292-4018-9146-c3e10e559264 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6c0b659cf8df4c67bfd08a21e1bfd4ac'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:56:04.065982 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1016/2027] 10.222.0.57 () {58 vars in 1224 bytes} [Fri Sep 16 07:56:03 2022] DELETE /identity/v3/users/0516d93854fc4c489cb85cf7457ee9b4 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 07:56:04.066769 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0c4898-6b9e-45c6-be3d-69f79ee4dcd7 admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:56:04.068074 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-7c0c4898-6b9e-45c6-be3d-69f79ee4dcd7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:56:04.075143 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-8ed4ab7b-9292-4018-9146-c3e10e559264 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6c0b659cf8df4c67bfd08a21e1bfd4ac'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:56:04.081244 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1012/2028] 10.222.0.57 () {58 vars in 1224 bytes} [Fri Sep 16 07:56:03 2022] DELETE /identity/v3/users/6c0b659cf8df4c67bfd08a21e1bfd4ac => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 16 07:56:04.084344 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b6db3e-b7be-457d-8115-3fa1d1676a0d None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:04.084344 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b6db3e-b7be-457d-8115-3fa1d1676a0d None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:04.084344 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b6db3e-b7be-457d-8115-3fa1d1676a0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:04.101918 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-60b6db3e-b7be-457d-8115-3fa1d1676a0d None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:56:04.103108 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-60b6db3e-b7be-457d-8115-3fa1d1676a0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:56:04.137775 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0c4898-6b9e-45c6-be3d-69f79ee4dcd7 admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:56:04.164259 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1013/2029] 10.222.0.57 () {58 vars in 958 bytes} [Fri Sep 16 07:56:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 07:56:04.165513 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb17637-b91f-427f-bdbe-688b5f2b1b78 None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:04.165935 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb17637-b91f-427f-bdbe-688b5f2b1b78 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:04.166222 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb17637-b91f-427f-bdbe-688b5f2b1b78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:04.187151 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-8fb17637-b91f-427f-bdbe-688b5f2b1b78 None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:56:04.187410 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86eee5a2-3c73-4aa6-a8f8-9c8ec01f608e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544bf6be4c24454a013ca110c43cef2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4735f453c0c24cc4a1c14e9ac84a0b46', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:56:04.188022 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86eee5a2-3c73-4aa6-a8f8-9c8ec01f608e service cinder] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:04.189026 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-8fb17637-b91f-427f-bdbe-688b5f2b1b78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:56:04.189131 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86eee5a2-3c73-4aa6-a8f8-9c8ec01f608e service cinder] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:04.189346 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86eee5a2-3c73-4aa6-a8f8-9c8ec01f608e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:04.191069 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-86eee5a2-3c73-4aa6-a8f8-9c8ec01f608e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:56:04.197768 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1014/2030] 10.222.0.57 () {58 vars in 958 bytes} [Fri Sep 16 07:56:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 07:56:04.201688 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb17637-b91f-427f-bdbe-688b5f2b1b78 None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:56:04.202994 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-8fb17637-b91f-427f-bdbe-688b5f2b1b78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:56:04.251794 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:56:04.252094 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:56:04.255414 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86eee5a2-3c73-4aa6-a8f8-9c8ec01f608e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:56:04.257784 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86eee5a2-3c73-4aa6-a8f8-9c8ec01f608e service cinder] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:56:04.269093 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1017/2031] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Sep 16 07:56:04 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 07:56:04.270018 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86eee5a2-3c73-4aa6-a8f8-9c8ec01f608e service cinder] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:56:04.278193 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb17637-b91f-427f-bdbe-688b5f2b1b78 None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:56:04.280174 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86eee5a2-3c73-4aa6-a8f8-9c8ec01f608e service cinder] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:56:04.284918 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3df298-e585-4f36-801e-373c7d1404aa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1062e457207a41e4ba4f0a0c4bf36f1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4735f453c0c24cc4a1c14e9ac84a0b46', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:56:04.285521 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3df298-e585-4f36-801e-373c7d1404aa service neutron] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:04.286479 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3df298-e585-4f36-801e-373c7d1404aa service neutron] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:04.286479 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3df298-e585-4f36-801e-373c7d1404aa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:04.286946 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08192fe2-bba1-4c11-a5e9-def04fcda732 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1062e457207a41e4ba4f0a0c4bf36f1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4735f453c0c24cc4a1c14e9ac84a0b46', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:56:04.288213 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08192fe2-bba1-4c11-a5e9-def04fcda732 service neutron] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:04.288849 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08192fe2-bba1-4c11-a5e9-def04fcda732 service neutron] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:04.289333 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08192fe2-bba1-4c11-a5e9-def04fcda732 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:04.301357 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08192fe2-bba1-4c11-a5e9-def04fcda732 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:56:04.302086 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3df298-e585-4f36-801e-373c7d1404aa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:56:04.302760 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08192fe2-bba1-4c11-a5e9-def04fcda732 service neutron] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:56:04.304210 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3df298-e585-4f36-801e-373c7d1404aa service neutron] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:56:04.314900 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1015/2032] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Sep 16 07:56:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 07:56:04.315194 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1018/2033] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Sep 16 07:56:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 07:56:04.822309 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08192fe2-bba1-4c11-a5e9-def04fcda732 service neutron] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:56:04.825065 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-08192fe2-bba1-4c11-a5e9-def04fcda732 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:56:04.859372 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08192fe2-bba1-4c11-a5e9-def04fcda732 service neutron] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:56:04.869345 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e381399a-3b6d-41df-a5af-863ad5c0e942 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:56:04.870081 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e381399a-3b6d-41df-a5af-863ad5c0e942 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:04.870515 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e381399a-3b6d-41df-a5af-863ad5c0e942 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:04.870823 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e381399a-3b6d-41df-a5af-863ad5c0e942 admin admin] PATH_INFO: `/v3/projects/5748e774c76641c7beb85de268fba631` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:04.871999 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e381399a-3b6d-41df-a5af-863ad5c0e942 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5748e774c76641c7beb85de268fba631)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:56:04.874117 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e381399a-3b6d-41df-a5af-863ad5c0e942 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:56:04.890054 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3df298-e585-4f36-801e-373c7d1404aa service neutron] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:56:04.892300 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-af3df298-e585-4f36-801e-373c7d1404aa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:56:04.914767 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3df298-e585-4f36-801e-373c7d1404aa service neutron] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:56:04.924177 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403aa014-db47-4d62-a995-247b2a538582 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544bf6be4c24454a013ca110c43cef2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4735f453c0c24cc4a1c14e9ac84a0b46', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:56:04.925259 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403aa014-db47-4d62-a995-247b2a538582 service cinder] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:04.925672 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403aa014-db47-4d62-a995-247b2a538582 service cinder] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:04.926214 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403aa014-db47-4d62-a995-247b2a538582 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:04.930558 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-403aa014-db47-4d62-a995-247b2a538582 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:56:04.949198 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-e381399a-3b6d-41df-a5af-863ad5c0e942 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5748e774c76641c7beb85de268fba631', 'request_id': 'req-e381399a-3b6d-41df-a5af-863ad5c0e942'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:56:04.961698 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-e381399a-3b6d-41df-a5af-863ad5c0e942 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5748e774c76641c7beb85de268fba631', 'request_id': 'req-e381399a-3b6d-41df-a5af-863ad5c0e942'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:56:04.970126 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-e381399a-3b6d-41df-a5af-863ad5c0e942 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5748e774c76641c7beb85de268fba631', 'request_id': 'req-e381399a-3b6d-41df-a5af-863ad5c0e942'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:56:04.988263 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-e381399a-3b6d-41df-a5af-863ad5c0e942 admin admin] The token cache is being invalidate because project 5748e774c76641c7beb85de268fba631 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81430) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 07:56:04.988473 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-e381399a-3b6d-41df-a5af-863ad5c0e942 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:56:04.989631 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-e381399a-3b6d-41df-a5af-863ad5c0e942 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:56:04.993201 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1016/2034] 10.222.0.57 () {58 vars in 1233 bytes} [Fri Sep 16 07:56:04 2022] DELETE /identity/v3/projects/5748e774c76641c7beb85de268fba631 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 07:56:04.993201 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e381399a-3b6d-41df-a5af-863ad5c0e942 admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:56:04.996796 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-e381399a-3b6d-41df-a5af-863ad5c0e942 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:56:05.031488 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403aa014-db47-4d62-a995-247b2a538582 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:56:05.033861 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403aa014-db47-4d62-a995-247b2a538582 service cinder] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:56:05.045279 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1019/2035] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Sep 16 07:56:04 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 16 07:56:05.045959 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403aa014-db47-4d62-a995-247b2a538582 service cinder] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:56:05.057515 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403aa014-db47-4d62-a995-247b2a538582 service cinder] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:56:05.116148 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e381399a-3b6d-41df-a5af-863ad5c0e942 admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:56:05.128329 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f9770d-949a-4b8e-ae45-99ec3d7691f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:56:05.129019 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f9770d-949a-4b8e-ae45-99ec3d7691f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:05.129297 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f9770d-949a-4b8e-ae45-99ec3d7691f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:05.129570 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f9770d-949a-4b8e-ae45-99ec3d7691f7 admin admin] PATH_INFO: `/v3/users/65e9317aa7bd4a3481e24ac01df07e96` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:05.130787 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f9770d-949a-4b8e-ae45-99ec3d7691f7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=65e9317aa7bd4a3481e24ac01df07e96)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:56:05.133144 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f9770d-949a-4b8e-ae45-99ec3d7691f7 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:56:05.162229 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9cbb34-e6a8-494b-bb79-c50cdc4ea073 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:56:05.163100 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9cbb34-e6a8-494b-bb79-c50cdc4ea073 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:05.163328 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9cbb34-e6a8-494b-bb79-c50cdc4ea073 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:05.163673 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9cbb34-e6a8-494b-bb79-c50cdc4ea073 admin admin] PATH_INFO: `/v3/users/5d3ba6a628e444d8aa65f245c83dcf6a` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:05.164951 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9cbb34-e6a8-494b-bb79-c50cdc4ea073 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5d3ba6a628e444d8aa65f245c83dcf6a)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:56:05.167048 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9cbb34-e6a8-494b-bb79-c50cdc4ea073 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:56:05.197103 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-20f9770d-949a-4b8e-ae45-99ec3d7691f7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '65e9317aa7bd4a3481e24ac01df07e96'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:56:05.198033 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-20f9770d-949a-4b8e-ae45-99ec3d7691f7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '65e9317aa7bd4a3481e24ac01df07e96'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:56:05.207446 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-20f9770d-949a-4b8e-ae45-99ec3d7691f7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '65e9317aa7bd4a3481e24ac01df07e96'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:56:05.220860 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:56:05.222634 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-20f9770d-949a-4b8e-ae45-99ec3d7691f7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '65e9317aa7bd4a3481e24ac01df07e96'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:56:05.223151 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-ec9cbb34-e6a8-494b-bb79-c50cdc4ea073 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5d3ba6a628e444d8aa65f245c83dcf6a'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:56:05.236969 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-20f9770d-949a-4b8e-ae45-99ec3d7691f7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '65e9317aa7bd4a3481e24ac01df07e96'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:56:05.238388 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-ec9cbb34-e6a8-494b-bb79-c50cdc4ea073 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5d3ba6a628e444d8aa65f245c83dcf6a'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:56:05.239192 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-ec9cbb34-e6a8-494b-bb79-c50cdc4ea073 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5d3ba6a628e444d8aa65f245c83dcf6a'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:56:05.244372 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1017/2036] 10.222.0.57 () {58 vars in 1224 bytes} [Fri Sep 16 07:56:04 2022] DELETE /identity/v3/users/65e9317aa7bd4a3481e24ac01df07e96 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 07:56:05.245519 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f9770d-949a-4b8e-ae45-99ec3d7691f7 admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:56:05.248822 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-20f9770d-949a-4b8e-ae45-99ec3d7691f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:56:05.249192 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-ec9cbb34-e6a8-494b-bb79-c50cdc4ea073 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5d3ba6a628e444d8aa65f245c83dcf6a'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:56:05.256553 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:56:05.258947 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-ec9cbb34-e6a8-494b-bb79-c50cdc4ea073 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5d3ba6a628e444d8aa65f245c83dcf6a'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:56:05.272673 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1020/2037] 10.222.0.57 () {58 vars in 1224 bytes} [Fri Sep 16 07:56:05 2022] DELETE /identity/v3/users/5d3ba6a628e444d8aa65f245c83dcf6a => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 07:56:05.272673 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a66ba8-bac5-4244-aa63-722e596d94f9 None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:05.272673 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a66ba8-bac5-4244-aa63-722e596d94f9 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:05.272673 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a66ba8-bac5-4244-aa63-722e596d94f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:05.293707 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-30a66ba8-bac5-4244-aa63-722e596d94f9 None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:56:05.295111 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-30a66ba8-bac5-4244-aa63-722e596d94f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:56:05.335957 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f9770d-949a-4b8e-ae45-99ec3d7691f7 admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:56:05.376408 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1021/2038] 10.222.0.57 () {58 vars in 958 bytes} [Fri Sep 16 07:56:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 07:56:05.388451 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a66ba8-bac5-4244-aa63-722e596d94f9 None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:56:05.390316 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-30a66ba8-bac5-4244-aa63-722e596d94f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:56:05.409678 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2935055b-bd94-4366-8d47-6f8ce80f9c8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:56:05.410365 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2935055b-bd94-4366-8d47-6f8ce80f9c8a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:05.410652 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2935055b-bd94-4366-8d47-6f8ce80f9c8a admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:05.410930 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2935055b-bd94-4366-8d47-6f8ce80f9c8a admin admin] PATH_INFO: `/v3/projects/a39c9adc042642998251867dc7528fcd` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:05.412118 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2935055b-bd94-4366-8d47-6f8ce80f9c8a admin admin] RBAC: Authorizing `identity:delete_project(project_id=a39c9adc042642998251867dc7528fcd)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:56:05.414643 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2935055b-bd94-4366-8d47-6f8ce80f9c8a admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:56:05.464431 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a66ba8-bac5-4244-aa63-722e596d94f9 None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:56:05.475567 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-2935055b-bd94-4366-8d47-6f8ce80f9c8a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a39c9adc042642998251867dc7528fcd', 'request_id': 'req-2935055b-bd94-4366-8d47-6f8ce80f9c8a'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:56:05.485563 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-2935055b-bd94-4366-8d47-6f8ce80f9c8a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a39c9adc042642998251867dc7528fcd', 'request_id': 'req-2935055b-bd94-4366-8d47-6f8ce80f9c8a'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:56:05.493565 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-2935055b-bd94-4366-8d47-6f8ce80f9c8a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a39c9adc042642998251867dc7528fcd', 'request_id': 'req-2935055b-bd94-4366-8d47-6f8ce80f9c8a'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:56:05.507185 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-2935055b-bd94-4366-8d47-6f8ce80f9c8a admin admin] The token cache is being invalidate because project a39c9adc042642998251867dc7528fcd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81430) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 07:56:05.507484 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-2935055b-bd94-4366-8d47-6f8ce80f9c8a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:56:05.508175 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-2935055b-bd94-4366-8d47-6f8ce80f9c8a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:56:05.509756 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1018/2039] 10.222.0.57 () {58 vars in 1233 bytes} [Fri Sep 16 07:56:05 2022] DELETE /identity/v3/projects/a39c9adc042642998251867dc7528fcd => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 07:56:05.513599 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2935055b-bd94-4366-8d47-6f8ce80f9c8a admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:56:05.515013 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-2935055b-bd94-4366-8d47-6f8ce80f9c8a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:56:05.551012 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:56:05.561465 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b479b86c-55f5-4ecf-9db9-3d64053bf311 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1062e457207a41e4ba4f0a0c4bf36f1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4735f453c0c24cc4a1c14e9ac84a0b46', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:56:05.562361 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b479b86c-55f5-4ecf-9db9-3d64053bf311 service neutron] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:05.562646 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b479b86c-55f5-4ecf-9db9-3d64053bf311 service neutron] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:05.562919 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b479b86c-55f5-4ecf-9db9-3d64053bf311 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:05.566380 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-b479b86c-55f5-4ecf-9db9-3d64053bf311 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:56:05.614580 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2935055b-bd94-4366-8d47-6f8ce80f9c8a admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:56:05.625202 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005591fd-5683-4d1e-a926-52a633fa829c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:56:05.626053 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005591fd-5683-4d1e-a926-52a633fa829c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:05.626342 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005591fd-5683-4d1e-a926-52a633fa829c admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:05.626646 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005591fd-5683-4d1e-a926-52a633fa829c admin admin] PATH_INFO: `/v3/users/943ae22f63f345008f7d539cca064ee6` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:05.627809 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005591fd-5683-4d1e-a926-52a633fa829c admin admin] RBAC: Authorizing `identity:delete_user(user_id=943ae22f63f345008f7d539cca064ee6)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:56:05.634423 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005591fd-5683-4d1e-a926-52a633fa829c admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:56:05.653252 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b479b86c-55f5-4ecf-9db9-3d64053bf311 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:56:05.655357 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b479b86c-55f5-4ecf-9db9-3d64053bf311 service neutron] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:56:05.675824 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1022/2040] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Sep 16 07:56:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 07:56:05.676764 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b479b86c-55f5-4ecf-9db9-3d64053bf311 service neutron] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:56:05.678814 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-b479b86c-55f5-4ecf-9db9-3d64053bf311 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:56:05.686366 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:56:05.695298 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b479b86c-55f5-4ecf-9db9-3d64053bf311 service neutron] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:56:05.703395 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4621d8-0348-40be-bb89-6440aa2a7ffa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:56:05.704672 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4621d8-0348-40be-bb89-6440aa2a7ffa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:05.704947 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4621d8-0348-40be-bb89-6440aa2a7ffa admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:05.705218 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4621d8-0348-40be-bb89-6440aa2a7ffa admin admin] PATH_INFO: `/v3/projects/653ede4d0cad415eb0580937c32471ee` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:05.706513 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4621d8-0348-40be-bb89-6440aa2a7ffa admin admin] RBAC: Authorizing `identity:delete_project(project_id=653ede4d0cad415eb0580937c32471ee)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:56:05.710558 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4621d8-0348-40be-bb89-6440aa2a7ffa admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:56:05.720095 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-005591fd-5683-4d1e-a926-52a633fa829c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '943ae22f63f345008f7d539cca064ee6'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:56:05.721540 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-005591fd-5683-4d1e-a926-52a633fa829c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '943ae22f63f345008f7d539cca064ee6'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:56:05.737942 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-005591fd-5683-4d1e-a926-52a633fa829c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '943ae22f63f345008f7d539cca064ee6'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:56:05.784287 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-005591fd-5683-4d1e-a926-52a633fa829c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '943ae22f63f345008f7d539cca064ee6'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:56:05.818604 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-005591fd-5683-4d1e-a926-52a633fa829c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '943ae22f63f345008f7d539cca064ee6'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:56:05.821313 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-9a4621d8-0348-40be-bb89-6440aa2a7ffa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '653ede4d0cad415eb0580937c32471ee', 'request_id': 'req-9a4621d8-0348-40be-bb89-6440aa2a7ffa'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:56:05.831287 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-9a4621d8-0348-40be-bb89-6440aa2a7ffa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '653ede4d0cad415eb0580937c32471ee', 'request_id': 'req-9a4621d8-0348-40be-bb89-6440aa2a7ffa'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:56:05.831859 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1019/2041] 10.222.0.57 () {58 vars in 1224 bytes} [Fri Sep 16 07:56:05 2022] DELETE /identity/v3/users/943ae22f63f345008f7d539cca064ee6 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 07:56:05.848066 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-9a4621d8-0348-40be-bb89-6440aa2a7ffa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '653ede4d0cad415eb0580937c32471ee', 'request_id': 'req-9a4621d8-0348-40be-bb89-6440aa2a7ffa'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:56:05.870031 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-9a4621d8-0348-40be-bb89-6440aa2a7ffa admin admin] The token cache is being invalidate because project 653ede4d0cad415eb0580937c32471ee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81431) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 07:56:05.870031 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-9a4621d8-0348-40be-bb89-6440aa2a7ffa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:56:05.885340 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-9a4621d8-0348-40be-bb89-6440aa2a7ffa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:56:05.893357 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1023/2042] 10.222.0.57 () {58 vars in 1233 bytes} [Fri Sep 16 07:56:05 2022] DELETE /identity/v3/projects/653ede4d0cad415eb0580937c32471ee => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 07:56:05.893893 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005591fd-5683-4d1e-a926-52a633fa829c admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:56:05.893893 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-005591fd-5683-4d1e-a926-52a633fa829c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:56:06.038370 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005591fd-5683-4d1e-a926-52a633fa829c admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:56:06.044705 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74dca2b8-3267-4c6a-b1e6-c0a5f73a2dcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:56:06.045478 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dca2b8-3267-4c6a-b1e6-c0a5f73a2dcb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:06.045902 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dca2b8-3267-4c6a-b1e6-c0a5f73a2dcb admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:06.046343 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dca2b8-3267-4c6a-b1e6-c0a5f73a2dcb admin admin] PATH_INFO: `/v3/users/44f92456b8f84c60894c1d04aef834ee` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:06.047942 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74dca2b8-3267-4c6a-b1e6-c0a5f73a2dcb admin admin] RBAC: Authorizing `identity:delete_user(user_id=44f92456b8f84c60894c1d04aef834ee)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:56:06.050644 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74dca2b8-3267-4c6a-b1e6-c0a5f73a2dcb admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:56:06.116651 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4621d8-0348-40be-bb89-6440aa2a7ffa admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:56:06.120514 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-9a4621d8-0348-40be-bb89-6440aa2a7ffa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:56:06.159840 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:56:06.165659 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-74dca2b8-3267-4c6a-b1e6-c0a5f73a2dcb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '44f92456b8f84c60894c1d04aef834ee'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:56:06.167407 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-74dca2b8-3267-4c6a-b1e6-c0a5f73a2dcb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '44f92456b8f84c60894c1d04aef834ee'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:56:06.182813 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-74dca2b8-3267-4c6a-b1e6-c0a5f73a2dcb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '44f92456b8f84c60894c1d04aef834ee'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:56:06.198071 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-74dca2b8-3267-4c6a-b1e6-c0a5f73a2dcb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '44f92456b8f84c60894c1d04aef834ee'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:56:06.207558 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-74dca2b8-3267-4c6a-b1e6-c0a5f73a2dcb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '44f92456b8f84c60894c1d04aef834ee'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:56:06.214725 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1020/2043] 10.222.0.57 () {58 vars in 1224 bytes} [Fri Sep 16 07:56:05 2022] DELETE /identity/v3/users/44f92456b8f84c60894c1d04aef834ee => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 07:56:06.234264 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4621d8-0348-40be-bb89-6440aa2a7ffa admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:56:06.330170 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3f677b-2614-41d9-8c9f-85b89dc82fcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:56:06.330324 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3f677b-2614-41d9-8c9f-85b89dc82fcd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:06.331101 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3f677b-2614-41d9-8c9f-85b89dc82fcd admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:06.331567 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3f677b-2614-41d9-8c9f-85b89dc82fcd admin admin] PATH_INFO: `/v3/projects/1004a23df546471688a31c8a1f69089d` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:06.333290 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3f677b-2614-41d9-8c9f-85b89dc82fcd admin admin] RBAC: Authorizing `identity:delete_project(project_id=1004a23df546471688a31c8a1f69089d)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:56:06.335900 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3f677b-2614-41d9-8c9f-85b89dc82fcd admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:56:06.405496 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:56:06.421791 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-ae3f677b-2614-41d9-8c9f-85b89dc82fcd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1004a23df546471688a31c8a1f69089d', 'request_id': 'req-ae3f677b-2614-41d9-8c9f-85b89dc82fcd'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:56:06.430498 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-ae3f677b-2614-41d9-8c9f-85b89dc82fcd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1004a23df546471688a31c8a1f69089d', 'request_id': 'req-ae3f677b-2614-41d9-8c9f-85b89dc82fcd'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:56:06.441526 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-ae3f677b-2614-41d9-8c9f-85b89dc82fcd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1004a23df546471688a31c8a1f69089d', 'request_id': 'req-ae3f677b-2614-41d9-8c9f-85b89dc82fcd'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:56:06.454312 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-ae3f677b-2614-41d9-8c9f-85b89dc82fcd admin admin] The token cache is being invalidate because project 1004a23df546471688a31c8a1f69089d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81431) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 07:56:06.457262 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-ae3f677b-2614-41d9-8c9f-85b89dc82fcd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:56:06.458206 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-ae3f677b-2614-41d9-8c9f-85b89dc82fcd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:56:06.460553 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1024/2044] 10.222.0.57 () {58 vars in 1233 bytes} [Fri Sep 16 07:56:06 2022] DELETE /identity/v3/projects/1004a23df546471688a31c8a1f69089d => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 16 07:56:06.464415 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74dca2b8-3267-4c6a-b1e6-c0a5f73a2dcb admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:56:06.466033 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-74dca2b8-3267-4c6a-b1e6-c0a5f73a2dcb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:56:06.491210 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74dca2b8-3267-4c6a-b1e6-c0a5f73a2dcb admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:56:06.568602 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfcecc6-7980-4d3f-b1b6-88fc86498823 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:56:06.569410 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfcecc6-7980-4d3f-b1b6-88fc86498823 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:06.569859 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfcecc6-7980-4d3f-b1b6-88fc86498823 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:06.570160 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfcecc6-7980-4d3f-b1b6-88fc86498823 admin admin] PATH_INFO: `/v3/users/699d71968f0c462d9b49033d36cc642a` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:06.571666 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfcecc6-7980-4d3f-b1b6-88fc86498823 admin admin] RBAC: Authorizing `identity:delete_user(user_id=699d71968f0c462d9b49033d36cc642a)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:56:06.574270 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfcecc6-7980-4d3f-b1b6-88fc86498823 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:56:06.589749 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3f677b-2614-41d9-8c9f-85b89dc82fcd admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:56:06.591265 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-ae3f677b-2614-41d9-8c9f-85b89dc82fcd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:56:06.605360 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3f677b-2614-41d9-8c9f-85b89dc82fcd admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:56:06.614354 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7df1527-d43a-4899-ac7a-9c8955f26669 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:56:06.616902 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7df1527-d43a-4899-ac7a-9c8955f26669 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:06.617221 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7df1527-d43a-4899-ac7a-9c8955f26669 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:06.617507 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7df1527-d43a-4899-ac7a-9c8955f26669 admin admin] PATH_INFO: `/v3/projects/5318bccb8ffc476183c3a3e54443d878` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:06.619621 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7df1527-d43a-4899-ac7a-9c8955f26669 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5318bccb8ffc476183c3a3e54443d878)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:56:06.621262 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7df1527-d43a-4899-ac7a-9c8955f26669 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:56:06.646883 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-ecfcecc6-7980-4d3f-b1b6-88fc86498823 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '699d71968f0c462d9b49033d36cc642a'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:56:06.647380 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-ecfcecc6-7980-4d3f-b1b6-88fc86498823 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '699d71968f0c462d9b49033d36cc642a'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:56:06.659084 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-ecfcecc6-7980-4d3f-b1b6-88fc86498823 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '699d71968f0c462d9b49033d36cc642a'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:56:06.676979 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-ecfcecc6-7980-4d3f-b1b6-88fc86498823 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '699d71968f0c462d9b49033d36cc642a'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:56:06.679878 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-c7df1527-d43a-4899-ac7a-9c8955f26669 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5318bccb8ffc476183c3a3e54443d878', 'request_id': 'req-c7df1527-d43a-4899-ac7a-9c8955f26669'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:56:06.686440 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-ecfcecc6-7980-4d3f-b1b6-88fc86498823 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '699d71968f0c462d9b49033d36cc642a'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:56:06.689313 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-c7df1527-d43a-4899-ac7a-9c8955f26669 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5318bccb8ffc476183c3a3e54443d878', 'request_id': 'req-c7df1527-d43a-4899-ac7a-9c8955f26669'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:56:06.695162 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1021/2045] 10.222.0.57 () {58 vars in 1224 bytes} [Fri Sep 16 07:56:06 2022] DELETE /identity/v3/users/699d71968f0c462d9b49033d36cc642a => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 07:56:06.698547 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfcecc6-7980-4d3f-b1b6-88fc86498823 admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:56:06.700244 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-ecfcecc6-7980-4d3f-b1b6-88fc86498823 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:56:06.703016 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-c7df1527-d43a-4899-ac7a-9c8955f26669 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5318bccb8ffc476183c3a3e54443d878', 'request_id': 'req-c7df1527-d43a-4899-ac7a-9c8955f26669'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:56:06.717960 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-c7df1527-d43a-4899-ac7a-9c8955f26669 admin admin] The token cache is being invalidate because project 5318bccb8ffc476183c3a3e54443d878 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81431) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 07:56:06.718253 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-c7df1527-d43a-4899-ac7a-9c8955f26669 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:56:06.718940 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-c7df1527-d43a-4899-ac7a-9c8955f26669 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:56:06.721523 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1025/2046] 10.222.0.57 () {58 vars in 1233 bytes} [Fri Sep 16 07:56:06 2022] DELETE /identity/v3/projects/5318bccb8ffc476183c3a3e54443d878 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 16 07:56:06.726312 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d35a71-286b-46a5-b6e5-52ecbe3c320e None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:06.726590 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d35a71-286b-46a5-b6e5-52ecbe3c320e None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:06.727260 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d35a71-286b-46a5-b6e5-52ecbe3c320e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:06.750289 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-b8d35a71-286b-46a5-b6e5-52ecbe3c320e None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:56:06.751574 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-b8d35a71-286b-46a5-b6e5-52ecbe3c320e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:56:06.758798 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=85,keystone:INSERT=2,keystone:DELETE=13 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:56:06.788664 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfcecc6-7980-4d3f-b1b6-88fc86498823 admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:56:06.794652 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25326096-b804-4944-874e-9d610b0b2fad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:56:06.795298 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25326096-b804-4944-874e-9d610b0b2fad admin admin] REQUEST_METHOD: `DELETE` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:06.795578 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25326096-b804-4944-874e-9d610b0b2fad admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:06.795848 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25326096-b804-4944-874e-9d610b0b2fad admin admin] PATH_INFO: `/v3/projects/7fb2f27781e14cf59e44c070dcfec8ab` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:06.799177 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25326096-b804-4944-874e-9d610b0b2fad admin admin] RBAC: Authorizing `identity:delete_project(project_id=7fb2f27781e14cf59e44c070dcfec8ab)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:56:06.801778 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25326096-b804-4944-874e-9d610b0b2fad admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:56:06.829647 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1026/2047] 10.222.0.57 () {58 vars in 958 bytes} [Fri Sep 16 07:56:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 07:56:06.831768 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633c9434-7859-402c-a770-e5bfdf9bb52d None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:06.832185 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633c9434-7859-402c-a770-e5bfdf9bb52d None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:06.832531 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633c9434-7859-402c-a770-e5bfdf9bb52d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:06.854541 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-633c9434-7859-402c-a770-e5bfdf9bb52d None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:56:06.855799 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-633c9434-7859-402c-a770-e5bfdf9bb52d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:56:06.862520 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-25326096-b804-4944-874e-9d610b0b2fad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7fb2f27781e14cf59e44c070dcfec8ab', 'request_id': 'req-25326096-b804-4944-874e-9d610b0b2fad'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:56:06.872557 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-25326096-b804-4944-874e-9d610b0b2fad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7fb2f27781e14cf59e44c070dcfec8ab', 'request_id': 'req-25326096-b804-4944-874e-9d610b0b2fad'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:56:06.882621 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-25326096-b804-4944-874e-9d610b0b2fad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7fb2f27781e14cf59e44c070dcfec8ab', 'request_id': 'req-25326096-b804-4944-874e-9d610b0b2fad'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:56:06.899749 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-25326096-b804-4944-874e-9d610b0b2fad admin admin] The token cache is being invalidate because project 7fb2f27781e14cf59e44c070dcfec8ab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81430) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 07:56:06.900062 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-25326096-b804-4944-874e-9d610b0b2fad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:56:06.900780 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-25326096-b804-4944-874e-9d610b0b2fad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:56:06.902573 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1022/2048] 10.222.0.57 () {58 vars in 1233 bytes} [Fri Sep 16 07:56:06 2022] DELETE /identity/v3/projects/7fb2f27781e14cf59e44c070dcfec8ab => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 07:56:06.910445 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4b5ca0-09ef-4f45-a176-5c9973fa51e3 None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:06.910726 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4b5ca0-09ef-4f45-a176-5c9973fa51e3 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:06.911048 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4b5ca0-09ef-4f45-a176-5c9973fa51e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:06.914335 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:56:06.934722 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-ea4b5ca0-09ef-4f45-a176-5c9973fa51e3 None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:56:06.936196 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-ea4b5ca0-09ef-4f45-a176-5c9973fa51e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:56:06.936841 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1027/2049] 10.222.0.57 () {58 vars in 958 bytes} [Fri Sep 16 07:56:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 16 07:56:06.941916 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633c9434-7859-402c-a770-e5bfdf9bb52d None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:56:06.945983 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1023/2050] 10.222.0.57 () {58 vars in 958 bytes} [Fri Sep 16 07:56:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 07:56:06.955503 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0146ee06-261d-4a4f-8ed4-596edd5bf8a1 None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:06.955791 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0146ee06-261d-4a4f-8ed4-596edd5bf8a1 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:06.956069 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0146ee06-261d-4a4f-8ed4-596edd5bf8a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:06.956675 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633c9434-7859-402c-a770-e5bfdf9bb52d None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:56:06.962322 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135e1b68-acba-4356-a5ad-bf1b40a0ab2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:56:06.963137 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135e1b68-acba-4356-a5ad-bf1b40a0ab2d admin admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:06.963624 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135e1b68-acba-4356-a5ad-bf1b40a0ab2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:06.963934 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135e1b68-acba-4356-a5ad-bf1b40a0ab2d admin admin] PATH_INFO: `/v3/domains` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:06.964993 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135e1b68-acba-4356-a5ad-bf1b40a0ab2d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:56:06.965326 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135e1b68-acba-4356-a5ad-bf1b40a0ab2d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:56:06.967961 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135e1b68-acba-4356-a5ad-bf1b40a0ab2d admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:56:06.976487 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-0146ee06-261d-4a4f-8ed4-596edd5bf8a1 None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:56:06.977687 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-0146ee06-261d-4a4f-8ed4-596edd5bf8a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:56:06.983079 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1028/2051] 10.222.0.57 () {58 vars in 1153 bytes} [Fri Sep 16 07:56:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 07:56:06.988113 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135e1b68-acba-4356-a5ad-bf1b40a0ab2d admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:56:06.989769 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1024/2052] 10.222.0.57 () {58 vars in 958 bytes} [Fri Sep 16 07:56:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 07:56:06.995965 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0146ee06-261d-4a4f-8ed4-596edd5bf8a1 None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:56:06.998553 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135e1b68-acba-4356-a5ad-bf1b40a0ab2d admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:56:07.004175 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cae27be-8c74-43f5-934c-95dbca776be0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:56:07.004993 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cae27be-8c74-43f5-934c-95dbca776be0 admin admin] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:07.005323 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cae27be-8c74-43f5-934c-95dbca776be0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:07.005650 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cae27be-8c74-43f5-934c-95dbca776be0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:07.006338 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cae27be-8c74-43f5-934c-95dbca776be0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:56:07.008238 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0146ee06-261d-4a4f-8ed4-596edd5bf8a1 None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:56:07.008405 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cae27be-8c74-43f5-934c-95dbca776be0 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:56:07.014278 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe4fa77-f813-4250-8d81-fe4d6116ee78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:56:07.015214 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe4fa77-f813-4250-8d81-fe4d6116ee78 admin admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:07.015627 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe4fa77-f813-4250-8d81-fe4d6116ee78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:07.015904 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe4fa77-f813-4250-8d81-fe4d6116ee78 admin admin] PATH_INFO: `/v3/domains` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:07.016755 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe4fa77-f813-4250-8d81-fe4d6116ee78 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:56:07.016921 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe4fa77-f813-4250-8d81-fe4d6116ee78 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:56:07.018615 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe4fa77-f813-4250-8d81-fe4d6116ee78 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:56:07.038764 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1025/2053] 10.222.0.57 () {58 vars in 1153 bytes} [Fri Sep 16 07:56:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 07:56:07.038764 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe4fa77-f813-4250-8d81-fe4d6116ee78 admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:56:07.040717 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-fbe4fa77-f813-4250-8d81-fe4d6116ee78 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:56:07.044821 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1029/2054] 10.222.0.57 () {60 vars in 1153 bytes} [Fri Sep 16 07:56:06 2022] POST /identity/v3/projects => generated 383 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 16 07:56:07.045757 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cae27be-8c74-43f5-934c-95dbca776be0 admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:56:07.058044 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe4fa77-f813-4250-8d81-fe4d6116ee78 admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:56:07.114105 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cae27be-8c74-43f5-934c-95dbca776be0 admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:56:07.119192 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7865d6-772d-4d91-b318-0dec5548e725 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:56:07.119838 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7865d6-772d-4d91-b318-0dec5548e725 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:07.120118 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7865d6-772d-4d91-b318-0dec5548e725 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:07.120427 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7865d6-772d-4d91-b318-0dec5548e725 admin admin] PATH_INFO: `/v3/projects/884ee5bee6b3440ab3e54b84f1cb50a6` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:07.121550 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7865d6-772d-4d91-b318-0dec5548e725 admin admin] RBAC: Authorizing `identity:delete_project(project_id=884ee5bee6b3440ab3e54b84f1cb50a6)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:56:07.121797 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d47cc79-8c0c-4aaf-b0fa-55be41d7909b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:56:07.122760 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d47cc79-8c0c-4aaf-b0fa-55be41d7909b admin admin] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:07.123230 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d47cc79-8c0c-4aaf-b0fa-55be41d7909b admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:07.123573 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7865d6-772d-4d91-b318-0dec5548e725 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:56:07.123694 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d47cc79-8c0c-4aaf-b0fa-55be41d7909b admin admin] PATH_INFO: `/v3/projects` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:07.124750 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d47cc79-8c0c-4aaf-b0fa-55be41d7909b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:56:07.128008 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d47cc79-8c0c-4aaf-b0fa-55be41d7909b admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:56:07.154922 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1030/2055] 10.222.0.57 () {60 vars in 1153 bytes} [Fri Sep 16 07:56:07 2022] POST /identity/v3/projects => generated 383 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 07:56:07.159141 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d47cc79-8c0c-4aaf-b0fa-55be41d7909b admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:56:07.177132 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:56:07.178674 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-8c7865d6-772d-4d91-b318-0dec5548e725 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '884ee5bee6b3440ab3e54b84f1cb50a6', 'request_id': 'req-8c7865d6-772d-4d91-b318-0dec5548e725'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:56:07.187088 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-8c7865d6-772d-4d91-b318-0dec5548e725 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '884ee5bee6b3440ab3e54b84f1cb50a6', 'request_id': 'req-8c7865d6-772d-4d91-b318-0dec5548e725'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:56:07.194090 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-8c7865d6-772d-4d91-b318-0dec5548e725 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '884ee5bee6b3440ab3e54b84f1cb50a6', 'request_id': 'req-8c7865d6-772d-4d91-b318-0dec5548e725'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:56:07.206380 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-8c7865d6-772d-4d91-b318-0dec5548e725 admin admin] The token cache is being invalidate because project 884ee5bee6b3440ab3e54b84f1cb50a6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81430) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 07:56:07.206683 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-8c7865d6-772d-4d91-b318-0dec5548e725 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:56:07.207357 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-8c7865d6-772d-4d91-b318-0dec5548e725 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:56:07.209391 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1026/2056] 10.222.0.57 () {58 vars in 1233 bytes} [Fri Sep 16 07:56:07 2022] DELETE /identity/v3/projects/884ee5bee6b3440ab3e54b84f1cb50a6 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 07:56:07.210175 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7865d6-772d-4d91-b318-0dec5548e725 admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:56:07.211521 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-8c7865d6-772d-4d91-b318-0dec5548e725 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:56:07.228385 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d47cc79-8c0c-4aaf-b0fa-55be41d7909b admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:56:07.269464 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:56:07.275733 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7865d6-772d-4d91-b318-0dec5548e725 admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:56:07.280414 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d4cdcf-fcc8-4309-813c-7cc8ebdbf984 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:56:07.281012 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d4cdcf-fcc8-4309-813c-7cc8ebdbf984 admin admin] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:07.281289 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d4cdcf-fcc8-4309-813c-7cc8ebdbf984 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:07.281557 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d4cdcf-fcc8-4309-813c-7cc8ebdbf984 admin admin] PATH_INFO: `/v3/users` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:07.282825 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d4cdcf-fcc8-4309-813c-7cc8ebdbf984 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:56:07.284688 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d4cdcf-fcc8-4309-813c-7cc8ebdbf984 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:56:07.287220 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48f6d12-e050-46be-81d4-5da2484ab28a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:56:07.287830 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48f6d12-e050-46be-81d4-5da2484ab28a admin admin] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:07.288110 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48f6d12-e050-46be-81d4-5da2484ab28a admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:07.288379 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48f6d12-e050-46be-81d4-5da2484ab28a admin admin] PATH_INFO: `/v3/users` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:07.289004 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48f6d12-e050-46be-81d4-5da2484ab28a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:56:07.290943 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48f6d12-e050-46be-81d4-5da2484ab28a admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:56:07.306879 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1027/2057] 10.222.0.57 () {60 vars in 1144 bytes} [Fri Sep 16 07:56:07 2022] POST /identity/v3/users => generated 292 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 07:56:07.307931 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d4cdcf-fcc8-4309-813c-7cc8ebdbf984 admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:56:07.309921 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-a3d4cdcf-fcc8-4309-813c-7cc8ebdbf984 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:56:07.316385 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1031/2058] 10.222.0.57 () {60 vars in 1144 bytes} [Fri Sep 16 07:56:07 2022] POST /identity/v3/users => generated 292 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 07:56:07.317543 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5141d7c-97da-402d-9afe-86219a2f7db7 None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:07.317868 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5141d7c-97da-402d-9afe-86219a2f7db7 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:07.318148 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5141d7c-97da-402d-9afe-86219a2f7db7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:07.322867 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d4cdcf-fcc8-4309-813c-7cc8ebdbf984 admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:56:07.327509 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85ad0f3-5f62-479c-b9e9-34d557408eab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:56:07.328237 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85ad0f3-5f62-479c-b9e9-34d557408eab admin admin] REQUEST_METHOD: `DELETE` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:07.328526 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85ad0f3-5f62-479c-b9e9-34d557408eab admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:07.328841 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85ad0f3-5f62-479c-b9e9-34d557408eab admin admin] PATH_INFO: `/v3/users/af6ec817b2084fe3b0bc5aca3a40b2db` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:07.330135 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85ad0f3-5f62-479c-b9e9-34d557408eab admin admin] RBAC: Authorizing `identity:delete_user(user_id=af6ec817b2084fe3b0bc5aca3a40b2db)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:56:07.332020 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85ad0f3-5f62-479c-b9e9-34d557408eab admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:56:07.337817 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-e5141d7c-97da-402d-9afe-86219a2f7db7 None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:56:07.339021 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-e5141d7c-97da-402d-9afe-86219a2f7db7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:56:07.347786 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1032/2059] 10.222.0.57 () {58 vars in 958 bytes} [Fri Sep 16 07:56:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 07:56:07.348567 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5141d7c-97da-402d-9afe-86219a2f7db7 None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:56:07.359176 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5141d7c-97da-402d-9afe-86219a2f7db7 None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:56:07.365191 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5955e1-b37f-4661-8f3c-686e4cac7788 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:56:07.365874 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5955e1-b37f-4661-8f3c-686e4cac7788 admin admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:07.366194 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5955e1-b37f-4661-8f3c-686e4cac7788 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:07.366492 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5955e1-b37f-4661-8f3c-686e4cac7788 admin admin] PATH_INFO: `/v3/roles` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:07.367221 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5955e1-b37f-4661-8f3c-686e4cac7788 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:56:07.369114 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5955e1-b37f-4661-8f3c-686e4cac7788 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:56:07.382442 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1033/2060] 10.222.0.57 () {58 vars in 1122 bytes} [Fri Sep 16 07:56:07 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 07:56:07.382442 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5955e1-b37f-4661-8f3c-686e4cac7788 admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:56:07.382715 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-d85ad0f3-5f62-479c-b9e9-34d557408eab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'af6ec817b2084fe3b0bc5aca3a40b2db'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:56:07.383255 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-d85ad0f3-5f62-479c-b9e9-34d557408eab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'af6ec817b2084fe3b0bc5aca3a40b2db'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:56:07.384321 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-da5955e1-b37f-4661-8f3c-686e4cac7788 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:56:07.391854 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-d85ad0f3-5f62-479c-b9e9-34d557408eab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'af6ec817b2084fe3b0bc5aca3a40b2db'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:56:07.397420 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5955e1-b37f-4661-8f3c-686e4cac7788 admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:56:07.403552 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da3c32c-d953-4b36-9de1-29056de8b13f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:56:07.403552 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da3c32c-d953-4b36-9de1-29056de8b13f admin admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:07.403552 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da3c32c-d953-4b36-9de1-29056de8b13f admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:07.403552 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da3c32c-d953-4b36-9de1-29056de8b13f admin admin] PATH_INFO: `/v3/roles` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:07.403975 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da3c32c-d953-4b36-9de1-29056de8b13f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:56:07.405524 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da3c32c-d953-4b36-9de1-29056de8b13f admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:56:07.407815 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-d85ad0f3-5f62-479c-b9e9-34d557408eab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'af6ec817b2084fe3b0bc5aca3a40b2db'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:56:07.417344 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-d85ad0f3-5f62-479c-b9e9-34d557408eab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'af6ec817b2084fe3b0bc5aca3a40b2db'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:56:07.420864 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1034/2061] 10.222.0.57 () {58 vars in 1122 bytes} [Fri Sep 16 07:56:07 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 07:56:07.422150 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6d993f-95f8-41f0-8269-4c793adb8759 None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:07.423078 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6d993f-95f8-41f0-8269-4c793adb8759 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:07.423322 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6d993f-95f8-41f0-8269-4c793adb8759 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:07.430464 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1028/2062] 10.222.0.57 () {58 vars in 1224 bytes} [Fri Sep 16 07:56:07 2022] DELETE /identity/v3/users/af6ec817b2084fe3b0bc5aca3a40b2db => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 07:56:07.430464 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85ad0f3-5f62-479c-b9e9-34d557408eab admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:56:07.430464 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-d85ad0f3-5f62-479c-b9e9-34d557408eab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:56:07.444871 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-8e6d993f-95f8-41f0-8269-4c793adb8759 None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:56:07.446286 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-8e6d993f-95f8-41f0-8269-4c793adb8759 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:56:07.484426 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=82,keystone:INSERT=5,keystone:DELETE=13 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:56:07.512198 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85ad0f3-5f62-479c-b9e9-34d557408eab admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:56:07.521137 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d20f941-3444-4644-9b77-2ed7ad15fd0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:56:07.521807 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d20f941-3444-4644-9b77-2ed7ad15fd0a admin admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:07.522106 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d20f941-3444-4644-9b77-2ed7ad15fd0a admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:07.522371 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d20f941-3444-4644-9b77-2ed7ad15fd0a admin admin] PATH_INFO: `/v3/roles` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:07.523024 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d20f941-3444-4644-9b77-2ed7ad15fd0a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:56:07.524802 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d20f941-3444-4644-9b77-2ed7ad15fd0a admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:56:07.526306 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1035/2063] 10.222.0.57 () {58 vars in 958 bytes} [Fri Sep 16 07:56:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 07:56:07.526891 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6d993f-95f8-41f0-8269-4c793adb8759 None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:56:07.537474 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6d993f-95f8-41f0-8269-4c793adb8759 None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:56:07.542226 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6835e38-6169-4009-9eae-863adc863a24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:56:07.542985 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6835e38-6169-4009-9eae-863adc863a24 admin admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:07.543265 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6835e38-6169-4009-9eae-863adc863a24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:07.543546 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6835e38-6169-4009-9eae-863adc863a24 admin admin] PATH_INFO: `/v3/roles` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:07.544277 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1029/2064] 10.222.0.57 () {58 vars in 1122 bytes} [Fri Sep 16 07:56:07 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 07:56:07.544775 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6835e38-6169-4009-9eae-863adc863a24 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:56:07.545661 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fa00bd-bb8a-4797-9606-4f2a7a40b47f None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:07.545991 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fa00bd-bb8a-4797-9606-4f2a7a40b47f None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:07.546270 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fa00bd-bb8a-4797-9606-4f2a7a40b47f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:07.546436 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6835e38-6169-4009-9eae-863adc863a24 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:56:07.558857 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1036/2065] 10.222.0.57 () {58 vars in 1122 bytes} [Fri Sep 16 07:56:07 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 07:56:07.559428 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6835e38-6169-4009-9eae-863adc863a24 admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:56:07.570162 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6835e38-6169-4009-9eae-863adc863a24 admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:56:07.572152 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-78fa00bd-bb8a-4797-9606-4f2a7a40b47f None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:56:07.573822 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-78fa00bd-bb8a-4797-9606-4f2a7a40b47f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:56:07.575351 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83ba4b6-82fe-49aa-a070-9f1eaccaf22b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:56:07.575955 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83ba4b6-82fe-49aa-a070-9f1eaccaf22b admin admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:07.576234 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83ba4b6-82fe-49aa-a070-9f1eaccaf22b admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:07.576507 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83ba4b6-82fe-49aa-a070-9f1eaccaf22b admin admin] PATH_INFO: `/v3/domains` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:07.577155 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83ba4b6-82fe-49aa-a070-9f1eaccaf22b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:56:07.577458 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83ba4b6-82fe-49aa-a070-9f1eaccaf22b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:56:07.580165 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83ba4b6-82fe-49aa-a070-9f1eaccaf22b admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:56:07.584944 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1030/2066] 10.222.0.57 () {58 vars in 958 bytes} [Fri Sep 16 07:56:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 07:56:07.589495 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fa00bd-bb8a-4797-9606-4f2a7a40b47f None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:56:07.596146 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1037/2067] 10.222.0.57 () {58 vars in 1153 bytes} [Fri Sep 16 07:56:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:56:07.597219 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83ba4b6-82fe-49aa-a070-9f1eaccaf22b admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:56:07.600824 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fa00bd-bb8a-4797-9606-4f2a7a40b47f None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:56:07.606021 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134a9468-21a4-46a8-b97a-1d119fbd6fc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:56:07.606713 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134a9468-21a4-46a8-b97a-1d119fbd6fc0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:07.606999 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134a9468-21a4-46a8-b97a-1d119fbd6fc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:07.607276 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134a9468-21a4-46a8-b97a-1d119fbd6fc0 admin admin] PATH_INFO: `/v3/projects/3af4f638c15c4382b114ba9f759178f5/users/a056a6f148fd4443ad3831073183b228/roles/4818d38cf2564825b312e66c9eb24762` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:07.611251 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83ba4b6-82fe-49aa-a070-9f1eaccaf22b admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:56:07.615583 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad45083-66b4-43d9-b7b1-0d004e1878b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:56:07.616237 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad45083-66b4-43d9-b7b1-0d004e1878b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:07.616514 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad45083-66b4-43d9-b7b1-0d004e1878b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:07.616782 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad45083-66b4-43d9-b7b1-0d004e1878b8 admin admin] PATH_INFO: `/v3/projects/5e32d637ffd945e1895ae2b72e6e7612/users/31a668b9445f42ba89880644e2d1b36b/roles/4818d38cf2564825b312e66c9eb24762` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:07.623844 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134a9468-21a4-46a8-b97a-1d119fbd6fc0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3af4f638c15c4382b114ba9f759178f5, user_id=a056a6f148fd4443ad3831073183b228, role_id=4818d38cf2564825b312e66c9eb24762)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:56:07.627386 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134a9468-21a4-46a8-b97a-1d119fbd6fc0 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:56:07.633062 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad45083-66b4-43d9-b7b1-0d004e1878b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e32d637ffd945e1895ae2b72e6e7612, user_id=31a668b9445f42ba89880644e2d1b36b, role_id=4818d38cf2564825b312e66c9eb24762)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:56:07.636279 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad45083-66b4-43d9-b7b1-0d004e1878b8 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:56:07.643091 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1031/2068] 10.222.0.57 () {60 vars in 1483 bytes} [Fri Sep 16 07:56:07 2022] PUT /identity/v3/projects/3af4f638c15c4382b114ba9f759178f5/users/a056a6f148fd4443ad3831073183b228/roles/4818d38cf2564825b312e66c9eb24762 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 07:56:07.644052 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134a9468-21a4-46a8-b97a-1d119fbd6fc0 admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:56:07.661188 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1038/2069] 10.222.0.57 () {60 vars in 1483 bytes} [Fri Sep 16 07:56:07 2022] PUT /identity/v3/projects/5e32d637ffd945e1895ae2b72e6e7612/users/31a668b9445f42ba89880644e2d1b36b/roles/4818d38cf2564825b312e66c9eb24762 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 07:56:07.669676 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad45083-66b4-43d9-b7b1-0d004e1878b8 admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:56:07.675380 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-8ad45083-66b4-43d9-b7b1-0d004e1878b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:56:07.761267 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad45083-66b4-43d9-b7b1-0d004e1878b8 admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:56:07.763239 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134a9468-21a4-46a8-b97a-1d119fbd6fc0 admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:56:07.767726 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c349d5fd-6fed-4105-9e82-f5d7c48e65d8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1062e457207a41e4ba4f0a0c4bf36f1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4735f453c0c24cc4a1c14e9ac84a0b46', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:56:07.768655 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c349d5fd-6fed-4105-9e82-f5d7c48e65d8 service neutron] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:07.770043 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c349d5fd-6fed-4105-9e82-f5d7c48e65d8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:07.770319 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c349d5fd-6fed-4105-9e82-f5d7c48e65d8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:07.785070 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:56:07.867928 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59eea187-f059-4ca2-9867-3df456e9bcf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:56:07.867928 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59eea187-f059-4ca2-9867-3df456e9bcf2 admin admin] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:07.867928 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59eea187-f059-4ca2-9867-3df456e9bcf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:07.867928 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59eea187-f059-4ca2-9867-3df456e9bcf2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:07.868469 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59eea187-f059-4ca2-9867-3df456e9bcf2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:56:07.868469 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59eea187-f059-4ca2-9867-3df456e9bcf2 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:56:07.868607 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c349d5fd-6fed-4105-9e82-f5d7c48e65d8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:56:07.871759 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c349d5fd-6fed-4105-9e82-f5d7c48e65d8 service neutron] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:56:07.882051 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1039/2070] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Sep 16 07:56:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 07:56:07.883543 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038cbd9d-b933-4072-ba26-6dec1ff282af None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:07.883953 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038cbd9d-b933-4072-ba26-6dec1ff282af None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:07.884238 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038cbd9d-b933-4072-ba26-6dec1ff282af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:07.901353 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1032/2071] 10.222.0.57 () {60 vars in 1153 bytes} [Fri Sep 16 07:56:07 2022] POST /identity/v3/projects => generated 387 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 07:56:07.901353 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ced5c0-5103-4b88-a4f8-773c153640b6 None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:07.901353 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ced5c0-5103-4b88-a4f8-773c153640b6 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:07.901353 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ced5c0-5103-4b88-a4f8-773c153640b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:07.921075 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-038cbd9d-b933-4072-ba26-6dec1ff282af None None] MFA Rules not processed for user `a056a6f148fd4443ad3831073183b228`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:56:07.922328 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-038cbd9d-b933-4072-ba26-6dec1ff282af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:56:07.928980 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-18ced5c0-5103-4b88-a4f8-773c153640b6 None None] MFA Rules not processed for user `31a668b9445f42ba89880644e2d1b36b`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:56:07.930201 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-18ced5c0-5103-4b88-a4f8-773c153640b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:56:07.956805 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:56:08.001603 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1040/2072] 10.222.0.57 () {58 vars in 958 bytes} [Fri Sep 16 07:56:07 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 07:56:08.002895 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038cbd9d-b933-4072-ba26-6dec1ff282af None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:56:08.020820 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1033/2073] 10.222.0.57 () {58 vars in 958 bytes} [Fri Sep 16 07:56:07 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 07:56:08.020820 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ced5c0-5103-4b88-a4f8-773c153640b6 None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:56:08.020820 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-18ced5c0-5103-4b88-a4f8-773c153640b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:56:08.080053 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038cbd9d-b933-4072-ba26-6dec1ff282af None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:56:08.091190 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5e88bd-e1ca-471b-ac06-7bfda86f3cbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:56:08.092376 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ced5c0-5103-4b88-a4f8-773c153640b6 None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:56:08.093232 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5e88bd-e1ca-471b-ac06-7bfda86f3cbc admin admin] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:08.093578 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5e88bd-e1ca-471b-ac06-7bfda86f3cbc admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:08.094833 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5e88bd-e1ca-471b-ac06-7bfda86f3cbc admin admin] PATH_INFO: `/v3/users` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:08.095145 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5e88bd-e1ca-471b-ac06-7bfda86f3cbc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:56:08.097536 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5e88bd-e1ca-471b-ac06-7bfda86f3cbc admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:56:08.097757 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d195e1-04f8-4517-98e3-ebcb99634171 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544bf6be4c24454a013ca110c43cef2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4735f453c0c24cc4a1c14e9ac84a0b46', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:56:08.098536 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d195e1-04f8-4517-98e3-ebcb99634171 service cinder] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:08.098967 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d195e1-04f8-4517-98e3-ebcb99634171 service cinder] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:08.099357 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d195e1-04f8-4517-98e3-ebcb99634171 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:08.116882 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d195e1-04f8-4517-98e3-ebcb99634171 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:56:08.119039 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d195e1-04f8-4517-98e3-ebcb99634171 service cinder] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:56:08.126472 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1041/2074] 10.222.0.57 () {60 vars in 1144 bytes} [Fri Sep 16 07:56:08 2022] POST /identity/v3/users => generated 294 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 07:56:08.130204 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1034/2075] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Sep 16 07:56:08 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 07:56:08.130357 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5e88bd-e1ca-471b-ac06-7bfda86f3cbc admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:56:08.131181 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d195e1-04f8-4517-98e3-ebcb99634171 service cinder] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:56:08.143547 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5e88bd-e1ca-471b-ac06-7bfda86f3cbc admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:56:08.148686 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9fcfa8-5355-44bc-a09d-0a7958646b3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:56:08.149503 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9fcfa8-5355-44bc-a09d-0a7958646b3f admin admin] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:08.150090 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9fcfa8-5355-44bc-a09d-0a7958646b3f admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:08.150460 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9fcfa8-5355-44bc-a09d-0a7958646b3f admin admin] PATH_INFO: `/v3/projects` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:08.151190 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9fcfa8-5355-44bc-a09d-0a7958646b3f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:56:08.153421 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9fcfa8-5355-44bc-a09d-0a7958646b3f admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:56:08.154677 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d195e1-04f8-4517-98e3-ebcb99634171 service cinder] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:56:08.161253 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0663424a-bd2a-4180-85da-9a46e62a1c8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:56:08.161982 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0663424a-bd2a-4180-85da-9a46e62a1c8a admin admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:08.162327 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0663424a-bd2a-4180-85da-9a46e62a1c8a admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:08.162812 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0663424a-bd2a-4180-85da-9a46e62a1c8a admin admin] PATH_INFO: `/v3/roles` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:08.163574 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0663424a-bd2a-4180-85da-9a46e62a1c8a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:56:08.165743 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0663424a-bd2a-4180-85da-9a46e62a1c8a admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:56:08.186560 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1035/2076] 10.222.0.57 () {58 vars in 1122 bytes} [Fri Sep 16 07:56:08 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 07:56:08.189486 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0663424a-bd2a-4180-85da-9a46e62a1c8a admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:56:08.198963 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1042/2077] 10.222.0.57 () {60 vars in 1153 bytes} [Fri Sep 16 07:56:08 2022] POST /identity/v3/projects => generated 383 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 07:56:08.200167 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9fcfa8-5355-44bc-a09d-0a7958646b3f admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:56:08.200476 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0663424a-bd2a-4180-85da-9a46e62a1c8a admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:56:08.209968 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:56:08.290390 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3bec06-559f-4e98-ade7-345ea4fcf597 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:56:08.290992 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9fcfa8-5355-44bc-a09d-0a7958646b3f admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:56:08.291417 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3bec06-559f-4e98-ade7-345ea4fcf597 admin admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:08.291816 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3bec06-559f-4e98-ade7-345ea4fcf597 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:08.292157 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3bec06-559f-4e98-ade7-345ea4fcf597 admin admin] PATH_INFO: `/v3/roles` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:08.292992 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3bec06-559f-4e98-ade7-345ea4fcf597 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:56:08.297997 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d825b04e-8178-4ec4-a738-d360da081400 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:56:08.298677 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3bec06-559f-4e98-ade7-345ea4fcf597 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:56:08.299598 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d825b04e-8178-4ec4-a738-d360da081400 admin admin] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:08.300024 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d825b04e-8178-4ec4-a738-d360da081400 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:08.300993 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d825b04e-8178-4ec4-a738-d360da081400 admin admin] PATH_INFO: `/v3/users` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:08.302287 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d825b04e-8178-4ec4-a738-d360da081400 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:56:08.304516 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d825b04e-8178-4ec4-a738-d360da081400 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:56:08.315132 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1036/2078] 10.222.0.57 () {58 vars in 1122 bytes} [Fri Sep 16 07:56:08 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 16 07:56:08.316438 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3bec06-559f-4e98-ade7-345ea4fcf597 admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:56:08.334766 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3bec06-559f-4e98-ade7-345ea4fcf597 admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:56:08.338796 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1043/2079] 10.222.0.57 () {60 vars in 1144 bytes} [Fri Sep 16 07:56:08 2022] POST /identity/v3/users => generated 298 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 07:56:08.340302 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d825b04e-8178-4ec4-a738-d360da081400 admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:56:08.344065 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485f1221-d62c-456e-87de-f7c3fbba8023 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:56:08.345310 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485f1221-d62c-456e-87de-f7c3fbba8023 admin admin] REQUEST_METHOD: `PUT` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:08.347030 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485f1221-d62c-456e-87de-f7c3fbba8023 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:08.347146 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485f1221-d62c-456e-87de-f7c3fbba8023 admin admin] PATH_INFO: `/v3/projects/a9a069943712467dae194254d5b4e0d4/users/a435023773144dd4afb368f4fac28bf7/roles/4818d38cf2564825b312e66c9eb24762` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:08.351527 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d825b04e-8178-4ec4-a738-d360da081400 admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:56:08.357624 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a743b92-68d4-4199-befc-7cae147fdf36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:56:08.358268 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a743b92-68d4-4199-befc-7cae147fdf36 admin admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:08.358580 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a743b92-68d4-4199-befc-7cae147fdf36 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:08.358817 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a743b92-68d4-4199-befc-7cae147fdf36 admin admin] PATH_INFO: `/v3/roles` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:08.359462 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a743b92-68d4-4199-befc-7cae147fdf36 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:56:08.362006 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a743b92-68d4-4199-befc-7cae147fdf36 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:56:08.373840 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1044/2080] 10.222.0.57 () {58 vars in 1122 bytes} [Fri Sep 16 07:56:08 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 16 07:56:08.379287 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a743b92-68d4-4199-befc-7cae147fdf36 admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:56:08.382935 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485f1221-d62c-456e-87de-f7c3fbba8023 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a9a069943712467dae194254d5b4e0d4, user_id=a435023773144dd4afb368f4fac28bf7, role_id=4818d38cf2564825b312e66c9eb24762)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:56:08.385611 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485f1221-d62c-456e-87de-f7c3fbba8023 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:56:08.393127 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a743b92-68d4-4199-befc-7cae147fdf36 admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:56:08.400827 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea6709f-788c-420e-981c-5dd33793dcd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:56:08.402455 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea6709f-788c-420e-981c-5dd33793dcd2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:08.403375 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea6709f-788c-420e-981c-5dd33793dcd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:08.403764 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea6709f-788c-420e-981c-5dd33793dcd2 admin admin] PATH_INFO: `/v3/projects/2b4cc1dbfcbd46b9b56e20c24aef69e7/users/547addc23fbe4fd3a3f126a4f2309d92/roles/567db03c91854ad9af1e9a87ec1bd275` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:08.405124 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1037/2081] 10.222.0.57 () {60 vars in 1483 bytes} [Fri Sep 16 07:56:08 2022] PUT /identity/v3/projects/a9a069943712467dae194254d5b4e0d4/users/a435023773144dd4afb368f4fac28bf7/roles/4818d38cf2564825b312e66c9eb24762 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 07:56:08.419884 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc03b2e-927d-4c7f-8a48-90040d979b9f None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:08.420406 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc03b2e-927d-4c7f-8a48-90040d979b9f None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:08.420859 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc03b2e-927d-4c7f-8a48-90040d979b9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:08.446635 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea6709f-788c-420e-981c-5dd33793dcd2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b4cc1dbfcbd46b9b56e20c24aef69e7, user_id=547addc23fbe4fd3a3f126a4f2309d92, role_id=567db03c91854ad9af1e9a87ec1bd275)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:56:08.451032 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea6709f-788c-420e-981c-5dd33793dcd2 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:56:08.465164 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-3cc03b2e-927d-4c7f-8a48-90040d979b9f None None] MFA Rules not processed for user `a435023773144dd4afb368f4fac28bf7`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:56:08.466731 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-3cc03b2e-927d-4c7f-8a48-90040d979b9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:56:08.471804 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1045/2082] 10.222.0.57 () {60 vars in 1483 bytes} [Fri Sep 16 07:56:08 2022] PUT /identity/v3/projects/2b4cc1dbfcbd46b9b56e20c24aef69e7/users/547addc23fbe4fd3a3f126a4f2309d92/roles/567db03c91854ad9af1e9a87ec1bd275 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 07:56:08.475739 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea6709f-788c-420e-981c-5dd33793dcd2 admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:56:08.507684 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:56:08.571054 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea6709f-788c-420e-981c-5dd33793dcd2 admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:56:08.588889 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1038/2083] 10.222.0.57 () {58 vars in 958 bytes} [Fri Sep 16 07:56:08 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 07:56:08.593311 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc03b2e-927d-4c7f-8a48-90040d979b9f None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:56:08.595004 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b667af-a706-432d-94bf-430006362a92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:56:08.596580 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b667af-a706-432d-94bf-430006362a92 admin admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:08.596872 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b667af-a706-432d-94bf-430006362a92 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:08.597145 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b667af-a706-432d-94bf-430006362a92 admin admin] PATH_INFO: `/v3/roles` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:08.597853 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b667af-a706-432d-94bf-430006362a92 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:56:08.599475 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b667af-a706-432d-94bf-430006362a92 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:56:08.611016 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1046/2084] 10.222.0.57 () {58 vars in 1122 bytes} [Fri Sep 16 07:56:08 2022] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 07:56:08.615297 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b667af-a706-432d-94bf-430006362a92 admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:56:08.617138 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc03b2e-927d-4c7f-8a48-90040d979b9f None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:56:08.623077 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d245a1d2-bd39-4637-be50-caccd48a3ce7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:56:08.623757 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d245a1d2-bd39-4637-be50-caccd48a3ce7 admin admin] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:08.624119 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d245a1d2-bd39-4637-be50-caccd48a3ce7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:08.624358 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d245a1d2-bd39-4637-be50-caccd48a3ce7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:08.626418 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d245a1d2-bd39-4637-be50-caccd48a3ce7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:56:08.628709 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d245a1d2-bd39-4637-be50-caccd48a3ce7 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:56:08.631735 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b667af-a706-432d-94bf-430006362a92 admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:56:08.637785 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c2a141-485d-4888-91d9-425be9a964f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:56:08.638367 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c2a141-485d-4888-91d9-425be9a964f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:08.638575 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c2a141-485d-4888-91d9-425be9a964f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:08.638845 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c2a141-485d-4888-91d9-425be9a964f4 admin admin] PATH_INFO: `/v3/projects/2b4cc1dbfcbd46b9b56e20c24aef69e7/users/547addc23fbe4fd3a3f126a4f2309d92/roles/567db03c91854ad9af1e9a87ec1bd275` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:08.640802 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c2a141-485d-4888-91d9-425be9a964f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b4cc1dbfcbd46b9b56e20c24aef69e7, user_id=547addc23fbe4fd3a3f126a4f2309d92, role_id=567db03c91854ad9af1e9a87ec1bd275)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:56:08.644497 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c2a141-485d-4888-91d9-425be9a964f4 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:56:08.656663 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1047/2085] 10.222.0.57 () {60 vars in 1483 bytes} [Fri Sep 16 07:56:08 2022] PUT /identity/v3/projects/2b4cc1dbfcbd46b9b56e20c24aef69e7/users/547addc23fbe4fd3a3f126a4f2309d92/roles/567db03c91854ad9af1e9a87ec1bd275 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 07:56:08.669981 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd833964-5b00-4ffe-acda-8778d3a05cb6 None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:08.670432 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd833964-5b00-4ffe-acda-8778d3a05cb6 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:08.670709 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd833964-5b00-4ffe-acda-8778d3a05cb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:08.681466 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1039/2086] 10.222.0.57 () {60 vars in 1153 bytes} [Fri Sep 16 07:56:08 2022] POST /identity/v3/projects => generated 385 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 07:56:08.683384 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d245a1d2-bd39-4637-be50-caccd48a3ce7 admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:56:08.708592 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-fd833964-5b00-4ffe-acda-8778d3a05cb6 None None] MFA Rules not processed for user `547addc23fbe4fd3a3f126a4f2309d92`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:56:08.709861 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-fd833964-5b00-4ffe-acda-8778d3a05cb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:56:08.812484 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:56:08.816589 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d245a1d2-bd39-4637-be50-caccd48a3ce7 admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:56:08.835782 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085a98ab-b34c-48f6-97e4-9041d45a2cb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:56:08.837088 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085a98ab-b34c-48f6-97e4-9041d45a2cb3 admin admin] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:08.837531 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085a98ab-b34c-48f6-97e4-9041d45a2cb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:08.837898 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085a98ab-b34c-48f6-97e4-9041d45a2cb3 admin admin] PATH_INFO: `/v3/users` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:08.838614 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085a98ab-b34c-48f6-97e4-9041d45a2cb3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:56:08.841045 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085a98ab-b34c-48f6-97e4-9041d45a2cb3 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:56:08.879966 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1040/2087] 10.222.0.57 () {60 vars in 1144 bytes} [Fri Sep 16 07:56:08 2022] POST /identity/v3/users => generated 299 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 07:56:08.885706 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085a98ab-b34c-48f6-97e4-9041d45a2cb3 admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:56:08.894433 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1048/2088] 10.222.0.57 () {58 vars in 958 bytes} [Fri Sep 16 07:56:08 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 07:56:08.913616 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd833964-5b00-4ffe-acda-8778d3a05cb6 None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:56:08.916594 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085a98ab-b34c-48f6-97e4-9041d45a2cb3 admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:56:08.923337 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d073fc-341a-4452-acb8-ad33ca45fd56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:56:08.924115 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d073fc-341a-4452-acb8-ad33ca45fd56 admin admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:08.924492 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d073fc-341a-4452-acb8-ad33ca45fd56 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:08.924866 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d073fc-341a-4452-acb8-ad33ca45fd56 admin admin] PATH_INFO: `/v3/roles` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:08.925618 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d073fc-341a-4452-acb8-ad33ca45fd56 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:56:08.927609 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d073fc-341a-4452-acb8-ad33ca45fd56 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:56:08.946635 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1041/2089] 10.222.0.57 () {58 vars in 1122 bytes} [Fri Sep 16 07:56:08 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 07:56:08.947870 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d073fc-341a-4452-acb8-ad33ca45fd56 admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:56:08.988439 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d073fc-341a-4452-acb8-ad33ca45fd56 admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:56:09.002370 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43f944d-760c-4622-9388-abeb8bb97fa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:56:09.003688 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43f944d-760c-4622-9388-abeb8bb97fa0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:09.003973 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43f944d-760c-4622-9388-abeb8bb97fa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:09.004250 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43f944d-760c-4622-9388-abeb8bb97fa0 admin admin] PATH_INFO: `/v3/projects/046ac1a5f1734fd880b24e036a59df46/users/16ea8f426ac942d18a61e9cfb0236843/roles/567db03c91854ad9af1e9a87ec1bd275` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:09.036350 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd833964-5b00-4ffe-acda-8778d3a05cb6 None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:56:09.046018 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2bf820-8768-4901-a8aa-c15920a40da2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544bf6be4c24454a013ca110c43cef2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4735f453c0c24cc4a1c14e9ac84a0b46', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:56:09.046649 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2bf820-8768-4901-a8aa-c15920a40da2 service cinder] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:09.049421 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2bf820-8768-4901-a8aa-c15920a40da2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:09.049891 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2bf820-8768-4901-a8aa-c15920a40da2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:09.075960 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43f944d-760c-4622-9388-abeb8bb97fa0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=046ac1a5f1734fd880b24e036a59df46, user_id=16ea8f426ac942d18a61e9cfb0236843, role_id=567db03c91854ad9af1e9a87ec1bd275)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:56:09.087165 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43f944d-760c-4622-9388-abeb8bb97fa0 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:56:09.087610 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2bf820-8768-4901-a8aa-c15920a40da2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:56:09.091737 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2bf820-8768-4901-a8aa-c15920a40da2 service cinder] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:56:09.104781 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1042/2090] 10.222.0.57 () {60 vars in 1483 bytes} [Fri Sep 16 07:56:08 2022] PUT /identity/v3/projects/046ac1a5f1734fd880b24e036a59df46/users/16ea8f426ac942d18a61e9cfb0236843/roles/567db03c91854ad9af1e9a87ec1bd275 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 07:56:09.108526 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43f944d-760c-4622-9388-abeb8bb97fa0 admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:56:09.152670 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1049/2091] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Sep 16 07:56:08 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 16 07:56:09.210085 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:56:09.234691 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43f944d-760c-4622-9388-abeb8bb97fa0 admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:56:09.246038 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c16d11d-66d8-4fc4-9bca-5f7a9a3e2c36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:56:09.248647 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c16d11d-66d8-4fc4-9bca-5f7a9a3e2c36 admin admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:09.248848 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c16d11d-66d8-4fc4-9bca-5f7a9a3e2c36 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:09.249163 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c16d11d-66d8-4fc4-9bca-5f7a9a3e2c36 admin admin] PATH_INFO: `/v3/roles` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:09.251770 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c16d11d-66d8-4fc4-9bca-5f7a9a3e2c36 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:56:09.253568 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c16d11d-66d8-4fc4-9bca-5f7a9a3e2c36 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:56:09.285812 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1043/2092] 10.222.0.57 () {58 vars in 1122 bytes} [Fri Sep 16 07:56:09 2022] GET /identity/v3/roles => generated 1420 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 16 07:56:09.285964 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2bf820-8768-4901-a8aa-c15920a40da2 service cinder] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:56:09.294272 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c16d11d-66d8-4fc4-9bca-5f7a9a3e2c36 admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:56:09.296708 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2bf820-8768-4901-a8aa-c15920a40da2 service cinder] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:56:09.311721 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c16d11d-66d8-4fc4-9bca-5f7a9a3e2c36 admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:56:09.324886 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8120cb51-56db-423e-9cf6-a20893b13c7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:56:09.325700 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8120cb51-56db-423e-9cf6-a20893b13c7e admin admin] REQUEST_METHOD: `PUT` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:09.326089 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8120cb51-56db-423e-9cf6-a20893b13c7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:09.326434 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8120cb51-56db-423e-9cf6-a20893b13c7e admin admin] PATH_INFO: `/v3/projects/046ac1a5f1734fd880b24e036a59df46/users/16ea8f426ac942d18a61e9cfb0236843/roles/567db03c91854ad9af1e9a87ec1bd275` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:09.329362 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8120cb51-56db-423e-9cf6-a20893b13c7e admin admin] RBAC: Authorizing `identity:create_grant(project_id=046ac1a5f1734fd880b24e036a59df46, user_id=16ea8f426ac942d18a61e9cfb0236843, role_id=567db03c91854ad9af1e9a87ec1bd275)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:56:09.332796 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8120cb51-56db-423e-9cf6-a20893b13c7e admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:56:09.348239 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1044/2093] 10.222.0.57 () {60 vars in 1483 bytes} [Fri Sep 16 07:56:09 2022] PUT /identity/v3/projects/046ac1a5f1734fd880b24e036a59df46/users/16ea8f426ac942d18a61e9cfb0236843/roles/567db03c91854ad9af1e9a87ec1bd275 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 07:56:09.349460 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8120cb51-56db-423e-9cf6-a20893b13c7e admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:56:09.358306 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-8120cb51-56db-423e-9cf6-a20893b13c7e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:56:09.379687 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6342f845-4cb9-4c5c-95e0-1447b84a9b7a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544bf6be4c24454a013ca110c43cef2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4735f453c0c24cc4a1c14e9ac84a0b46', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:56:09.380974 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6342f845-4cb9-4c5c-95e0-1447b84a9b7a service cinder] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:09.381349 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6342f845-4cb9-4c5c-95e0-1447b84a9b7a service cinder] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:09.381696 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6342f845-4cb9-4c5c-95e0-1447b84a9b7a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:09.493378 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6342f845-4cb9-4c5c-95e0-1447b84a9b7a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:56:09.495530 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6342f845-4cb9-4c5c-95e0-1447b84a9b7a service cinder] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:56:09.509704 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1050/2094] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Sep 16 07:56:09 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 07:56:09.511528 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1d2a2a-9420-48a1-895a-80f863a07982 None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:09.511870 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1d2a2a-9420-48a1-895a-80f863a07982 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:09.512121 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1d2a2a-9420-48a1-895a-80f863a07982 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:09.531221 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8120cb51-56db-423e-9cf6-a20893b13c7e admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:56:09.551104 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-ce1d2a2a-9420-48a1-895a-80f863a07982 None None] MFA Rules not processed for user `16ea8f426ac942d18a61e9cfb0236843`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:56:09.551317 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bbb128-66bb-4c0e-9dc7-ef2b64a634d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:56:09.551950 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bbb128-66bb-4c0e-9dc7-ef2b64a634d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:09.552238 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bbb128-66bb-4c0e-9dc7-ef2b64a634d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:09.552693 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bbb128-66bb-4c0e-9dc7-ef2b64a634d8 admin admin] PATH_INFO: `/v3/projects/3be065132d6744e182cb0b5235b20a47` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:09.553390 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-ce1d2a2a-9420-48a1-895a-80f863a07982 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:56:09.554116 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53bbb128-66bb-4c0e-9dc7-ef2b64a634d8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3be065132d6744e182cb0b5235b20a47)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:56:09.562113 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53bbb128-66bb-4c0e-9dc7-ef2b64a634d8 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:56:09.585921 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:56:09.654603 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-53bbb128-66bb-4c0e-9dc7-ef2b64a634d8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3be065132d6744e182cb0b5235b20a47', 'request_id': 'req-53bbb128-66bb-4c0e-9dc7-ef2b64a634d8'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:56:09.668117 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-53bbb128-66bb-4c0e-9dc7-ef2b64a634d8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3be065132d6744e182cb0b5235b20a47', 'request_id': 'req-53bbb128-66bb-4c0e-9dc7-ef2b64a634d8'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:56:09.677146 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-53bbb128-66bb-4c0e-9dc7-ef2b64a634d8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3be065132d6744e182cb0b5235b20a47', 'request_id': 'req-53bbb128-66bb-4c0e-9dc7-ef2b64a634d8'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:56:09.690917 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-53bbb128-66bb-4c0e-9dc7-ef2b64a634d8 admin admin] The token cache is being invalidate because project 3be065132d6744e182cb0b5235b20a47 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81430) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 07:56:09.691441 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-53bbb128-66bb-4c0e-9dc7-ef2b64a634d8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:56:09.692577 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-53bbb128-66bb-4c0e-9dc7-ef2b64a634d8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:56:09.693062 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1051/2095] 10.222.0.57 () {58 vars in 958 bytes} [Fri Sep 16 07:56:09 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 07:56:09.697892 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1045/2096] 10.222.0.57 () {58 vars in 1233 bytes} [Fri Sep 16 07:56:09 2022] DELETE /identity/v3/projects/3be065132d6744e182cb0b5235b20a47 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 07:56:09.699256 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1d2a2a-9420-48a1-895a-80f863a07982 None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:56:09.710498 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1d2a2a-9420-48a1-895a-80f863a07982 None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:56:09.711010 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bbb128-66bb-4c0e-9dc7-ef2b64a634d8 admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:56:09.713406 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-53bbb128-66bb-4c0e-9dc7-ef2b64a634d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:56:09.785964 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd1e630-abdf-43c7-a07c-d1c75f40a39a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:56:09.786750 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd1e630-abdf-43c7-a07c-d1c75f40a39a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:09.786938 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd1e630-abdf-43c7-a07c-d1c75f40a39a admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:09.787198 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd1e630-abdf-43c7-a07c-d1c75f40a39a admin admin] PATH_INFO: `/v3/users/d0374c163b934acd967df84fd448bb04` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:09.788385 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd1e630-abdf-43c7-a07c-d1c75f40a39a admin admin] RBAC: Authorizing `identity:delete_user(user_id=d0374c163b934acd967df84fd448bb04)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:56:09.790818 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd1e630-abdf-43c7-a07c-d1c75f40a39a admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:56:09.800020 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bbb128-66bb-4c0e-9dc7-ef2b64a634d8 admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:56:09.803758 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504c8349-6590-4b38-b658-afae8dd2b526 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544bf6be4c24454a013ca110c43cef2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4735f453c0c24cc4a1c14e9ac84a0b46', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:56:09.804368 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504c8349-6590-4b38-b658-afae8dd2b526 service cinder] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:09.804646 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504c8349-6590-4b38-b658-afae8dd2b526 service cinder] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:09.804918 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504c8349-6590-4b38-b658-afae8dd2b526 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:09.806961 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-504c8349-6590-4b38-b658-afae8dd2b526 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:56:09.830535 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:56:09.845241 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-edd1e630-abdf-43c7-a07c-d1c75f40a39a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd0374c163b934acd967df84fd448bb04'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:56:09.865497 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-edd1e630-abdf-43c7-a07c-d1c75f40a39a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd0374c163b934acd967df84fd448bb04'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:56:09.866871 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-edd1e630-abdf-43c7-a07c-d1c75f40a39a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd0374c163b934acd967df84fd448bb04'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:56:09.881622 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-edd1e630-abdf-43c7-a07c-d1c75f40a39a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd0374c163b934acd967df84fd448bb04'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:56:09.893812 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-edd1e630-abdf-43c7-a07c-d1c75f40a39a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd0374c163b934acd967df84fd448bb04'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:56:09.903798 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504c8349-6590-4b38-b658-afae8dd2b526 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:56:09.905300 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504c8349-6590-4b38-b658-afae8dd2b526 service cinder] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:56:09.906132 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1052/2097] 10.222.0.57 () {58 vars in 1224 bytes} [Fri Sep 16 07:56:09 2022] DELETE /identity/v3/users/d0374c163b934acd967df84fd448bb04 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 07:56:09.925908 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1046/2098] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Sep 16 07:56:09 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 07:56:10.009374 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd1e630-abdf-43c7-a07c-d1c75f40a39a admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:56:10.011009 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-edd1e630-abdf-43c7-a07c-d1c75f40a39a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:56:10.067342 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:56:10.124017 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd1e630-abdf-43c7-a07c-d1c75f40a39a admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:56:10.131904 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326707ad-607b-4480-b83e-4528c7c6665e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:56:10.131904 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326707ad-607b-4480-b83e-4528c7c6665e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:10.131904 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326707ad-607b-4480-b83e-4528c7c6665e admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:10.132185 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326707ad-607b-4480-b83e-4528c7c6665e admin admin] PATH_INFO: `/v3/users/a435023773144dd4afb368f4fac28bf7` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:10.134886 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326707ad-607b-4480-b83e-4528c7c6665e admin admin] RBAC: Authorizing `identity:delete_user(user_id=a435023773144dd4afb368f4fac28bf7)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:56:10.137105 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326707ad-607b-4480-b83e-4528c7c6665e admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:56:10.257875 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504c8349-6590-4b38-b658-afae8dd2b526 service cinder] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:56:10.259861 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-504c8349-6590-4b38-b658-afae8dd2b526 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:56:10.271779 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-326707ad-607b-4480-b83e-4528c7c6665e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a435023773144dd4afb368f4fac28bf7'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:56:10.286998 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504c8349-6590-4b38-b658-afae8dd2b526 service cinder] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:56:10.303415 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-326707ad-607b-4480-b83e-4528c7c6665e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a435023773144dd4afb368f4fac28bf7'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:56:10.305089 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cead857c-df7f-4dc1-8f9b-4c90f9852fdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:56:10.306108 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-326707ad-607b-4480-b83e-4528c7c6665e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a435023773144dd4afb368f4fac28bf7'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:56:10.307547 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cead857c-df7f-4dc1-8f9b-4c90f9852fdb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:10.307949 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cead857c-df7f-4dc1-8f9b-4c90f9852fdb admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:10.308230 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cead857c-df7f-4dc1-8f9b-4c90f9852fdb admin admin] PATH_INFO: `/v3/users/31a668b9445f42ba89880644e2d1b36b` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:10.310682 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cead857c-df7f-4dc1-8f9b-4c90f9852fdb admin admin] RBAC: Authorizing `identity:delete_user(user_id=31a668b9445f42ba89880644e2d1b36b)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:56:10.330293 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cead857c-df7f-4dc1-8f9b-4c90f9852fdb admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:56:10.339527 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-326707ad-607b-4480-b83e-4528c7c6665e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a435023773144dd4afb368f4fac28bf7'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:56:10.368441 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-326707ad-607b-4480-b83e-4528c7c6665e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a435023773144dd4afb368f4fac28bf7'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:56:10.385881 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1053/2099] 10.222.0.57 () {58 vars in 1224 bytes} [Fri Sep 16 07:56:10 2022] DELETE /identity/v3/users/a435023773144dd4afb368f4fac28bf7 => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 07:56:10.401932 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3ad923-27c1-4a96-a682-2ece3d53a422 None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:10.401932 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3ad923-27c1-4a96-a682-2ece3d53a422 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:10.401932 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3ad923-27c1-4a96-a682-2ece3d53a422 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:10.426043 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-4a3ad923-27c1-4a96-a682-2ece3d53a422 None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:56:10.427357 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-4a3ad923-27c1-4a96-a682-2ece3d53a422 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:56:10.446328 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-cead857c-df7f-4dc1-8f9b-4c90f9852fdb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '31a668b9445f42ba89880644e2d1b36b'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:56:10.446328 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-cead857c-df7f-4dc1-8f9b-4c90f9852fdb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '31a668b9445f42ba89880644e2d1b36b'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:56:10.466853 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-cead857c-df7f-4dc1-8f9b-4c90f9852fdb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '31a668b9445f42ba89880644e2d1b36b'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:56:10.494489 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-cead857c-df7f-4dc1-8f9b-4c90f9852fdb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '31a668b9445f42ba89880644e2d1b36b'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:56:10.503773 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-cead857c-df7f-4dc1-8f9b-4c90f9852fdb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '31a668b9445f42ba89880644e2d1b36b'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:56:10.510409 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1047/2100] 10.222.0.57 () {58 vars in 1224 bytes} [Fri Sep 16 07:56:10 2022] DELETE /identity/v3/users/31a668b9445f42ba89880644e2d1b36b => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 07:56:10.511889 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cead857c-df7f-4dc1-8f9b-4c90f9852fdb admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:56:10.513407 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-cead857c-df7f-4dc1-8f9b-4c90f9852fdb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:56:10.556500 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1054/2101] 10.222.0.57 () {58 vars in 958 bytes} [Fri Sep 16 07:56:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 07:56:10.557768 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902d504f-6033-4e51-87d2-176602d2b4be None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:10.558047 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902d504f-6033-4e51-87d2-176602d2b4be None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:10.558486 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902d504f-6033-4e51-87d2-176602d2b4be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:10.583811 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-902d504f-6033-4e51-87d2-176602d2b4be None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:56:10.585158 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-902d504f-6033-4e51-87d2-176602d2b4be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:56:10.611366 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cead857c-df7f-4dc1-8f9b-4c90f9852fdb admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:56:10.616539 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7aecc96-f615-42a7-a78f-3484d5727439 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:56:10.617193 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7aecc96-f615-42a7-a78f-3484d5727439 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:10.617473 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7aecc96-f615-42a7-a78f-3484d5727439 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:10.618047 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7aecc96-f615-42a7-a78f-3484d5727439 admin admin] PATH_INFO: `/v3/projects/df1420bbd6994222b692379cec1a6265` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:10.619199 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7aecc96-f615-42a7-a78f-3484d5727439 admin admin] RBAC: Authorizing `identity:delete_project(project_id=df1420bbd6994222b692379cec1a6265)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:56:10.621343 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7aecc96-f615-42a7-a78f-3484d5727439 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:56:10.647865 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:56:10.665504 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:56:10.689606 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1055/2102] 10.222.0.57 () {58 vars in 958 bytes} [Fri Sep 16 07:56:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 07:56:10.690806 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902d504f-6033-4e51-87d2-176602d2b4be None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:56:10.692683 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-902d504f-6033-4e51-87d2-176602d2b4be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:56:10.692866 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-d7aecc96-f615-42a7-a78f-3484d5727439 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'df1420bbd6994222b692379cec1a6265', 'request_id': 'req-d7aecc96-f615-42a7-a78f-3484d5727439'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:56:10.721684 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-d7aecc96-f615-42a7-a78f-3484d5727439 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'df1420bbd6994222b692379cec1a6265', 'request_id': 'req-d7aecc96-f615-42a7-a78f-3484d5727439'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:56:10.731496 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-d7aecc96-f615-42a7-a78f-3484d5727439 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'df1420bbd6994222b692379cec1a6265', 'request_id': 'req-d7aecc96-f615-42a7-a78f-3484d5727439'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:56:10.748834 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-d7aecc96-f615-42a7-a78f-3484d5727439 admin admin] The token cache is being invalidate because project df1420bbd6994222b692379cec1a6265 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81430) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 07:56:10.749135 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-d7aecc96-f615-42a7-a78f-3484d5727439 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:56:10.750087 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-d7aecc96-f615-42a7-a78f-3484d5727439 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:56:10.751659 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1048/2103] 10.222.0.57 () {58 vars in 1233 bytes} [Fri Sep 16 07:56:10 2022] DELETE /identity/v3/projects/df1420bbd6994222b692379cec1a6265 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 07:56:10.752693 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7aecc96-f615-42a7-a78f-3484d5727439 admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:56:10.754102 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-d7aecc96-f615-42a7-a78f-3484d5727439 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:56:10.782373 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902d504f-6033-4e51-87d2-176602d2b4be None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:56:10.832223 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7aecc96-f615-42a7-a78f-3484d5727439 admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:56:10.836756 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba4c564-c477-4add-87e3-b972926c4642 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1062e457207a41e4ba4f0a0c4bf36f1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4735f453c0c24cc4a1c14e9ac84a0b46', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:56:10.837600 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba4c564-c477-4add-87e3-b972926c4642 service neutron] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:10.837987 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba4c564-c477-4add-87e3-b972926c4642 service neutron] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:10.838331 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba4c564-c477-4add-87e3-b972926c4642 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:10.841400 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-9ba4c564-c477-4add-87e3-b972926c4642 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:56:10.846029 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195c5527-7f6d-4633-b259-bdf82cecc218 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1062e457207a41e4ba4f0a0c4bf36f1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4735f453c0c24cc4a1c14e9ac84a0b46', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:56:10.846734 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195c5527-7f6d-4633-b259-bdf82cecc218 service neutron] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:10.847093 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195c5527-7f6d-4633-b259-bdf82cecc218 service neutron] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:10.847549 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195c5527-7f6d-4633-b259-bdf82cecc218 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:10.854378 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-195c5527-7f6d-4633-b259-bdf82cecc218 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:56:10.921534 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba4c564-c477-4add-87e3-b972926c4642 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:56:10.923032 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba4c564-c477-4add-87e3-b972926c4642 service neutron] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:56:10.931593 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195c5527-7f6d-4633-b259-bdf82cecc218 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:56:10.933044 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195c5527-7f6d-4633-b259-bdf82cecc218 service neutron] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:56:10.940886 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1049/2104] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Sep 16 07:56:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 07:56:10.942078 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca696a0f-ddab-4fc1-8d16-56dd60683139 None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:10.942413 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca696a0f-ddab-4fc1-8d16-56dd60683139 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:10.942685 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca696a0f-ddab-4fc1-8d16-56dd60683139 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:10.945405 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1056/2105] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Sep 16 07:56:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 255 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 07:56:10.965506 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-ca696a0f-ddab-4fc1-8d16-56dd60683139 None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:56:10.966639 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-ca696a0f-ddab-4fc1-8d16-56dd60683139 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:56:10.975720 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1050/2106] 10.222.0.57 () {58 vars in 958 bytes} [Fri Sep 16 07:56:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 07:56:10.983722 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb568c9a-adb4-4f53-992f-8cb54601eff6 None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:10.984002 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb568c9a-adb4-4f53-992f-8cb54601eff6 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:10.984274 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb568c9a-adb4-4f53-992f-8cb54601eff6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:11.008293 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-cb568c9a-adb4-4f53-992f-8cb54601eff6 None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:56:11.009566 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-cb568c9a-adb4-4f53-992f-8cb54601eff6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:56:11.019103 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1057/2107] 10.222.0.57 () {58 vars in 958 bytes} [Fri Sep 16 07:56:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 16 07:56:11.023316 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca696a0f-ddab-4fc1-8d16-56dd60683139 None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:56:11.036139 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca696a0f-ddab-4fc1-8d16-56dd60683139 None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:56:11.044208 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ff591f-3325-484e-be0c-172fc8c7ebdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:56:11.045518 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ff591f-3325-484e-be0c-172fc8c7ebdb admin admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:11.046177 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ff591f-3325-484e-be0c-172fc8c7ebdb admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:11.046913 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ff591f-3325-484e-be0c-172fc8c7ebdb admin admin] PATH_INFO: `/v3/domains` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:11.047848 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ff591f-3325-484e-be0c-172fc8c7ebdb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:56:11.048349 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ff591f-3325-484e-be0c-172fc8c7ebdb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:56:11.050401 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ff591f-3325-484e-be0c-172fc8c7ebdb admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:56:11.067337 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1051/2108] 10.222.0.57 () {58 vars in 1153 bytes} [Fri Sep 16 07:56:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:56:11.071908 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb568c9a-adb4-4f53-992f-8cb54601eff6 None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:56:11.083730 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb568c9a-adb4-4f53-992f-8cb54601eff6 None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:56:11.088942 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3dbc6f4-a3bb-4a90-b6af-ee7d31767849 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:56:11.089559 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dbc6f4-a3bb-4a90-b6af-ee7d31767849 admin admin] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:11.089939 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dbc6f4-a3bb-4a90-b6af-ee7d31767849 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:11.090427 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dbc6f4-a3bb-4a90-b6af-ee7d31767849 admin admin] PATH_INFO: `/v3/projects` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:11.090836 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3dbc6f4-a3bb-4a90-b6af-ee7d31767849 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:56:11.092903 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3dbc6f4-a3bb-4a90-b6af-ee7d31767849 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:56:11.131009 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1058/2109] 10.222.0.57 () {60 vars in 1153 bytes} [Fri Sep 16 07:56:11 2022] POST /identity/v3/projects => generated 373 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 16 07:56:11.135079 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ff591f-3325-484e-be0c-172fc8c7ebdb admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:56:11.153250 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ff591f-3325-484e-be0c-172fc8c7ebdb admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:56:11.203188 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:56:11.222911 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd26708d-beaf-4382-ae51-040a1a80c8d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:56:11.224434 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd26708d-beaf-4382-ae51-040a1a80c8d5 admin admin] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:11.224836 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd26708d-beaf-4382-ae51-040a1a80c8d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:11.225352 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd26708d-beaf-4382-ae51-040a1a80c8d5 admin admin] PATH_INFO: `/v3/users` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:11.226327 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd26708d-beaf-4382-ae51-040a1a80c8d5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:56:11.228404 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd26708d-beaf-4382-ae51-040a1a80c8d5 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:56:11.261882 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3dbc6f4-a3bb-4a90-b6af-ee7d31767849 admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:56:11.270558 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1052/2110] 10.222.0.57 () {60 vars in 1144 bytes} [Fri Sep 16 07:56:11 2022] POST /identity/v3/users => generated 287 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 16 07:56:11.275665 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3dbc6f4-a3bb-4a90-b6af-ee7d31767849 admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:56:11.281299 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8a9a07-ea95-42e7-a944-b6e94aeeba39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:56:11.282050 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8a9a07-ea95-42e7-a944-b6e94aeeba39 admin admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:11.282389 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8a9a07-ea95-42e7-a944-b6e94aeeba39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:11.282865 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8a9a07-ea95-42e7-a944-b6e94aeeba39 admin admin] PATH_INFO: `/v3/roles` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:11.283610 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8a9a07-ea95-42e7-a944-b6e94aeeba39 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:56:11.286080 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8a9a07-ea95-42e7-a944-b6e94aeeba39 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:56:11.302392 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd26708d-beaf-4382-ae51-040a1a80c8d5 admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:56:11.303040 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1059/2111] 10.222.0.57 () {58 vars in 1122 bytes} [Fri Sep 16 07:56:11 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 07:56:11.314726 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd26708d-beaf-4382-ae51-040a1a80c8d5 admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:56:11.321010 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9745e73b-37cc-47df-a27f-10aad003d04b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:56:11.321620 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9745e73b-37cc-47df-a27f-10aad003d04b admin admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:11.322149 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9745e73b-37cc-47df-a27f-10aad003d04b admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:11.322431 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9745e73b-37cc-47df-a27f-10aad003d04b admin admin] PATH_INFO: `/v3/roles` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:11.323125 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9745e73b-37cc-47df-a27f-10aad003d04b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:56:11.325260 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9745e73b-37cc-47df-a27f-10aad003d04b admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:56:11.342014 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1053/2112] 10.222.0.57 () {58 vars in 1122 bytes} [Fri Sep 16 07:56:11 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 07:56:11.345789 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8a9a07-ea95-42e7-a944-b6e94aeeba39 admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:56:11.358114 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8a9a07-ea95-42e7-a944-b6e94aeeba39 admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:56:11.385942 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8bf82b-b26b-4142-9117-7fdf4977a60a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:56:11.386645 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8bf82b-b26b-4142-9117-7fdf4977a60a admin admin] REQUEST_METHOD: `PUT` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:11.390783 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8bf82b-b26b-4142-9117-7fdf4977a60a admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:11.390783 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8bf82b-b26b-4142-9117-7fdf4977a60a admin admin] PATH_INFO: `/v3/projects/512d130f61674f1e9ddb08017bc05e47/users/a5f55e403a5543d4aae0b463ac8bad58/roles/4818d38cf2564825b312e66c9eb24762` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:11.424858 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9745e73b-37cc-47df-a27f-10aad003d04b admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:56:11.427073 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-9745e73b-37cc-47df-a27f-10aad003d04b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:56:11.445761 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:56:11.449237 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9745e73b-37cc-47df-a27f-10aad003d04b admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:56:11.457448 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e37bdc-87f7-4a42-90b7-ff0f933127b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:56:11.458247 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e37bdc-87f7-4a42-90b7-ff0f933127b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:11.458497 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e37bdc-87f7-4a42-90b7-ff0f933127b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:11.458783 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e37bdc-87f7-4a42-90b7-ff0f933127b5 admin admin] PATH_INFO: `/v3/projects/a9a069943712467dae194254d5b4e0d4` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:11.460131 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e37bdc-87f7-4a42-90b7-ff0f933127b5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a9a069943712467dae194254d5b4e0d4)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:56:11.461944 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8bf82b-b26b-4142-9117-7fdf4977a60a admin admin] RBAC: Authorizing `identity:create_grant(project_id=512d130f61674f1e9ddb08017bc05e47, user_id=a5f55e403a5543d4aae0b463ac8bad58, role_id=4818d38cf2564825b312e66c9eb24762)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:56:11.466772 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8bf82b-b26b-4142-9117-7fdf4977a60a admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:56:11.476371 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e37bdc-87f7-4a42-90b7-ff0f933127b5 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:56:11.499292 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1060/2113] 10.222.0.57 () {60 vars in 1483 bytes} [Fri Sep 16 07:56:11 2022] PUT /identity/v3/projects/512d130f61674f1e9ddb08017bc05e47/users/a5f55e403a5543d4aae0b463ac8bad58/roles/4818d38cf2564825b312e66c9eb24762 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 07:56:11.510266 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be87a43-8dcf-427b-af4a-6d1116e06735 None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:11.510561 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be87a43-8dcf-427b-af4a-6d1116e06735 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:11.510837 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be87a43-8dcf-427b-af4a-6d1116e06735 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:11.574431 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-7be87a43-8dcf-427b-af4a-6d1116e06735 None None] MFA Rules not processed for user `a5f55e403a5543d4aae0b463ac8bad58`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:56:11.575660 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-7be87a43-8dcf-427b-af4a-6d1116e06735 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:56:11.582394 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-f4e37bdc-87f7-4a42-90b7-ff0f933127b5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a9a069943712467dae194254d5b4e0d4', 'request_id': 'req-f4e37bdc-87f7-4a42-90b7-ff0f933127b5'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:56:11.591611 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-f4e37bdc-87f7-4a42-90b7-ff0f933127b5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a9a069943712467dae194254d5b4e0d4', 'request_id': 'req-f4e37bdc-87f7-4a42-90b7-ff0f933127b5'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:56:11.606029 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-f4e37bdc-87f7-4a42-90b7-ff0f933127b5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a9a069943712467dae194254d5b4e0d4', 'request_id': 'req-f4e37bdc-87f7-4a42-90b7-ff0f933127b5'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:56:11.630975 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-f4e37bdc-87f7-4a42-90b7-ff0f933127b5 admin admin] The token cache is being invalidate because project a9a069943712467dae194254d5b4e0d4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81430) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 07:56:11.632300 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-f4e37bdc-87f7-4a42-90b7-ff0f933127b5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:56:11.633021 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-f4e37bdc-87f7-4a42-90b7-ff0f933127b5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:56:11.635047 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1054/2114] 10.222.0.57 () {58 vars in 1233 bytes} [Fri Sep 16 07:56:11 2022] DELETE /identity/v3/projects/a9a069943712467dae194254d5b4e0d4 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 07:56:11.635977 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e37bdc-87f7-4a42-90b7-ff0f933127b5 admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:56:11.638223 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-f4e37bdc-87f7-4a42-90b7-ff0f933127b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:56:11.690838 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1061/2115] 10.222.0.57 () {58 vars in 958 bytes} [Fri Sep 16 07:56:11 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 16 07:56:11.692207 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be87a43-8dcf-427b-af4a-6d1116e06735 None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:56:11.695676 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-7be87a43-8dcf-427b-af4a-6d1116e06735 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:56:11.789904 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e37bdc-87f7-4a42-90b7-ff0f933127b5 admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:56:11.800631 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb244014-5d1a-4670-a607-6bf3da6fb2d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:56:11.802264 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb244014-5d1a-4670-a607-6bf3da6fb2d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:11.803431 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb244014-5d1a-4670-a607-6bf3da6fb2d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:11.803751 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb244014-5d1a-4670-a607-6bf3da6fb2d0 admin admin] PATH_INFO: `/v3/projects/5e32d637ffd945e1895ae2b72e6e7612` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:11.805219 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb244014-5d1a-4670-a607-6bf3da6fb2d0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5e32d637ffd945e1895ae2b72e6e7612)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:56:11.807288 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb244014-5d1a-4670-a607-6bf3da6fb2d0 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:56:11.833048 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be87a43-8dcf-427b-af4a-6d1116e06735 None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:56:11.841063 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c51f791-34c2-4642-97ef-d6a575e0e653 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:56:11.842886 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c51f791-34c2-4642-97ef-d6a575e0e653 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:11.843282 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c51f791-34c2-4642-97ef-d6a575e0e653 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:11.843523 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c51f791-34c2-4642-97ef-d6a575e0e653 admin admin] PATH_INFO: `/v3/users/16ea8f426ac942d18a61e9cfb0236843` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:11.845506 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c51f791-34c2-4642-97ef-d6a575e0e653 admin admin] RBAC: Authorizing `identity:delete_user(user_id=16ea8f426ac942d18a61e9cfb0236843)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:56:11.848981 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c51f791-34c2-4642-97ef-d6a575e0e653 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:56:11.909662 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-eb244014-5d1a-4670-a607-6bf3da6fb2d0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5e32d637ffd945e1895ae2b72e6e7612', 'request_id': 'req-eb244014-5d1a-4670-a607-6bf3da6fb2d0'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:56:11.912436 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=85,keystone:INSERT=4,keystone:DELETE=11 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:56:11.925468 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-2c51f791-34c2-4642-97ef-d6a575e0e653 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '16ea8f426ac942d18a61e9cfb0236843'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:56:11.943112 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-eb244014-5d1a-4670-a607-6bf3da6fb2d0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5e32d637ffd945e1895ae2b72e6e7612', 'request_id': 'req-eb244014-5d1a-4670-a607-6bf3da6fb2d0'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:56:11.952923 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-eb244014-5d1a-4670-a607-6bf3da6fb2d0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5e32d637ffd945e1895ae2b72e6e7612', 'request_id': 'req-eb244014-5d1a-4670-a607-6bf3da6fb2d0'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:56:11.968213 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-eb244014-5d1a-4670-a607-6bf3da6fb2d0 admin admin] The token cache is being invalidate because project 5e32d637ffd945e1895ae2b72e6e7612 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81430) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 07:56:11.968658 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-eb244014-5d1a-4670-a607-6bf3da6fb2d0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:56:11.969992 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-eb244014-5d1a-4670-a607-6bf3da6fb2d0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:56:11.972204 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1055/2116] 10.222.0.57 () {58 vars in 1233 bytes} [Fri Sep 16 07:56:11 2022] DELETE /identity/v3/projects/5e32d637ffd945e1895ae2b72e6e7612 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 07:56:11.975998 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb244014-5d1a-4670-a607-6bf3da6fb2d0 admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:56:11.980575 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-eb244014-5d1a-4670-a607-6bf3da6fb2d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:56:11.983711 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-2c51f791-34c2-4642-97ef-d6a575e0e653 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '16ea8f426ac942d18a61e9cfb0236843'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:56:11.985208 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-2c51f791-34c2-4642-97ef-d6a575e0e653 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '16ea8f426ac942d18a61e9cfb0236843'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:56:12.000884 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-2c51f791-34c2-4642-97ef-d6a575e0e653 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '16ea8f426ac942d18a61e9cfb0236843'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:56:12.012915 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-2c51f791-34c2-4642-97ef-d6a575e0e653 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '16ea8f426ac942d18a61e9cfb0236843'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:56:12.017316 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:56:12.026600 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1062/2117] 10.222.0.57 () {58 vars in 1224 bytes} [Fri Sep 16 07:56:11 2022] DELETE /identity/v3/users/16ea8f426ac942d18a61e9cfb0236843 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 07:56:12.027951 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c51f791-34c2-4642-97ef-d6a575e0e653 admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:56:12.041484 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-2c51f791-34c2-4642-97ef-d6a575e0e653 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:56:12.067709 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb244014-5d1a-4670-a607-6bf3da6fb2d0 admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:56:12.155046 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4aae7d3-5cd4-456b-8d89-12d2ed98de5d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544bf6be4c24454a013ca110c43cef2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4735f453c0c24cc4a1c14e9ac84a0b46', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:56:12.155643 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4aae7d3-5cd4-456b-8d89-12d2ed98de5d service cinder] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:12.155924 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4aae7d3-5cd4-456b-8d89-12d2ed98de5d service cinder] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:12.156205 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4aae7d3-5cd4-456b-8d89-12d2ed98de5d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:12.159104 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-b4aae7d3-5cd4-456b-8d89-12d2ed98de5d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:56:12.169924 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c51f791-34c2-4642-97ef-d6a575e0e653 admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:56:12.181938 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8340e7-c919-445b-b2b1-22c58b2a8de6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:56:12.182756 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8340e7-c919-445b-b2b1-22c58b2a8de6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:12.182756 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8340e7-c919-445b-b2b1-22c58b2a8de6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:12.182957 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8340e7-c919-445b-b2b1-22c58b2a8de6 admin admin] PATH_INFO: `/v3/users/547addc23fbe4fd3a3f126a4f2309d92` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:12.184053 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8340e7-c919-445b-b2b1-22c58b2a8de6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=547addc23fbe4fd3a3f126a4f2309d92)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:56:12.186100 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8340e7-c919-445b-b2b1-22c58b2a8de6 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:56:12.251407 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4aae7d3-5cd4-456b-8d89-12d2ed98de5d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:56:12.254244 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4aae7d3-5cd4-456b-8d89-12d2ed98de5d service cinder] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:56:12.267382 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-8a8340e7-c919-445b-b2b1-22c58b2a8de6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '547addc23fbe4fd3a3f126a4f2309d92'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:56:12.270601 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1056/2118] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Sep 16 07:56:11 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 07:56:12.292346 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-8a8340e7-c919-445b-b2b1-22c58b2a8de6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '547addc23fbe4fd3a3f126a4f2309d92'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:56:12.293807 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-8a8340e7-c919-445b-b2b1-22c58b2a8de6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '547addc23fbe4fd3a3f126a4f2309d92'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:56:12.321059 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-8a8340e7-c919-445b-b2b1-22c58b2a8de6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '547addc23fbe4fd3a3f126a4f2309d92'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:56:12.330707 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-8a8340e7-c919-445b-b2b1-22c58b2a8de6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '547addc23fbe4fd3a3f126a4f2309d92'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:56:12.338636 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1063/2119] 10.222.0.57 () {58 vars in 1224 bytes} [Fri Sep 16 07:56:12 2022] DELETE /identity/v3/users/547addc23fbe4fd3a3f126a4f2309d92 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 07:56:12.441329 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4aae7d3-5cd4-456b-8d89-12d2ed98de5d service cinder] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:56:12.443101 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-b4aae7d3-5cd4-456b-8d89-12d2ed98de5d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:56:12.476389 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4aae7d3-5cd4-456b-8d89-12d2ed98de5d service cinder] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:56:12.597967 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:INSERT=1,keystone:DELETE=3,keystone:SELECT=96 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:56:12.616628 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b9c466-d386-4fe3-9ea3-0c860a933e83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:56:12.617359 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b9c466-d386-4fe3-9ea3-0c860a933e83 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:12.618044 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b9c466-d386-4fe3-9ea3-0c860a933e83 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:12.618360 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b9c466-d386-4fe3-9ea3-0c860a933e83 admin admin] PATH_INFO: `/v3/projects/046ac1a5f1734fd880b24e036a59df46` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:12.619801 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b9c466-d386-4fe3-9ea3-0c860a933e83 admin admin] RBAC: Authorizing `identity:delete_project(project_id=046ac1a5f1734fd880b24e036a59df46)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:56:12.623629 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b9c466-d386-4fe3-9ea3-0c860a933e83 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:56:12.690321 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-96b9c466-d386-4fe3-9ea3-0c860a933e83 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '046ac1a5f1734fd880b24e036a59df46', 'request_id': 'req-96b9c466-d386-4fe3-9ea3-0c860a933e83'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:56:12.704140 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-96b9c466-d386-4fe3-9ea3-0c860a933e83 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '046ac1a5f1734fd880b24e036a59df46', 'request_id': 'req-96b9c466-d386-4fe3-9ea3-0c860a933e83'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:56:12.721397 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-96b9c466-d386-4fe3-9ea3-0c860a933e83 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '046ac1a5f1734fd880b24e036a59df46', 'request_id': 'req-96b9c466-d386-4fe3-9ea3-0c860a933e83'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:56:12.740869 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8340e7-c919-445b-b2b1-22c58b2a8de6 admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:56:12.741643 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-96b9c466-d386-4fe3-9ea3-0c860a933e83 admin admin] The token cache is being invalidate because project 046ac1a5f1734fd880b24e036a59df46 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81430) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 07:56:12.741993 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-96b9c466-d386-4fe3-9ea3-0c860a933e83 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:56:12.742870 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-8a8340e7-c919-445b-b2b1-22c58b2a8de6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:56:12.743696 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-96b9c466-d386-4fe3-9ea3-0c860a933e83 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:56:12.746532 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1057/2120] 10.222.0.57 () {58 vars in 1233 bytes} [Fri Sep 16 07:56:12 2022] DELETE /identity/v3/projects/046ac1a5f1734fd880b24e036a59df46 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 07:56:12.752584 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef1c732-c676-4f11-8a7d-50c37a08c193 None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:12.752873 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef1c732-c676-4f11-8a7d-50c37a08c193 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:12.753329 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef1c732-c676-4f11-8a7d-50c37a08c193 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:12.775018 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8340e7-c919-445b-b2b1-22c58b2a8de6 admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:56:12.787391 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-9ef1c732-c676-4f11-8a7d-50c37a08c193 None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:56:12.790042 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-9ef1c732-c676-4f11-8a7d-50c37a08c193 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:56:12.863884 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdaa130-8f85-4539-939f-e99c13bc2efe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:56:12.864597 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdaa130-8f85-4539-939f-e99c13bc2efe admin admin] REQUEST_METHOD: `DELETE` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:12.864901 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdaa130-8f85-4539-939f-e99c13bc2efe admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:12.865180 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdaa130-8f85-4539-939f-e99c13bc2efe admin admin] PATH_INFO: `/v3/projects/2b4cc1dbfcbd46b9b56e20c24aef69e7` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:12.866450 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bdaa130-8f85-4539-939f-e99c13bc2efe admin admin] RBAC: Authorizing `identity:delete_project(project_id=2b4cc1dbfcbd46b9b56e20c24aef69e7)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:56:12.868793 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bdaa130-8f85-4539-939f-e99c13bc2efe admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:56:12.884787 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1058/2121] 10.222.0.57 () {58 vars in 958 bytes} [Fri Sep 16 07:56:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 07:56:12.888103 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28ad439-b17a-4b1e-b95c-80ecce77a5f9 None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:12.888399 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28ad439-b17a-4b1e-b95c-80ecce77a5f9 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:12.888668 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28ad439-b17a-4b1e-b95c-80ecce77a5f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:12.899597 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:56:12.912208 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-d28ad439-b17a-4b1e-b95c-80ecce77a5f9 None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:56:12.913438 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-d28ad439-b17a-4b1e-b95c-80ecce77a5f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:56:12.931399 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-4bdaa130-8f85-4539-939f-e99c13bc2efe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2b4cc1dbfcbd46b9b56e20c24aef69e7', 'request_id': 'req-4bdaa130-8f85-4539-939f-e99c13bc2efe'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:56:12.939570 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-4bdaa130-8f85-4539-939f-e99c13bc2efe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2b4cc1dbfcbd46b9b56e20c24aef69e7', 'request_id': 'req-4bdaa130-8f85-4539-939f-e99c13bc2efe'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:56:12.949268 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-4bdaa130-8f85-4539-939f-e99c13bc2efe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2b4cc1dbfcbd46b9b56e20c24aef69e7', 'request_id': 'req-4bdaa130-8f85-4539-939f-e99c13bc2efe'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:56:12.962928 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-4bdaa130-8f85-4539-939f-e99c13bc2efe admin admin] The token cache is being invalidate because project 2b4cc1dbfcbd46b9b56e20c24aef69e7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81431) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 07:56:12.963213 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-4bdaa130-8f85-4539-939f-e99c13bc2efe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:56:12.963863 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-4bdaa130-8f85-4539-939f-e99c13bc2efe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:56:12.968817 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1064/2122] 10.222.0.57 () {58 vars in 1233 bytes} [Fri Sep 16 07:56:12 2022] DELETE /identity/v3/projects/2b4cc1dbfcbd46b9b56e20c24aef69e7 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 07:56:12.970922 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a219585a-14a9-4d1d-ab4e-31cd99133e7b None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:12.971208 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a219585a-14a9-4d1d-ab4e-31cd99133e7b None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:12.971482 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a219585a-14a9-4d1d-ab4e-31cd99133e7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:12.981099 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1059/2123] 10.222.0.57 () {58 vars in 958 bytes} [Fri Sep 16 07:56:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 16 07:56:12.982449 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28ad439-b17a-4b1e-b95c-80ecce77a5f9 None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:56:12.993058 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28ad439-b17a-4b1e-b95c-80ecce77a5f9 None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:56:12.994012 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-a219585a-14a9-4d1d-ab4e-31cd99133e7b None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:56:12.995384 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-a219585a-14a9-4d1d-ab4e-31cd99133e7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:56:12.998624 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad4fa67-ac13-4d2e-8868-40ee16da9f7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:56:12.999319 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad4fa67-ac13-4d2e-8868-40ee16da9f7d admin admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:12.999604 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad4fa67-ac13-4d2e-8868-40ee16da9f7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:12.999876 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad4fa67-ac13-4d2e-8868-40ee16da9f7d admin admin] PATH_INFO: `/v3/domains` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:13.001178 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad4fa67-ac13-4d2e-8868-40ee16da9f7d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:56:13.001485 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad4fa67-ac13-4d2e-8868-40ee16da9f7d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:56:13.004947 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1065/2124] 10.222.0.57 () {58 vars in 958 bytes} [Fri Sep 16 07:56:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 07:56:13.011539 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad4fa67-ac13-4d2e-8868-40ee16da9f7d admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:56:13.012862 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8dc4e4-3bb2-4829-9844-4628470f5025 None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:13.013143 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8dc4e4-3bb2-4829-9844-4628470f5025 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:13.013399 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8dc4e4-3bb2-4829-9844-4628470f5025 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:13.022481 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1060/2125] 10.222.0.57 () {58 vars in 1153 bytes} [Fri Sep 16 07:56:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 07:56:13.023595 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad4fa67-ac13-4d2e-8868-40ee16da9f7d admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:56:13.033575 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad4fa67-ac13-4d2e-8868-40ee16da9f7d admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:56:13.037269 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-1d8dc4e4-3bb2-4829-9844-4628470f5025 None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:56:13.038297 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85158b99-c92a-4637-aab1-30c467ecb244 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:56:13.038550 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-1d8dc4e4-3bb2-4829-9844-4628470f5025 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:56:13.039401 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85158b99-c92a-4637-aab1-30c467ecb244 admin admin] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:13.039401 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85158b99-c92a-4637-aab1-30c467ecb244 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:13.039401 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85158b99-c92a-4637-aab1-30c467ecb244 admin admin] PATH_INFO: `/v3/projects` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:13.040037 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85158b99-c92a-4637-aab1-30c467ecb244 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:56:13.041976 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85158b99-c92a-4637-aab1-30c467ecb244 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:56:13.046830 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:56:13.050295 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1066/2126] 10.222.0.57 () {58 vars in 958 bytes} [Fri Sep 16 07:56:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 16 07:56:13.054526 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8dc4e4-3bb2-4829-9844-4628470f5025 None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:56:13.066642 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8dc4e4-3bb2-4829-9844-4628470f5025 None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:56:13.073511 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd16cfd-0165-4509-b604-d93317fba4a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:56:13.074351 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd16cfd-0165-4509-b604-d93317fba4a6 admin admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:13.074621 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd16cfd-0165-4509-b604-d93317fba4a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:13.074887 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd16cfd-0165-4509-b604-d93317fba4a6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:13.075529 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd16cfd-0165-4509-b604-d93317fba4a6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:56:13.075823 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd16cfd-0165-4509-b604-d93317fba4a6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:56:13.076086 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1061/2127] 10.222.0.57 () {60 vars in 1153 bytes} [Fri Sep 16 07:56:13 2022] POST /identity/v3/projects => generated 385 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 07:56:13.077853 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd16cfd-0165-4509-b604-d93317fba4a6 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:56:13.080651 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85158b99-c92a-4637-aab1-30c467ecb244 admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:56:13.096157 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1067/2128] 10.222.0.57 () {58 vars in 1153 bytes} [Fri Sep 16 07:56:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:56:13.100827 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd16cfd-0165-4509-b604-d93317fba4a6 admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:56:13.119343 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd16cfd-0165-4509-b604-d93317fba4a6 admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:56:13.162090 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85158b99-c92a-4637-aab1-30c467ecb244 admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:56:13.166239 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2e50d9-e0e5-4dba-a4e4-1ab400fb5b29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:56:13.166841 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2e50d9-e0e5-4dba-a4e4-1ab400fb5b29 admin admin] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:13.167155 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2e50d9-e0e5-4dba-a4e4-1ab400fb5b29 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:13.167435 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2e50d9-e0e5-4dba-a4e4-1ab400fb5b29 admin admin] PATH_INFO: `/v3/users` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:13.168065 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2e50d9-e0e5-4dba-a4e4-1ab400fb5b29 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:56:13.170019 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2e50d9-e0e5-4dba-a4e4-1ab400fb5b29 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:56:13.180495 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfafea1-12f0-44f8-a7aa-0d0a0aca8678 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:56:13.181482 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfafea1-12f0-44f8-a7aa-0d0a0aca8678 admin admin] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:13.181955 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfafea1-12f0-44f8-a7aa-0d0a0aca8678 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:13.182323 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfafea1-12f0-44f8-a7aa-0d0a0aca8678 admin admin] PATH_INFO: `/v3/projects` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:13.182994 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfafea1-12f0-44f8-a7aa-0d0a0aca8678 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:56:13.185225 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfafea1-12f0-44f8-a7aa-0d0a0aca8678 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:56:13.193129 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1062/2129] 10.222.0.57 () {60 vars in 1144 bytes} [Fri Sep 16 07:56:13 2022] POST /identity/v3/users => generated 293 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 07:56:13.197113 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2e50d9-e0e5-4dba-a4e4-1ab400fb5b29 admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:56:13.207768 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2e50d9-e0e5-4dba-a4e4-1ab400fb5b29 admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:56:13.214379 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821ab0b1-de97-42ea-9365-5b47220bca25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:56:13.217614 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1068/2130] 10.222.0.57 () {60 vars in 1153 bytes} [Fri Sep 16 07:56:13 2022] POST /identity/v3/projects => generated 385 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 16 07:56:13.217748 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821ab0b1-de97-42ea-9365-5b47220bca25 admin admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:13.217748 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821ab0b1-de97-42ea-9365-5b47220bca25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:13.217748 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821ab0b1-de97-42ea-9365-5b47220bca25 admin admin] PATH_INFO: `/v3/roles` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:13.217748 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821ab0b1-de97-42ea-9365-5b47220bca25 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:56:13.217748 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821ab0b1-de97-42ea-9365-5b47220bca25 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:56:13.218569 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfafea1-12f0-44f8-a7aa-0d0a0aca8678 admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:56:13.231805 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1063/2131] 10.222.0.57 () {58 vars in 1122 bytes} [Fri Sep 16 07:56:13 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 16 07:56:13.236173 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821ab0b1-de97-42ea-9365-5b47220bca25 admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:56:13.248080 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821ab0b1-de97-42ea-9365-5b47220bca25 admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:56:13.285610 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfafea1-12f0-44f8-a7aa-0d0a0aca8678 admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:56:13.291392 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b30e29-edbf-4744-92c8-45c2480273d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:56:13.292000 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b30e29-edbf-4744-92c8-45c2480273d7 admin admin] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:13.292282 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b30e29-edbf-4744-92c8-45c2480273d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:13.292557 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b30e29-edbf-4744-92c8-45c2480273d7 admin admin] PATH_INFO: `/v3/users` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:13.293187 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b30e29-edbf-4744-92c8-45c2480273d7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:56:13.295153 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b30e29-edbf-4744-92c8-45c2480273d7 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:56:13.314270 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:DELETE=7,keystone:SELECT=88,keystone:INSERT=5 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:56:13.323962 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1069/2132] 10.222.0.57 () {60 vars in 1144 bytes} [Fri Sep 16 07:56:13 2022] POST /identity/v3/users => generated 293 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 07:56:13.325248 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b30e29-edbf-4744-92c8-45c2480273d7 admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:56:13.326361 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33da7936-986c-485b-979d-eaea789d877f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:56:13.326891 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33da7936-986c-485b-979d-eaea789d877f admin admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:13.327177 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33da7936-986c-485b-979d-eaea789d877f admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:13.327448 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33da7936-986c-485b-979d-eaea789d877f admin admin] PATH_INFO: `/v3/roles` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:13.328365 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33da7936-986c-485b-979d-eaea789d877f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:56:13.330917 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33da7936-986c-485b-979d-eaea789d877f admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:56:13.336540 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b30e29-edbf-4744-92c8-45c2480273d7 admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:56:13.341505 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043d8c78-0d50-47a5-9343-3798d5e567b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:56:13.343243 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043d8c78-0d50-47a5-9343-3798d5e567b2 admin admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:13.343243 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043d8c78-0d50-47a5-9343-3798d5e567b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:13.343243 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043d8c78-0d50-47a5-9343-3798d5e567b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:13.343531 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043d8c78-0d50-47a5-9343-3798d5e567b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:56:13.345428 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043d8c78-0d50-47a5-9343-3798d5e567b2 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:56:13.347238 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1064/2133] 10.222.0.57 () {58 vars in 1122 bytes} [Fri Sep 16 07:56:13 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 07:56:13.351519 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33da7936-986c-485b-979d-eaea789d877f admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:56:13.358601 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1070/2134] 10.222.0.57 () {58 vars in 1122 bytes} [Fri Sep 16 07:56:13 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 07:56:13.360189 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043d8c78-0d50-47a5-9343-3798d5e567b2 admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:56:13.365011 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33da7936-986c-485b-979d-eaea789d877f admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:56:13.370208 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210b8243-c82f-4889-9771-bac3ad8f3e6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:56:13.371083 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043d8c78-0d50-47a5-9343-3798d5e567b2 admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:56:13.371192 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210b8243-c82f-4889-9771-bac3ad8f3e6b admin admin] REQUEST_METHOD: `PUT` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:13.371493 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210b8243-c82f-4889-9771-bac3ad8f3e6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:13.371882 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210b8243-c82f-4889-9771-bac3ad8f3e6b admin admin] PATH_INFO: `/v3/projects/cd05ad0616b54c3a9394485de7a9fe42/users/cde4d407713f47bcb07b2f8b98209d1c/roles/4818d38cf2564825b312e66c9eb24762` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:13.376094 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bf0f49-aa8b-431f-a0e4-11e9c6b4c2e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:56:13.376694 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bf0f49-aa8b-431f-a0e4-11e9c6b4c2e5 admin admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:13.376969 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bf0f49-aa8b-431f-a0e4-11e9c6b4c2e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:13.377237 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bf0f49-aa8b-431f-a0e4-11e9c6b4c2e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:13.377900 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94bf0f49-aa8b-431f-a0e4-11e9c6b4c2e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:56:13.379684 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94bf0f49-aa8b-431f-a0e4-11e9c6b4c2e5 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:56:13.388620 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210b8243-c82f-4889-9771-bac3ad8f3e6b admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd05ad0616b54c3a9394485de7a9fe42, user_id=cde4d407713f47bcb07b2f8b98209d1c, role_id=4818d38cf2564825b312e66c9eb24762)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:56:13.391229 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1071/2135] 10.222.0.57 () {58 vars in 1122 bytes} [Fri Sep 16 07:56:13 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 16 07:56:13.394914 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210b8243-c82f-4889-9771-bac3ad8f3e6b admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:56:13.395479 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bf0f49-aa8b-431f-a0e4-11e9c6b4c2e5 admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:56:13.411981 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1065/2136] 10.222.0.57 () {60 vars in 1483 bytes} [Fri Sep 16 07:56:13 2022] PUT /identity/v3/projects/cd05ad0616b54c3a9394485de7a9fe42/users/cde4d407713f47bcb07b2f8b98209d1c/roles/4818d38cf2564825b312e66c9eb24762 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 07:56:13.419192 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bf0f49-aa8b-431f-a0e4-11e9c6b4c2e5 admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:56:13.423502 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662a7d78-6a53-4e69-8f03-7aa577fc1013 None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:13.423799 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662a7d78-6a53-4e69-8f03-7aa577fc1013 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:13.424161 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662a7d78-6a53-4e69-8f03-7aa577fc1013 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:13.453168 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-662a7d78-6a53-4e69-8f03-7aa577fc1013 None None] MFA Rules not processed for user `cde4d407713f47bcb07b2f8b98209d1c`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:56:13.455197 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-662a7d78-6a53-4e69-8f03-7aa577fc1013 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:56:13.490121 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:56:13.498557 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b923552-ea5d-4f6f-8b64-9a7a5be6dd2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:56:13.499228 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b923552-ea5d-4f6f-8b64-9a7a5be6dd2c admin admin] REQUEST_METHOD: `PUT` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:13.499508 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b923552-ea5d-4f6f-8b64-9a7a5be6dd2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:13.499785 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b923552-ea5d-4f6f-8b64-9a7a5be6dd2c admin admin] PATH_INFO: `/v3/projects/3b71450e42dc4179b58d10d6ed1881cb/users/f2c1c64c17304af28de1204ea79c9064/roles/4818d38cf2564825b312e66c9eb24762` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:13.522381 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b923552-ea5d-4f6f-8b64-9a7a5be6dd2c admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b71450e42dc4179b58d10d6ed1881cb, user_id=f2c1c64c17304af28de1204ea79c9064, role_id=4818d38cf2564825b312e66c9eb24762)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:56:13.525099 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b923552-ea5d-4f6f-8b64-9a7a5be6dd2c admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:56:13.546832 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1072/2137] 10.222.0.57 () {60 vars in 1483 bytes} [Fri Sep 16 07:56:13 2022] PUT /identity/v3/projects/3b71450e42dc4179b58d10d6ed1881cb/users/f2c1c64c17304af28de1204ea79c9064/roles/4818d38cf2564825b312e66c9eb24762 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 16 07:56:13.558450 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8c81f6-c686-4f92-9d16-951b773fa4e7 None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:13.558732 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8c81f6-c686-4f92-9d16-951b773fa4e7 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:13.559002 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8c81f6-c686-4f92-9d16-951b773fa4e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:13.560628 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1066/2138] 10.222.0.57 () {58 vars in 958 bytes} [Fri Sep 16 07:56:13 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 07:56:13.565524 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662a7d78-6a53-4e69-8f03-7aa577fc1013 None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:56:13.577195 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662a7d78-6a53-4e69-8f03-7aa577fc1013 None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:56:13.602696 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-0f8c81f6-c686-4f92-9d16-951b773fa4e7 None None] MFA Rules not processed for user `f2c1c64c17304af28de1204ea79c9064`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:56:13.603937 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-0f8c81f6-c686-4f92-9d16-951b773fa4e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:56:13.682819 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec50c701-53a4-47f3-a8d6-28aaa179e9e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:56:13.683537 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec50c701-53a4-47f3-a8d6-28aaa179e9e4 admin admin] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:13.684100 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec50c701-53a4-47f3-a8d6-28aaa179e9e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:13.684446 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec50c701-53a4-47f3-a8d6-28aaa179e9e4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:13.685381 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec50c701-53a4-47f3-a8d6-28aaa179e9e4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:56:13.688996 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec50c701-53a4-47f3-a8d6-28aaa179e9e4 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:56:13.716199 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1073/2139] 10.222.0.57 () {58 vars in 958 bytes} [Fri Sep 16 07:56:13 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 16 07:56:13.721874 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8c81f6-c686-4f92-9d16-951b773fa4e7 None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:56:13.735006 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1067/2140] 10.222.0.57 () {60 vars in 1153 bytes} [Fri Sep 16 07:56:13 2022] POST /identity/v3/projects => generated 387 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 16 07:56:13.739143 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec50c701-53a4-47f3-a8d6-28aaa179e9e4 admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:56:13.739542 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8c81f6-c686-4f92-9d16-951b773fa4e7 None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:56:13.802805 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:56:13.819325 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c41872e-115f-42da-8135-fd771104ceee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:56:13.820342 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c41872e-115f-42da-8135-fd771104ceee admin admin] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:13.821010 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c41872e-115f-42da-8135-fd771104ceee admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:13.821666 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c41872e-115f-42da-8135-fd771104ceee admin admin] PATH_INFO: `/v3/projects` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:13.822284 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c41872e-115f-42da-8135-fd771104ceee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:56:13.824264 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c41872e-115f-42da-8135-fd771104ceee admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:56:13.825191 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec50c701-53a4-47f3-a8d6-28aaa179e9e4 admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:56:13.831382 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779e387b-b436-4a89-af57-6b01ff824462 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:56:13.832241 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779e387b-b436-4a89-af57-6b01ff824462 admin admin] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:13.832543 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779e387b-b436-4a89-af57-6b01ff824462 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:13.832827 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779e387b-b436-4a89-af57-6b01ff824462 admin admin] PATH_INFO: `/v3/users` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:13.833818 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779e387b-b436-4a89-af57-6b01ff824462 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:56:13.835850 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779e387b-b436-4a89-af57-6b01ff824462 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:56:13.859245 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1074/2141] 10.222.0.57 () {60 vars in 1153 bytes} [Fri Sep 16 07:56:13 2022] POST /identity/v3/projects => generated 385 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 07:56:13.864528 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c41872e-115f-42da-8135-fd771104ceee admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:56:13.867882 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1068/2142] 10.222.0.57 () {60 vars in 1144 bytes} [Fri Sep 16 07:56:13 2022] POST /identity/v3/users => generated 294 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 16 07:56:13.871415 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779e387b-b436-4a89-af57-6b01ff824462 admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:56:13.891374 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779e387b-b436-4a89-af57-6b01ff824462 admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:56:13.962048 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:56:13.987692 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c41872e-115f-42da-8135-fd771104ceee admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:56:13.990291 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60873f7a-af4a-4a2f-a203-9f6fad08d2f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:56:13.990940 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60873f7a-af4a-4a2f-a203-9f6fad08d2f1 admin admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:13.991296 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60873f7a-af4a-4a2f-a203-9f6fad08d2f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:13.991635 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60873f7a-af4a-4a2f-a203-9f6fad08d2f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:13.993304 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81e6d02-3897-469c-b28a-9a580bc61245 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:56:13.993656 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60873f7a-af4a-4a2f-a203-9f6fad08d2f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:56:13.994086 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81e6d02-3897-469c-b28a-9a580bc61245 admin admin] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:13.994441 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81e6d02-3897-469c-b28a-9a580bc61245 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:13.994866 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81e6d02-3897-469c-b28a-9a580bc61245 admin admin] PATH_INFO: `/v3/users` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:13.995667 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81e6d02-3897-469c-b28a-9a580bc61245 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:56:13.995961 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60873f7a-af4a-4a2f-a203-9f6fad08d2f1 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:56:13.997923 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81e6d02-3897-469c-b28a-9a580bc61245 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:56:14.011135 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1069/2143] 10.222.0.57 () {58 vars in 1122 bytes} [Fri Sep 16 07:56:13 2022] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 07:56:14.014974 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60873f7a-af4a-4a2f-a203-9f6fad08d2f1 admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:56:14.030231 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60873f7a-af4a-4a2f-a203-9f6fad08d2f1 admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:56:14.039027 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1075/2144] 10.222.0.57 () {60 vars in 1144 bytes} [Fri Sep 16 07:56:13 2022] POST /identity/v3/users => generated 293 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 07:56:14.042527 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad58d4c-b49f-4fcd-860c-6b203af69063 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:56:14.043120 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81e6d02-3897-469c-b28a-9a580bc61245 admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:56:14.043502 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad58d4c-b49f-4fcd-860c-6b203af69063 admin admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:14.043871 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad58d4c-b49f-4fcd-860c-6b203af69063 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:14.044822 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad58d4c-b49f-4fcd-860c-6b203af69063 admin admin] PATH_INFO: `/v3/roles` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:14.045667 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad58d4c-b49f-4fcd-860c-6b203af69063 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:56:14.048257 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad58d4c-b49f-4fcd-860c-6b203af69063 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:56:14.057661 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81e6d02-3897-469c-b28a-9a580bc61245 admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:56:14.063515 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a2a9ac-9cdf-420b-9582-4230f4317daa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:56:14.064136 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a2a9ac-9cdf-420b-9582-4230f4317daa admin admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:14.064420 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a2a9ac-9cdf-420b-9582-4230f4317daa admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:14.064700 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a2a9ac-9cdf-420b-9582-4230f4317daa admin admin] PATH_INFO: `/v3/roles` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:14.065694 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a2a9ac-9cdf-420b-9582-4230f4317daa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:56:14.067440 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a2a9ac-9cdf-420b-9582-4230f4317daa admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:56:14.081143 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1070/2145] 10.222.0.57 () {58 vars in 1122 bytes} [Fri Sep 16 07:56:14 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 07:56:14.082449 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1076/2146] 10.222.0.57 () {58 vars in 1122 bytes} [Fri Sep 16 07:56:14 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 07:56:14.087435 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a2a9ac-9cdf-420b-9582-4230f4317daa admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:56:14.088595 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad58d4c-b49f-4fcd-860c-6b203af69063 admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:56:14.100174 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a2a9ac-9cdf-420b-9582-4230f4317daa admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:56:14.101047 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad58d4c-b49f-4fcd-860c-6b203af69063 admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:56:14.119390 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19410c53-b46f-4831-abf4-27544e88b918 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:56:14.120017 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19410c53-b46f-4831-abf4-27544e88b918 admin admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:14.120298 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19410c53-b46f-4831-abf4-27544e88b918 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:14.120570 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19410c53-b46f-4831-abf4-27544e88b918 admin admin] PATH_INFO: `/v3/roles` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:14.121218 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19410c53-b46f-4831-abf4-27544e88b918 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:56:14.122846 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19410c53-b46f-4831-abf4-27544e88b918 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:56:14.125006 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30e4c1b-868c-40a1-b64a-1b45f7a56690 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:56:14.126362 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30e4c1b-868c-40a1-b64a-1b45f7a56690 admin admin] REQUEST_METHOD: `PUT` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:14.126638 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30e4c1b-868c-40a1-b64a-1b45f7a56690 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:14.126913 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30e4c1b-868c-40a1-b64a-1b45f7a56690 admin admin] PATH_INFO: `/v3/projects/d146cffa2edd46419cc2ed21057bec5f/users/640071e00a51420eb3015befa5e36bb1/roles/4818d38cf2564825b312e66c9eb24762` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:14.149425 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1077/2147] 10.222.0.57 () {58 vars in 1122 bytes} [Fri Sep 16 07:56:14 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 07:56:14.154905 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19410c53-b46f-4831-abf4-27544e88b918 admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:56:14.155993 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30e4c1b-868c-40a1-b64a-1b45f7a56690 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d146cffa2edd46419cc2ed21057bec5f, user_id=640071e00a51420eb3015befa5e36bb1, role_id=4818d38cf2564825b312e66c9eb24762)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:56:14.159467 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30e4c1b-868c-40a1-b64a-1b45f7a56690 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:56:14.187338 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19410c53-b46f-4831-abf4-27544e88b918 admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:56:14.189209 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1071/2148] 10.222.0.57 () {60 vars in 1483 bytes} [Fri Sep 16 07:56:14 2022] PUT /identity/v3/projects/d146cffa2edd46419cc2ed21057bec5f/users/640071e00a51420eb3015befa5e36bb1/roles/4818d38cf2564825b312e66c9eb24762 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 07:56:14.200233 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e242ba-dd48-43c3-a2dc-263ee71d4fcd None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:14.200407 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e242ba-dd48-43c3-a2dc-263ee71d4fcd None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:14.200650 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e242ba-dd48-43c3-a2dc-263ee71d4fcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:14.279084 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-66e242ba-dd48-43c3-a2dc-263ee71d4fcd None None] MFA Rules not processed for user `640071e00a51420eb3015befa5e36bb1`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:56:14.281228 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-66e242ba-dd48-43c3-a2dc-263ee71d4fcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:56:14.301326 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835e3b03-9dc7-49fd-bb8e-e3b792f0dfef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:56:14.303287 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835e3b03-9dc7-49fd-bb8e-e3b792f0dfef admin admin] REQUEST_METHOD: `PUT` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:14.304810 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835e3b03-9dc7-49fd-bb8e-e3b792f0dfef admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:14.305485 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835e3b03-9dc7-49fd-bb8e-e3b792f0dfef admin admin] PATH_INFO: `/v3/projects/6b736bf89eeb4f8b810891996c5b0a06/users/7ba21595ab7542f29817835accf895ca/roles/4818d38cf2564825b312e66c9eb24762` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:14.330920 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835e3b03-9dc7-49fd-bb8e-e3b792f0dfef admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b736bf89eeb4f8b810891996c5b0a06, user_id=7ba21595ab7542f29817835accf895ca, role_id=4818d38cf2564825b312e66c9eb24762)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:56:14.334606 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835e3b03-9dc7-49fd-bb8e-e3b792f0dfef admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:56:14.355457 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1078/2149] 10.222.0.57 () {60 vars in 1483 bytes} [Fri Sep 16 07:56:14 2022] PUT /identity/v3/projects/6b736bf89eeb4f8b810891996c5b0a06/users/7ba21595ab7542f29817835accf895ca/roles/4818d38cf2564825b312e66c9eb24762 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 07:56:14.370646 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b16b0c2-6608-47f6-b978-f0cbe11d16e6 None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:14.370989 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b16b0c2-6608-47f6-b978-f0cbe11d16e6 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:14.371197 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b16b0c2-6608-47f6-b978-f0cbe11d16e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:14.412166 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1072/2150] 10.222.0.57 () {58 vars in 958 bytes} [Fri Sep 16 07:56:14 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 07:56:14.416823 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e242ba-dd48-43c3-a2dc-263ee71d4fcd None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:56:14.424831 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-3b16b0c2-6608-47f6-b978-f0cbe11d16e6 None None] MFA Rules not processed for user `7ba21595ab7542f29817835accf895ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:56:14.426925 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-3b16b0c2-6608-47f6-b978-f0cbe11d16e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:56:14.440059 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e242ba-dd48-43c3-a2dc-263ee71d4fcd None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:56:14.451806 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:56:14.541337 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962b3bbf-d9ae-4aa2-8b17-b75271b8705d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:56:14.542009 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962b3bbf-d9ae-4aa2-8b17-b75271b8705d admin admin] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:14.542288 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962b3bbf-d9ae-4aa2-8b17-b75271b8705d admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:14.542832 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962b3bbf-d9ae-4aa2-8b17-b75271b8705d admin admin] PATH_INFO: `/v3/projects` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:14.543475 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962b3bbf-d9ae-4aa2-8b17-b75271b8705d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:56:14.545798 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962b3bbf-d9ae-4aa2-8b17-b75271b8705d admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:56:14.570554 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1079/2151] 10.222.0.57 () {58 vars in 958 bytes} [Fri Sep 16 07:56:14 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 16 07:56:14.575016 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b16b0c2-6608-47f6-b978-f0cbe11d16e6 None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:56:14.592148 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b16b0c2-6608-47f6-b978-f0cbe11d16e6 None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:56:14.605621 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1073/2152] 10.222.0.57 () {60 vars in 1153 bytes} [Fri Sep 16 07:56:14 2022] POST /identity/v3/projects => generated 387 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 07:56:14.607556 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962b3bbf-d9ae-4aa2-8b17-b75271b8705d admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:56:14.611955 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb9aea6-602d-4c5c-ae51-289deb3abe44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:56:14.612919 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb9aea6-602d-4c5c-ae51-289deb3abe44 admin admin] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:14.614093 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb9aea6-602d-4c5c-ae51-289deb3abe44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:14.614452 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb9aea6-602d-4c5c-ae51-289deb3abe44 admin admin] PATH_INFO: `/v3/projects` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:14.615102 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb9aea6-602d-4c5c-ae51-289deb3abe44 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:56:14.617029 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb9aea6-602d-4c5c-ae51-289deb3abe44 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:56:14.639247 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:56:14.673333 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1080/2153] 10.222.0.57 () {60 vars in 1153 bytes} [Fri Sep 16 07:56:14 2022] POST /identity/v3/projects => generated 385 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 07:56:14.678284 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb9aea6-602d-4c5c-ae51-289deb3abe44 admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:56:14.717532 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962b3bbf-d9ae-4aa2-8b17-b75271b8705d admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:56:14.821136 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb9aea6-602d-4c5c-ae51-289deb3abe44 admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:56:14.830873 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea4c48c-bf70-403f-a17a-74ad7cb3c8b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:56:14.832019 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea4c48c-bf70-403f-a17a-74ad7cb3c8b5 admin admin] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:14.832325 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea4c48c-bf70-403f-a17a-74ad7cb3c8b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:14.832781 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea4c48c-bf70-403f-a17a-74ad7cb3c8b5 admin admin] PATH_INFO: `/v3/users` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:14.833492 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea4c48c-bf70-403f-a17a-74ad7cb3c8b5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:56:14.839229 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea4c48c-bf70-403f-a17a-74ad7cb3c8b5 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:56:14.874582 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1081/2154] 10.222.0.57 () {60 vars in 1144 bytes} [Fri Sep 16 07:56:14 2022] POST /identity/v3/users => generated 299 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 07:56:14.875646 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea4c48c-bf70-403f-a17a-74ad7cb3c8b5 admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:56:14.881497 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c394acc-072a-44f1-a3b0-42b13e12daf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:56:14.885163 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c394acc-072a-44f1-a3b0-42b13e12daf5 admin admin] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:14.885424 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c394acc-072a-44f1-a3b0-42b13e12daf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:14.887518 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c394acc-072a-44f1-a3b0-42b13e12daf5 admin admin] PATH_INFO: `/v3/users` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:14.890143 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c394acc-072a-44f1-a3b0-42b13e12daf5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:56:14.891012 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea4c48c-bf70-403f-a17a-74ad7cb3c8b5 admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:56:14.897461 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbb841e-552f-4397-b64d-a572f98fb4ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:56:14.898416 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbb841e-552f-4397-b64d-a572f98fb4ff admin admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:14.898872 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbb841e-552f-4397-b64d-a572f98fb4ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:14.899364 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbb841e-552f-4397-b64d-a572f98fb4ff admin admin] PATH_INFO: `/v3/roles` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:14.900606 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbb841e-552f-4397-b64d-a572f98fb4ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:56:14.901013 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c394acc-072a-44f1-a3b0-42b13e12daf5 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:56:14.902774 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbb841e-552f-4397-b64d-a572f98fb4ff admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:56:14.916068 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1082/2155] 10.222.0.57 () {58 vars in 1122 bytes} [Fri Sep 16 07:56:14 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 07:56:14.921170 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbb841e-552f-4397-b64d-a572f98fb4ff admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:56:14.935036 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbb841e-552f-4397-b64d-a572f98fb4ff admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:56:14.938658 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1074/2156] 10.222.0.57 () {60 vars in 1144 bytes} [Fri Sep 16 07:56:14 2022] POST /identity/v3/users => generated 300 bytes in 332 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 07:56:14.940606 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd74c8eb-d89c-4ec7-a743-5fefe62d7a3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:56:14.941518 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd74c8eb-d89c-4ec7-a743-5fefe62d7a3f admin admin] REQUEST_METHOD: `PUT` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:14.941828 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd74c8eb-d89c-4ec7-a743-5fefe62d7a3f admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:14.942100 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd74c8eb-d89c-4ec7-a743-5fefe62d7a3f admin admin] PATH_INFO: `/v3/projects/ce9822ca1e20424f83b2b00811134383/users/1a76bd08cb3a4303b600dd6d508fe6fd/roles/567db03c91854ad9af1e9a87ec1bd275` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:14.948415 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c394acc-072a-44f1-a3b0-42b13e12daf5 admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:56:14.960568 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd74c8eb-d89c-4ec7-a743-5fefe62d7a3f admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce9822ca1e20424f83b2b00811134383, user_id=1a76bd08cb3a4303b600dd6d508fe6fd, role_id=567db03c91854ad9af1e9a87ec1bd275)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:56:14.964043 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd74c8eb-d89c-4ec7-a743-5fefe62d7a3f admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:56:14.970303 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c394acc-072a-44f1-a3b0-42b13e12daf5 admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:56:14.979141 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43822f7d-60a2-45e1-9125-453d8e0769cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:56:14.980284 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43822f7d-60a2-45e1-9125-453d8e0769cd admin admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:14.980828 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43822f7d-60a2-45e1-9125-453d8e0769cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:14.981899 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43822f7d-60a2-45e1-9125-453d8e0769cd admin admin] PATH_INFO: `/v3/roles` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:14.982804 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43822f7d-60a2-45e1-9125-453d8e0769cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:56:14.986176 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43822f7d-60a2-45e1-9125-453d8e0769cd admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:56:14.995147 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1083/2157] 10.222.0.57 () {60 vars in 1483 bytes} [Fri Sep 16 07:56:14 2022] PUT /identity/v3/projects/ce9822ca1e20424f83b2b00811134383/users/1a76bd08cb3a4303b600dd6d508fe6fd/roles/567db03c91854ad9af1e9a87ec1bd275 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 07:56:14.996195 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd74c8eb-d89c-4ec7-a743-5fefe62d7a3f admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:56:15.012901 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-cd74c8eb-d89c-4ec7-a743-5fefe62d7a3f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:56:15.015443 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1075/2158] 10.222.0.57 () {58 vars in 1122 bytes} [Fri Sep 16 07:56:14 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 16 07:56:15.016965 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43822f7d-60a2-45e1-9125-453d8e0769cd admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:56:15.043748 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43822f7d-60a2-45e1-9125-453d8e0769cd admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:56:15.159005 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:56:15.182135 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd74c8eb-d89c-4ec7-a743-5fefe62d7a3f admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:56:15.187191 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed761d09-d34b-4fb0-b6b9-61d2277f9023 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:56:15.188426 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed761d09-d34b-4fb0-b6b9-61d2277f9023 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:15.188969 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed761d09-d34b-4fb0-b6b9-61d2277f9023 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:15.189247 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed761d09-d34b-4fb0-b6b9-61d2277f9023 admin admin] PATH_INFO: `/v3/users/a056a6f148fd4443ad3831073183b228` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:15.191030 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed761d09-d34b-4fb0-b6b9-61d2277f9023 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a056a6f148fd4443ad3831073183b228)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:56:15.193467 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed761d09-d34b-4fb0-b6b9-61d2277f9023 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:56:15.194919 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990757bf-db58-4b43-a24d-83420af5a615 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:56:15.195737 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990757bf-db58-4b43-a24d-83420af5a615 admin admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:15.196676 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990757bf-db58-4b43-a24d-83420af5a615 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:15.196676 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990757bf-db58-4b43-a24d-83420af5a615 admin admin] PATH_INFO: `/v3/roles` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:15.196973 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990757bf-db58-4b43-a24d-83420af5a615 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:56:15.198925 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990757bf-db58-4b43-a24d-83420af5a615 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:56:15.217277 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1076/2159] 10.222.0.57 () {58 vars in 1122 bytes} [Fri Sep 16 07:56:15 2022] GET /identity/v3/roles => generated 1420 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 07:56:15.217277 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990757bf-db58-4b43-a24d-83420af5a615 admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:56:15.227746 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990757bf-db58-4b43-a24d-83420af5a615 admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:56:15.233305 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75806506-b3d0-4fd0-b62b-d82f57c428f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:56:15.234165 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75806506-b3d0-4fd0-b62b-d82f57c428f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:15.235004 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75806506-b3d0-4fd0-b62b-d82f57c428f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:15.235318 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75806506-b3d0-4fd0-b62b-d82f57c428f7 admin admin] PATH_INFO: `/v3/projects/363bf96a91894a5f8cb4a70c0b064a10/users/8ceec9b6ae744e07ab5fd21db24bce71/roles/567db03c91854ad9af1e9a87ec1bd275` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:15.255126 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75806506-b3d0-4fd0-b62b-d82f57c428f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=363bf96a91894a5f8cb4a70c0b064a10, user_id=8ceec9b6ae744e07ab5fd21db24bce71, role_id=567db03c91854ad9af1e9a87ec1bd275)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:56:15.257836 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75806506-b3d0-4fd0-b62b-d82f57c428f7 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:56:15.264565 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-ed761d09-d34b-4fb0-b6b9-61d2277f9023 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a056a6f148fd4443ad3831073183b228'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:56:15.276098 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1077/2160] 10.222.0.57 () {60 vars in 1483 bytes} [Fri Sep 16 07:56:15 2022] PUT /identity/v3/projects/363bf96a91894a5f8cb4a70c0b064a10/users/8ceec9b6ae744e07ab5fd21db24bce71/roles/567db03c91854ad9af1e9a87ec1bd275 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 07:56:15.277245 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75806506-b3d0-4fd0-b62b-d82f57c428f7 admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:56:15.280072 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-ed761d09-d34b-4fb0-b6b9-61d2277f9023 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a056a6f148fd4443ad3831073183b228'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:56:15.281002 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-ed761d09-d34b-4fb0-b6b9-61d2277f9023 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a056a6f148fd4443ad3831073183b228'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:56:15.291555 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-ed761d09-d34b-4fb0-b6b9-61d2277f9023 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a056a6f148fd4443ad3831073183b228'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:56:15.294964 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:56:15.301286 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-ed761d09-d34b-4fb0-b6b9-61d2277f9023 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a056a6f148fd4443ad3831073183b228'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:56:15.311093 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1084/2161] 10.222.0.57 () {58 vars in 1224 bytes} [Fri Sep 16 07:56:14 2022] DELETE /identity/v3/users/a056a6f148fd4443ad3831073183b228 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 07:56:15.311093 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed761d09-d34b-4fb0-b6b9-61d2277f9023 admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:56:15.311093 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-ed761d09-d34b-4fb0-b6b9-61d2277f9023 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:56:15.356965 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75806506-b3d0-4fd0-b62b-d82f57c428f7 admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:56:15.388526 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed761d09-d34b-4fb0-b6b9-61d2277f9023 admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:56:15.396366 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ef4e42-3010-47cb-bfcc-c53787824859 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:56:15.397238 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ef4e42-3010-47cb-bfcc-c53787824859 admin admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:15.397532 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ef4e42-3010-47cb-bfcc-c53787824859 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:15.397863 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ef4e42-3010-47cb-bfcc-c53787824859 admin admin] PATH_INFO: `/v3/roles` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:15.398535 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ef4e42-3010-47cb-bfcc-c53787824859 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:56:15.400670 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ef4e42-3010-47cb-bfcc-c53787824859 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:56:15.418525 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1085/2162] 10.222.0.57 () {58 vars in 1122 bytes} [Fri Sep 16 07:56:15 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 07:56:15.418525 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94354b59-3b16-4537-a8bc-a0bf3532069d None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:15.418525 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94354b59-3b16-4537-a8bc-a0bf3532069d None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:15.418525 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94354b59-3b16-4537-a8bc-a0bf3532069d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:15.424616 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a89b0ab-a640-4ad5-a709-cc4fc60c6a54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:56:15.425431 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a89b0ab-a640-4ad5-a709-cc4fc60c6a54 admin admin] REQUEST_METHOD: `PUT` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:15.425845 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a89b0ab-a640-4ad5-a709-cc4fc60c6a54 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:15.426248 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a89b0ab-a640-4ad5-a709-cc4fc60c6a54 admin admin] PATH_INFO: `/v3/projects/ce9822ca1e20424f83b2b00811134383/users/1a76bd08cb3a4303b600dd6d508fe6fd/roles/567db03c91854ad9af1e9a87ec1bd275` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:15.428425 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a89b0ab-a640-4ad5-a709-cc4fc60c6a54 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce9822ca1e20424f83b2b00811134383, user_id=1a76bd08cb3a4303b600dd6d508fe6fd, role_id=567db03c91854ad9af1e9a87ec1bd275)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:56:15.431572 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a89b0ab-a640-4ad5-a709-cc4fc60c6a54 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:56:15.441682 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-94354b59-3b16-4537-a8bc-a0bf3532069d None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:56:15.443679 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-94354b59-3b16-4537-a8bc-a0bf3532069d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:56:15.444335 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1078/2163] 10.222.0.57 () {60 vars in 1483 bytes} [Fri Sep 16 07:56:15 2022] PUT /identity/v3/projects/ce9822ca1e20424f83b2b00811134383/users/1a76bd08cb3a4303b600dd6d508fe6fd/roles/567db03c91854ad9af1e9a87ec1bd275 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 07:56:15.445152 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a89b0ab-a640-4ad5-a709-cc4fc60c6a54 admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:56:15.523980 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a89b0ab-a640-4ad5-a709-cc4fc60c6a54 admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:56:15.528835 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec87de47-ad4d-4cf2-bab6-fa6d7416dede admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:56:15.529540 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec87de47-ad4d-4cf2-bab6-fa6d7416dede admin admin] REQUEST_METHOD: `PUT` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:15.529851 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec87de47-ad4d-4cf2-bab6-fa6d7416dede admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:15.530130 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec87de47-ad4d-4cf2-bab6-fa6d7416dede admin admin] PATH_INFO: `/v3/projects/363bf96a91894a5f8cb4a70c0b064a10/users/8ceec9b6ae744e07ab5fd21db24bce71/roles/567db03c91854ad9af1e9a87ec1bd275` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:15.532203 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec87de47-ad4d-4cf2-bab6-fa6d7416dede admin admin] RBAC: Authorizing `identity:create_grant(project_id=363bf96a91894a5f8cb4a70c0b064a10, user_id=8ceec9b6ae744e07ab5fd21db24bce71, role_id=567db03c91854ad9af1e9a87ec1bd275)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:56:15.533156 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1086/2164] 10.222.0.57 () {58 vars in 958 bytes} [Fri Sep 16 07:56:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 07:56:15.535412 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec87de47-ad4d-4cf2-bab6-fa6d7416dede admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:56:15.537661 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc776f3b-0e1b-47fd-9801-606b7952eb68 None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:15.537982 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc776f3b-0e1b-47fd-9801-606b7952eb68 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:15.538336 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc776f3b-0e1b-47fd-9801-606b7952eb68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:15.547886 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1079/2165] 10.222.0.57 () {60 vars in 1483 bytes} [Fri Sep 16 07:56:15 2022] PUT /identity/v3/projects/363bf96a91894a5f8cb4a70c0b064a10/users/8ceec9b6ae744e07ab5fd21db24bce71/roles/567db03c91854ad9af1e9a87ec1bd275 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 07:56:15.548476 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:56:15.548582 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec87de47-ad4d-4cf2-bab6-fa6d7416dede admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:56:15.558555 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-ec87de47-ad4d-4cf2-bab6-fa6d7416dede admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:56:15.580802 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-cc776f3b-0e1b-47fd-9801-606b7952eb68 None None] MFA Rules not processed for user `1a76bd08cb3a4303b600dd6d508fe6fd`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:56:15.582765 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-cc776f3b-0e1b-47fd-9801-606b7952eb68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:56:15.643130 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:56:15.647281 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec87de47-ad4d-4cf2-bab6-fa6d7416dede admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:56:15.652032 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ab725b-fdc9-4c4c-8fb4-6d7f98da524c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1062e457207a41e4ba4f0a0c4bf36f1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4735f453c0c24cc4a1c14e9ac84a0b46', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:56:15.653815 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ab725b-fdc9-4c4c-8fb4-6d7f98da524c service neutron] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:15.655043 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ab725b-fdc9-4c4c-8fb4-6d7f98da524c service neutron] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:15.655413 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ab725b-fdc9-4c4c-8fb4-6d7f98da524c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:15.664581 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1087/2166] 10.222.0.57 () {58 vars in 958 bytes} [Fri Sep 16 07:56:15 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 07:56:15.665984 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212f81e0-21fd-4d3a-8038-c609b3509f05 None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:15.667337 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212f81e0-21fd-4d3a-8038-c609b3509f05 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:15.667625 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212f81e0-21fd-4d3a-8038-c609b3509f05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:15.708535 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-212f81e0-21fd-4d3a-8038-c609b3509f05 None None] MFA Rules not processed for user `8ceec9b6ae744e07ab5fd21db24bce71`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:56:15.709916 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-212f81e0-21fd-4d3a-8038-c609b3509f05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:56:15.762597 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ab725b-fdc9-4c4c-8fb4-6d7f98da524c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:56:15.764070 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ab725b-fdc9-4c4c-8fb4-6d7f98da524c service neutron] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:56:15.789656 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1080/2167] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Sep 16 07:56:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 07:56:15.790537 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ab725b-fdc9-4c4c-8fb4-6d7f98da524c service neutron] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:56:15.791873 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-41ab725b-fdc9-4c4c-8fb4-6d7f98da524c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:56:15.796023 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1088/2168] 10.222.0.57 () {58 vars in 958 bytes} [Fri Sep 16 07:56:15 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 07:56:15.807876 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212f81e0-21fd-4d3a-8038-c609b3509f05 None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:56:15.808844 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-212f81e0-21fd-4d3a-8038-c609b3509f05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:56:15.869461 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ab725b-fdc9-4c4c-8fb4-6d7f98da524c service neutron] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:56:15.873891 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8cb7a2-6bca-469f-8f65-c091d88a99db service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544bf6be4c24454a013ca110c43cef2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4735f453c0c24cc4a1c14e9ac84a0b46', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:56:15.874508 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8cb7a2-6bca-469f-8f65-c091d88a99db service cinder] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:15.874936 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8cb7a2-6bca-469f-8f65-c091d88a99db service cinder] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:15.875888 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8cb7a2-6bca-469f-8f65-c091d88a99db service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:15.878028 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-da8cb7a2-6bca-469f-8f65-c091d88a99db service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:56:15.882268 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212f81e0-21fd-4d3a-8038-c609b3509f05 None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:56:15.886091 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd765838-a5a3-4e72-8272-a6991ce9ed17 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544bf6be4c24454a013ca110c43cef2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4735f453c0c24cc4a1c14e9ac84a0b46', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:56:15.886696 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd765838-a5a3-4e72-8272-a6991ce9ed17 service cinder] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:15.887110 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd765838-a5a3-4e72-8272-a6991ce9ed17 service cinder] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:15.887392 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd765838-a5a3-4e72-8272-a6991ce9ed17 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:15.898882 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd765838-a5a3-4e72-8272-a6991ce9ed17 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:56:15.900327 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd765838-a5a3-4e72-8272-a6991ce9ed17 service cinder] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:56:15.918246 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1089/2169] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Sep 16 07:56:15 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 07:56:15.944471 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8cb7a2-6bca-469f-8f65-c091d88a99db service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:56:15.945979 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8cb7a2-6bca-469f-8f65-c091d88a99db service cinder] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:56:15.957991 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1081/2170] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Sep 16 07:56:15 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 07:56:16.264228 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd765838-a5a3-4e72-8272-a6991ce9ed17 service cinder] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:56:16.265699 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-fd765838-a5a3-4e72-8272-a6991ce9ed17 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:56:16.282549 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8cb7a2-6bca-469f-8f65-c091d88a99db service cinder] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:56:16.283860 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-da8cb7a2-6bca-469f-8f65-c091d88a99db service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:56:16.292252 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd765838-a5a3-4e72-8272-a6991ce9ed17 service cinder] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:56:16.303689 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bdc4b7-fa37-482d-a828-14b3feea3874 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:56:16.304447 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bdc4b7-fa37-482d-a828-14b3feea3874 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:16.304829 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bdc4b7-fa37-482d-a828-14b3feea3874 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:16.305199 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bdc4b7-fa37-482d-a828-14b3feea3874 admin admin] PATH_INFO: `/v3/users/a5f55e403a5543d4aae0b463ac8bad58` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:16.306673 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76bdc4b7-fa37-482d-a828-14b3feea3874 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a5f55e403a5543d4aae0b463ac8bad58)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:56:16.314927 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8cb7a2-6bca-469f-8f65-c091d88a99db service cinder] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:56:16.316633 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76bdc4b7-fa37-482d-a828-14b3feea3874 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:56:16.336586 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df4085b-31db-4de6-b84d-bd5af8aee6ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:56:16.337123 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df4085b-31db-4de6-b84d-bd5af8aee6ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:16.337397 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df4085b-31db-4de6-b84d-bd5af8aee6ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:16.337666 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df4085b-31db-4de6-b84d-bd5af8aee6ed admin admin] PATH_INFO: `/v3/projects/3af4f638c15c4382b114ba9f759178f5` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:16.339061 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df4085b-31db-4de6-b84d-bd5af8aee6ed admin admin] RBAC: Authorizing `identity:delete_project(project_id=3af4f638c15c4382b114ba9f759178f5)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:56:16.340604 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:56:16.340957 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df4085b-31db-4de6-b84d-bd5af8aee6ed admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:56:16.450139 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-76bdc4b7-fa37-482d-a828-14b3feea3874 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a5f55e403a5543d4aae0b463ac8bad58'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:56:16.461747 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:56:16.467368 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-3df4085b-31db-4de6-b84d-bd5af8aee6ed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3af4f638c15c4382b114ba9f759178f5', 'request_id': 'req-3df4085b-31db-4de6-b84d-bd5af8aee6ed'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:56:16.487989 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-3df4085b-31db-4de6-b84d-bd5af8aee6ed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3af4f638c15c4382b114ba9f759178f5', 'request_id': 'req-3df4085b-31db-4de6-b84d-bd5af8aee6ed'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:56:16.497341 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-76bdc4b7-fa37-482d-a828-14b3feea3874 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a5f55e403a5543d4aae0b463ac8bad58'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:56:16.500021 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-76bdc4b7-fa37-482d-a828-14b3feea3874 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a5f55e403a5543d4aae0b463ac8bad58'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:56:16.500896 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-3df4085b-31db-4de6-b84d-bd5af8aee6ed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3af4f638c15c4382b114ba9f759178f5', 'request_id': 'req-3df4085b-31db-4de6-b84d-bd5af8aee6ed'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:56:16.520845 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-76bdc4b7-fa37-482d-a828-14b3feea3874 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a5f55e403a5543d4aae0b463ac8bad58'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:56:16.523967 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-3df4085b-31db-4de6-b84d-bd5af8aee6ed admin admin] The token cache is being invalidate because project 3af4f638c15c4382b114ba9f759178f5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81430) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 07:56:16.524267 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-3df4085b-31db-4de6-b84d-bd5af8aee6ed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:56:16.525469 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-3df4085b-31db-4de6-b84d-bd5af8aee6ed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:56:16.526631 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1082/2171] 10.222.0.57 () {58 vars in 1233 bytes} [Fri Sep 16 07:56:16 2022] DELETE /identity/v3/projects/3af4f638c15c4382b114ba9f759178f5 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 16 07:56:16.531719 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee796e4-005c-4534-9b68-b2a6212bf457 None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:16.532781 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee796e4-005c-4534-9b68-b2a6212bf457 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:16.532781 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee796e4-005c-4534-9b68-b2a6212bf457 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:16.557791 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-76bdc4b7-fa37-482d-a828-14b3feea3874 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a5f55e403a5543d4aae0b463ac8bad58'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:56:16.589066 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1090/2172] 10.222.0.57 () {58 vars in 1224 bytes} [Fri Sep 16 07:56:16 2022] DELETE /identity/v3/users/a5f55e403a5543d4aae0b463ac8bad58 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 07:56:16.595355 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e600c873-8bc8-49b6-99a9-e9a5ba7ec64d None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:16.596541 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e600c873-8bc8-49b6-99a9-e9a5ba7ec64d None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:16.596819 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e600c873-8bc8-49b6-99a9-e9a5ba7ec64d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:16.604782 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-8ee796e4-005c-4534-9b68-b2a6212bf457 None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:56:16.610967 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-8ee796e4-005c-4534-9b68-b2a6212bf457 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:56:16.685394 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-e600c873-8bc8-49b6-99a9-e9a5ba7ec64d None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:56:16.685967 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-e600c873-8bc8-49b6-99a9-e9a5ba7ec64d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:56:16.834491 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1083/2173] 10.222.0.57 () {58 vars in 958 bytes} [Fri Sep 16 07:56:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 302 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 16 07:56:16.845400 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1993ae-7a72-4caf-88d7-73576ba5efd1 None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:16.848552 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1993ae-7a72-4caf-88d7-73576ba5efd1 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:16.848892 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1993ae-7a72-4caf-88d7-73576ba5efd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:16.883464 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1091/2174] 10.222.0.57 () {58 vars in 958 bytes} [Fri Sep 16 07:56:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 286 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 07:56:16.895924 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e600c873-8bc8-49b6-99a9-e9a5ba7ec64d None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:56:16.897990 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-0e1993ae-7a72-4caf-88d7-73576ba5efd1 None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:56:16.899735 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-0e1993ae-7a72-4caf-88d7-73576ba5efd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:56:16.900660 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-e600c873-8bc8-49b6-99a9-e9a5ba7ec64d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:56:16.932536 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1084/2175] 10.222.0.57 () {58 vars in 958 bytes} [Fri Sep 16 07:56:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 07:56:16.933688 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1993ae-7a72-4caf-88d7-73576ba5efd1 None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:56:16.935696 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-0e1993ae-7a72-4caf-88d7-73576ba5efd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:56:17.007799 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e600c873-8bc8-49b6-99a9-e9a5ba7ec64d None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:56:17.013098 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e094a997-7a2a-4150-b89e-26860d3567ef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1062e457207a41e4ba4f0a0c4bf36f1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4735f453c0c24cc4a1c14e9ac84a0b46', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:56:17.016339 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e094a997-7a2a-4150-b89e-26860d3567ef service neutron] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:17.016877 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e094a997-7a2a-4150-b89e-26860d3567ef service neutron] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:17.017610 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e094a997-7a2a-4150-b89e-26860d3567ef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:17.035307 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1993ae-7a72-4caf-88d7-73576ba5efd1 None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:56:17.037896 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e094a997-7a2a-4150-b89e-26860d3567ef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:56:17.040132 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e094a997-7a2a-4150-b89e-26860d3567ef service neutron] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:56:17.045751 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7eefd01-6f5f-4f7e-bf5f-ca94c5f0e51b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544bf6be4c24454a013ca110c43cef2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4735f453c0c24cc4a1c14e9ac84a0b46', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:56:17.046545 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7eefd01-6f5f-4f7e-bf5f-ca94c5f0e51b service cinder] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:17.047527 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7eefd01-6f5f-4f7e-bf5f-ca94c5f0e51b service cinder] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:17.047905 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7eefd01-6f5f-4f7e-bf5f-ca94c5f0e51b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:17.050269 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-c7eefd01-6f5f-4f7e-bf5f-ca94c5f0e51b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:56:17.054583 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1092/2176] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Sep 16 07:56:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 07:56:17.055557 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e094a997-7a2a-4150-b89e-26860d3567ef service neutron] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:56:17.071164 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e094a997-7a2a-4150-b89e-26860d3567ef service neutron] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:56:17.078657 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749d3957-f709-425d-9631-277e1dc7ca7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:56:17.079069 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749d3957-f709-425d-9631-277e1dc7ca7f admin admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:17.079512 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749d3957-f709-425d-9631-277e1dc7ca7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:17.083502 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749d3957-f709-425d-9631-277e1dc7ca7f admin admin] PATH_INFO: `/v3/domains` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:17.083502 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749d3957-f709-425d-9631-277e1dc7ca7f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:56:17.083502 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749d3957-f709-425d-9631-277e1dc7ca7f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:56:17.084282 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749d3957-f709-425d-9631-277e1dc7ca7f admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:56:17.108177 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1093/2177] 10.222.0.57 () {58 vars in 1153 bytes} [Fri Sep 16 07:56:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:56:17.113319 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749d3957-f709-425d-9631-277e1dc7ca7f admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:56:17.124653 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749d3957-f709-425d-9631-277e1dc7ca7f admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:56:17.130826 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342a808a-2c0d-40b6-ae6c-deb156da2d70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:56:17.131640 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342a808a-2c0d-40b6-ae6c-deb156da2d70 admin admin] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:17.132055 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342a808a-2c0d-40b6-ae6c-deb156da2d70 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:17.132436 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342a808a-2c0d-40b6-ae6c-deb156da2d70 admin admin] PATH_INFO: `/v3/projects` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:17.133145 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342a808a-2c0d-40b6-ae6c-deb156da2d70 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:56:17.135213 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342a808a-2c0d-40b6-ae6c-deb156da2d70 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:56:17.158420 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:DELETE=10,keystone:SELECT=88,keystone:INSERT=2 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:56:17.170765 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7eefd01-6f5f-4f7e-bf5f-ca94c5f0e51b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:56:17.172946 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7eefd01-6f5f-4f7e-bf5f-ca94c5f0e51b service cinder] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:56:17.184416 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1085/2178] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Sep 16 07:56:16 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 252 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 16 07:56:17.188601 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1094/2179] 10.222.0.57 () {60 vars in 1153 bytes} [Fri Sep 16 07:56:17 2022] POST /identity/v3/projects => generated 377 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 16 07:56:17.190186 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7eefd01-6f5f-4f7e-bf5f-ca94c5f0e51b service cinder] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:56:17.204616 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7eefd01-6f5f-4f7e-bf5f-ca94c5f0e51b service cinder] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:56:17.230762 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:56:17.289255 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e910a5-ccf7-48c9-82e2-e4f351aa6e19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:56:17.290182 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e910a5-ccf7-48c9-82e2-e4f351aa6e19 admin admin] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:17.290563 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e910a5-ccf7-48c9-82e2-e4f351aa6e19 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:17.291046 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e910a5-ccf7-48c9-82e2-e4f351aa6e19 admin admin] PATH_INFO: `/v3/users` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:17.292236 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e910a5-ccf7-48c9-82e2-e4f351aa6e19 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:56:17.295554 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e910a5-ccf7-48c9-82e2-e4f351aa6e19 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:56:17.323553 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1086/2180] 10.222.0.57 () {60 vars in 1144 bytes} [Fri Sep 16 07:56:17 2022] POST /identity/v3/users => generated 289 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 16 07:56:17.327686 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342a808a-2c0d-40b6-ae6c-deb156da2d70 admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:56:17.340977 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342a808a-2c0d-40b6-ae6c-deb156da2d70 admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:56:17.346534 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8221cd43-785c-4654-9b29-88169ac3ae34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:56:17.347175 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8221cd43-785c-4654-9b29-88169ac3ae34 admin admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:17.347523 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8221cd43-785c-4654-9b29-88169ac3ae34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:17.347837 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8221cd43-785c-4654-9b29-88169ac3ae34 admin admin] PATH_INFO: `/v3/roles` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:17.348463 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8221cd43-785c-4654-9b29-88169ac3ae34 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:56:17.350379 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8221cd43-785c-4654-9b29-88169ac3ae34 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:56:17.363066 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1095/2181] 10.222.0.57 () {58 vars in 1122 bytes} [Fri Sep 16 07:56:17 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 07:56:17.367347 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e910a5-ccf7-48c9-82e2-e4f351aa6e19 admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:56:17.379995 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e910a5-ccf7-48c9-82e2-e4f351aa6e19 admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:56:17.395387 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c379bcf-c86a-4e28-a029-9087025045ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:56:17.396014 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c379bcf-c86a-4e28-a029-9087025045ce admin admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:17.396299 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c379bcf-c86a-4e28-a029-9087025045ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:17.396689 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c379bcf-c86a-4e28-a029-9087025045ce admin admin] PATH_INFO: `/v3/roles` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:17.397357 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c379bcf-c86a-4e28-a029-9087025045ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:56:17.398990 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c379bcf-c86a-4e28-a029-9087025045ce admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:56:17.417684 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1087/2182] 10.222.0.57 () {58 vars in 1122 bytes} [Fri Sep 16 07:56:17 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 07:56:17.422389 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8221cd43-785c-4654-9b29-88169ac3ae34 admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:56:17.437529 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8221cd43-785c-4654-9b29-88169ac3ae34 admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:56:17.443801 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a814e6d-36e2-4205-8c9b-f8379d1dc615 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:56:17.444421 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a814e6d-36e2-4205-8c9b-f8379d1dc615 admin admin] REQUEST_METHOD: `PUT` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:17.444703 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a814e6d-36e2-4205-8c9b-f8379d1dc615 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:17.444976 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a814e6d-36e2-4205-8c9b-f8379d1dc615 admin admin] PATH_INFO: `/v3/projects/56fa718ff465414a84dc4d1b23e9e916/users/cc19f9a905b8499cb0c079ee9b3b1083/roles/4818d38cf2564825b312e66c9eb24762` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:17.471262 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a814e6d-36e2-4205-8c9b-f8379d1dc615 admin admin] RBAC: Authorizing `identity:create_grant(project_id=56fa718ff465414a84dc4d1b23e9e916, user_id=cc19f9a905b8499cb0c079ee9b3b1083, role_id=4818d38cf2564825b312e66c9eb24762)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:56:17.474592 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a814e6d-36e2-4205-8c9b-f8379d1dc615 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:56:17.500866 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1096/2183] 10.222.0.57 () {60 vars in 1483 bytes} [Fri Sep 16 07:56:17 2022] PUT /identity/v3/projects/56fa718ff465414a84dc4d1b23e9e916/users/cc19f9a905b8499cb0c079ee9b3b1083/roles/4818d38cf2564825b312e66c9eb24762 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 07:56:17.512983 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b244ff5a-39b7-4ba5-90f0-11cf2eb12cf6 None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:17.513370 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b244ff5a-39b7-4ba5-90f0-11cf2eb12cf6 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:17.513566 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b244ff5a-39b7-4ba5-90f0-11cf2eb12cf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:17.527951 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a814e6d-36e2-4205-8c9b-f8379d1dc615 admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:56:17.548300 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-8a814e6d-36e2-4205-8c9b-f8379d1dc615 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:56:17.643018 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-b244ff5a-39b7-4ba5-90f0-11cf2eb12cf6 None None] MFA Rules not processed for user `cc19f9a905b8499cb0c079ee9b3b1083`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:56:17.645077 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-b244ff5a-39b7-4ba5-90f0-11cf2eb12cf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:56:17.735223 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a814e6d-36e2-4205-8c9b-f8379d1dc615 admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:56:17.752964 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ccd962-0320-4db2-88be-5a5bc362a0e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:56:17.755704 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ccd962-0320-4db2-88be-5a5bc362a0e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:17.756011 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ccd962-0320-4db2-88be-5a5bc362a0e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:17.756295 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ccd962-0320-4db2-88be-5a5bc362a0e3 admin admin] PATH_INFO: `/v3/projects/512d130f61674f1e9ddb08017bc05e47` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:17.759244 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ccd962-0320-4db2-88be-5a5bc362a0e3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=512d130f61674f1e9ddb08017bc05e47)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:56:17.764265 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ccd962-0320-4db2-88be-5a5bc362a0e3 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:56:17.808301 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1088/2184] 10.222.0.57 () {58 vars in 958 bytes} [Fri Sep 16 07:56:17 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 296 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 07:56:17.823261 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b244ff5a-39b7-4ba5-90f0-11cf2eb12cf6 None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:56:17.825494 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-b244ff5a-39b7-4ba5-90f0-11cf2eb12cf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:56:17.901223 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-81ccd962-0320-4db2-88be-5a5bc362a0e3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '512d130f61674f1e9ddb08017bc05e47', 'request_id': 'req-81ccd962-0320-4db2-88be-5a5bc362a0e3'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:56:17.917754 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-81ccd962-0320-4db2-88be-5a5bc362a0e3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '512d130f61674f1e9ddb08017bc05e47', 'request_id': 'req-81ccd962-0320-4db2-88be-5a5bc362a0e3'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:56:17.927184 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b244ff5a-39b7-4ba5-90f0-11cf2eb12cf6 None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:56:17.929018 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-81ccd962-0320-4db2-88be-5a5bc362a0e3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '512d130f61674f1e9ddb08017bc05e47', 'request_id': 'req-81ccd962-0320-4db2-88be-5a5bc362a0e3'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:56:17.947915 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-81ccd962-0320-4db2-88be-5a5bc362a0e3 admin admin] The token cache is being invalidate because project 512d130f61674f1e9ddb08017bc05e47 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81431) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 07:56:17.948448 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-81ccd962-0320-4db2-88be-5a5bc362a0e3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:56:17.949305 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-81ccd962-0320-4db2-88be-5a5bc362a0e3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:56:17.958233 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1097/2185] 10.222.0.57 () {58 vars in 1233 bytes} [Fri Sep 16 07:56:17 2022] DELETE /identity/v3/projects/512d130f61674f1e9ddb08017bc05e47 => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 07:56:17.959641 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c846017-db70-4b5c-9c2e-24fb6aede008 None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:17.959936 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c846017-db70-4b5c-9c2e-24fb6aede008 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:17.960216 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c846017-db70-4b5c-9c2e-24fb6aede008 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:17.983700 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-1c846017-db70-4b5c-9c2e-24fb6aede008 None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:56:17.985603 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-1c846017-db70-4b5c-9c2e-24fb6aede008 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:56:17.987867 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:56:17.995340 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53aadeef-8519-43d0-ac7d-64e1998027e3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544bf6be4c24454a013ca110c43cef2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4735f453c0c24cc4a1c14e9ac84a0b46', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:56:17.995961 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53aadeef-8519-43d0-ac7d-64e1998027e3 service cinder] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:17.996238 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53aadeef-8519-43d0-ac7d-64e1998027e3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:17.996499 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53aadeef-8519-43d0-ac7d-64e1998027e3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:17.999252 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-53aadeef-8519-43d0-ac7d-64e1998027e3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:56:18.052297 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:56:18.098248 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1098/2186] 10.222.0.57 () {58 vars in 958 bytes} [Fri Sep 16 07:56:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 07:56:18.102959 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97477853-c71f-43fa-bec1-72ef6e0fa4de None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:18.103317 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97477853-c71f-43fa-bec1-72ef6e0fa4de None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:18.103656 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97477853-c71f-43fa-bec1-72ef6e0fa4de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:18.116000 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53aadeef-8519-43d0-ac7d-64e1998027e3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:56:18.119504 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53aadeef-8519-43d0-ac7d-64e1998027e3 service cinder] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:56:18.139056 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1089/2187] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Sep 16 07:56:17 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 07:56:18.158835 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-97477853-c71f-43fa-bec1-72ef6e0fa4de None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:56:18.160082 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-97477853-c71f-43fa-bec1-72ef6e0fa4de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:56:18.184407 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1099/2188] 10.222.0.57 () {58 vars in 958 bytes} [Fri Sep 16 07:56:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 07:56:18.188616 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53aadeef-8519-43d0-ac7d-64e1998027e3 service cinder] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:56:18.213059 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53aadeef-8519-43d0-ac7d-64e1998027e3 service cinder] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:56:18.217982 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd9d389-9af6-4449-84d8-dc14c8b4f740 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:56:18.218657 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd9d389-9af6-4449-84d8-dc14c8b4f740 admin admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:18.219517 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd9d389-9af6-4449-84d8-dc14c8b4f740 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:18.219767 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd9d389-9af6-4449-84d8-dc14c8b4f740 admin admin] PATH_INFO: `/v3/domains` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:18.220596 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd9d389-9af6-4449-84d8-dc14c8b4f740 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:56:18.220904 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd9d389-9af6-4449-84d8-dc14c8b4f740 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:56:18.223067 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd9d389-9af6-4449-84d8-dc14c8b4f740 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:56:18.237751 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1090/2189] 10.222.0.57 () {58 vars in 1153 bytes} [Fri Sep 16 07:56:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:56:18.241938 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97477853-c71f-43fa-bec1-72ef6e0fa4de None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:56:18.254999 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97477853-c71f-43fa-bec1-72ef6e0fa4de None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:56:18.261998 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f4cdef-f253-40f1-8306-c6fdd23529c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:56:18.262720 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f4cdef-f253-40f1-8306-c6fdd23529c9 admin admin] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:18.263049 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f4cdef-f253-40f1-8306-c6fdd23529c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:18.263265 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f4cdef-f253-40f1-8306-c6fdd23529c9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:18.263969 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f4cdef-f253-40f1-8306-c6fdd23529c9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:56:18.267220 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f4cdef-f253-40f1-8306-c6fdd23529c9 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:56:18.319773 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1100/2190] 10.222.0.57 () {60 vars in 1153 bytes} [Fri Sep 16 07:56:18 2022] POST /identity/v3/projects => generated 371 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 16 07:56:18.321104 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd9d389-9af6-4449-84d8-dc14c8b4f740 admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:56:18.344993 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd9d389-9af6-4449-84d8-dc14c8b4f740 admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:56:18.440214 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f4cdef-f253-40f1-8306-c6fdd23529c9 admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:56:18.442107 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-86f4cdef-f253-40f1-8306-c6fdd23529c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:56:18.463784 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de160f6b-2432-4f47-b810-a281b45566c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:56:18.465171 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de160f6b-2432-4f47-b810-a281b45566c4 admin admin] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:18.465858 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de160f6b-2432-4f47-b810-a281b45566c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:18.466318 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de160f6b-2432-4f47-b810-a281b45566c4 admin admin] PATH_INFO: `/v3/users` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:18.467243 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de160f6b-2432-4f47-b810-a281b45566c4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:56:18.470819 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de160f6b-2432-4f47-b810-a281b45566c4 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:56:18.512149 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1091/2191] 10.222.0.57 () {60 vars in 1144 bytes} [Fri Sep 16 07:56:18 2022] POST /identity/v3/users => generated 286 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 07:56:18.519260 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de160f6b-2432-4f47-b810-a281b45566c4 admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:56:18.541011 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f4cdef-f253-40f1-8306-c6fdd23529c9 admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:56:18.541845 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de160f6b-2432-4f47-b810-a281b45566c4 admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:56:18.547754 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06b4fa7-d729-47a0-ab08-df16093d73b9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544bf6be4c24454a013ca110c43cef2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4735f453c0c24cc4a1c14e9ac84a0b46', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:56:18.548670 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06b4fa7-d729-47a0-ab08-df16093d73b9 service cinder] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:18.548987 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06b4fa7-d729-47a0-ab08-df16093d73b9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:18.549280 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06b4fa7-d729-47a0-ab08-df16093d73b9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:18.551037 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b556d5e-3fc4-4037-8b52-1d75ea1c4144 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:56:18.551177 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-c06b4fa7-d729-47a0-ab08-df16093d73b9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:56:18.552324 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b556d5e-3fc4-4037-8b52-1d75ea1c4144 admin admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:18.553592 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b556d5e-3fc4-4037-8b52-1d75ea1c4144 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:18.554407 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b556d5e-3fc4-4037-8b52-1d75ea1c4144 admin admin] PATH_INFO: `/v3/roles` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:18.556102 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b556d5e-3fc4-4037-8b52-1d75ea1c4144 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:56:18.558095 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b556d5e-3fc4-4037-8b52-1d75ea1c4144 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:56:18.578826 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1092/2192] 10.222.0.57 () {58 vars in 1122 bytes} [Fri Sep 16 07:56:18 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 07:56:18.579804 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b556d5e-3fc4-4037-8b52-1d75ea1c4144 admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:56:18.600023 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b556d5e-3fc4-4037-8b52-1d75ea1c4144 admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:56:18.613771 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e16d18f-ddc9-4ddb-8a3e-0d22e4f44955 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:56:18.614187 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e16d18f-ddc9-4ddb-8a3e-0d22e4f44955 admin admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:18.614473 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e16d18f-ddc9-4ddb-8a3e-0d22e4f44955 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:18.614772 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e16d18f-ddc9-4ddb-8a3e-0d22e4f44955 admin admin] PATH_INFO: `/v3/roles` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:18.615437 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e16d18f-ddc9-4ddb-8a3e-0d22e4f44955 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:56:18.622495 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e16d18f-ddc9-4ddb-8a3e-0d22e4f44955 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:56:18.672542 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1093/2193] 10.222.0.57 () {58 vars in 1122 bytes} [Fri Sep 16 07:56:18 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 07:56:18.673655 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e16d18f-ddc9-4ddb-8a3e-0d22e4f44955 admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:56:18.700137 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e16d18f-ddc9-4ddb-8a3e-0d22e4f44955 admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:56:18.729942 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e9c1b1-db11-4d78-831b-d9ca713ea0e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:56:18.729942 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e9c1b1-db11-4d78-831b-d9ca713ea0e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:18.729942 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e9c1b1-db11-4d78-831b-d9ca713ea0e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:18.729942 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e9c1b1-db11-4d78-831b-d9ca713ea0e8 admin admin] PATH_INFO: `/v3/projects/e3b3c08ee6474ce6915a743e05f0afa4/users/ad110f845b8b4e549bf9a4ec9e39204f/roles/4818d38cf2564825b312e66c9eb24762` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:18.768556 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06b4fa7-d729-47a0-ab08-df16093d73b9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:56:18.771044 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06b4fa7-d729-47a0-ab08-df16093d73b9 service cinder] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:56:18.780653 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e9c1b1-db11-4d78-831b-d9ca713ea0e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e3b3c08ee6474ce6915a743e05f0afa4, user_id=ad110f845b8b4e549bf9a4ec9e39204f, role_id=4818d38cf2564825b312e66c9eb24762)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:56:18.783817 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e9c1b1-db11-4d78-831b-d9ca713ea0e8 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:56:18.805785 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1101/2194] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Sep 16 07:56:18 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 16 07:56:18.835087 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1094/2195] 10.222.0.57 () {60 vars in 1483 bytes} [Fri Sep 16 07:56:18 2022] PUT /identity/v3/projects/e3b3c08ee6474ce6915a743e05f0afa4/users/ad110f845b8b4e549bf9a4ec9e39204f/roles/4818d38cf2564825b312e66c9eb24762 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 07:56:18.845497 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e6ccc2-fec4-4418-8c83-770ea36d6a84 None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:18.846320 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e6ccc2-fec4-4418-8c83-770ea36d6a84 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:18.846721 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e6ccc2-fec4-4418-8c83-770ea36d6a84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:18.918476 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-a4e6ccc2-fec4-4418-8c83-770ea36d6a84 None None] MFA Rules not processed for user `ad110f845b8b4e549bf9a4ec9e39204f`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:56:18.925325 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-a4e6ccc2-fec4-4418-8c83-770ea36d6a84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:56:19.116238 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1102/2196] 10.222.0.57 () {58 vars in 958 bytes} [Fri Sep 16 07:56:18 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 07:56:19.141355 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e9c1b1-db11-4d78-831b-d9ca713ea0e8 admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:56:19.144277 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-b5e9c1b1-db11-4d78-831b-d9ca713ea0e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:56:19.197765 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:56:19.254815 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e9c1b1-db11-4d78-831b-d9ca713ea0e8 admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:56:19.258547 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b8a707-f947-4a9f-b8b4-2110626e2a69 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceecb2c2fe9842e3b228848e00fd11ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4735f453c0c24cc4a1c14e9ac84a0b46', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:56:19.259150 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b8a707-f947-4a9f-b8b4-2110626e2a69 service glance] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:19.259432 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b8a707-f947-4a9f-b8b4-2110626e2a69 service glance] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:19.259707 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b8a707-f947-4a9f-b8b4-2110626e2a69 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:19.268497 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b8a707-f947-4a9f-b8b4-2110626e2a69 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:56:19.269949 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b8a707-f947-4a9f-b8b4-2110626e2a69 service glance] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:56:19.278912 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1095/2197] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Sep 16 07:56:19 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 07:56:19.488540 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee49799-edd3-4e4f-a99c-0d595cab6eff None None] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:19.489881 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee49799-edd3-4e4f-a99c-0d595cab6eff None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:19.490280 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee49799-edd3-4e4f-a99c-0d595cab6eff None None] PATH_INFO: `/` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:19.491959 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1103/2198] 10.222.0.57 () {54 vars in 921 bytes} [Fri Sep 16 07:56:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 07:56:19.527584 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41525a4c-391a-403b-8ede-fe192ba3e125 None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:19.529049 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41525a4c-391a-403b-8ede-fe192ba3e125 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:19.529334 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41525a4c-391a-403b-8ede-fe192ba3e125 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:19.580965 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-41525a4c-391a-403b-8ede-fe192ba3e125 None None] MFA Rules not processed for user `c7d4ccdd6ef9400ba9e344df0964da1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:56:19.582197 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-41525a4c-391a-403b-8ede-fe192ba3e125 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:56:19.597714 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee49799-edd3-4e4f-a99c-0d595cab6eff None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:56:19.600154 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-8ee49799-edd3-4e4f-a99c-0d595cab6eff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:56:19.613213 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:56:19.700690 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1096/2199] 10.222.0.57 () {58 vars in 1018 bytes} [Fri Sep 16 07:56:19 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 07:56:19.710491 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41525a4c-391a-403b-8ede-fe192ba3e125 None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:56:19.711835 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee49799-edd3-4e4f-a99c-0d595cab6eff None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:56:19.715373 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-41525a4c-391a-403b-8ede-fe192ba3e125 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:56:19.717583 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa6326f-c006-4eb3-8252-76eee374a6db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:56:19.718301 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa6326f-c006-4eb3-8252-76eee374a6db admin admin] REQUEST_METHOD: `DELETE` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:19.719853 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa6326f-c006-4eb3-8252-76eee374a6db admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:19.720202 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa6326f-c006-4eb3-8252-76eee374a6db admin admin] PATH_INFO: `/v3/users/ed058b182f0f46a78f2f3a2f3a0e3528` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:19.721509 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa6326f-c006-4eb3-8252-76eee374a6db admin admin] RBAC: Authorizing `identity:delete_user(user_id=ed058b182f0f46a78f2f3a2f3a0e3528)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:56:19.723951 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa6326f-c006-4eb3-8252-76eee374a6db admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:56:19.736452 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41525a4c-391a-403b-8ede-fe192ba3e125 None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:56:19.742788 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdff8600-472b-42fc-bda4-14eee3c56b8c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7d4ccdd6ef9400ba9e344df0964da1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4735f453c0c24cc4a1c14e9ac84a0b46', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:56:19.744098 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdff8600-472b-42fc-bda4-14eee3c56b8c service placement] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:19.744098 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdff8600-472b-42fc-bda4-14eee3c56b8c service placement] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:19.744350 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdff8600-472b-42fc-bda4-14eee3c56b8c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:19.756534 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdff8600-472b-42fc-bda4-14eee3c56b8c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:56:19.759547 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdff8600-472b-42fc-bda4-14eee3c56b8c service placement] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:56:19.779796 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1097/2200] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Sep 16 07:56:19 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 07:56:19.782036 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdff8600-472b-42fc-bda4-14eee3c56b8c service placement] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:56:19.791906 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-0aa6326f-c006-4eb3-8252-76eee374a6db admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ed058b182f0f46a78f2f3a2f3a0e3528'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:56:19.810347 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-0aa6326f-c006-4eb3-8252-76eee374a6db admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ed058b182f0f46a78f2f3a2f3a0e3528'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:56:19.811200 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-0aa6326f-c006-4eb3-8252-76eee374a6db admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ed058b182f0f46a78f2f3a2f3a0e3528'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:56:19.826633 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-0aa6326f-c006-4eb3-8252-76eee374a6db admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ed058b182f0f46a78f2f3a2f3a0e3528'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:56:19.842709 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-0aa6326f-c006-4eb3-8252-76eee374a6db admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ed058b182f0f46a78f2f3a2f3a0e3528'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:56:19.851657 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1104/2201] 10.222.0.57 () {58 vars in 1224 bytes} [Fri Sep 16 07:56:19 2022] DELETE /identity/v3/users/ed058b182f0f46a78f2f3a2f3a0e3528 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 16 07:56:19.866887 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdff8600-472b-42fc-bda4-14eee3c56b8c service placement] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:56:19.975235 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c218d724-476f-423c-9dde-123d7be0d9e7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544bf6be4c24454a013ca110c43cef2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4735f453c0c24cc4a1c14e9ac84a0b46', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:56:19.975921 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c218d724-476f-423c-9dde-123d7be0d9e7 service cinder] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:19.976138 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c218d724-476f-423c-9dde-123d7be0d9e7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:19.976402 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c218d724-476f-423c-9dde-123d7be0d9e7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:19.983862 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-c218d724-476f-423c-9dde-123d7be0d9e7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:56:19.995905 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:56:20.097082 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa6326f-c006-4eb3-8252-76eee374a6db admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:56:20.097614 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c218d724-476f-423c-9dde-123d7be0d9e7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:56:20.098745 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c218d724-476f-423c-9dde-123d7be0d9e7 service cinder] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:56:20.100555 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-0aa6326f-c006-4eb3-8252-76eee374a6db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:56:20.111849 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1098/2202] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Sep 16 07:56:19 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 07:56:20.211397 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa6326f-c006-4eb3-8252-76eee374a6db admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:56:20.217345 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44a5e4f-a18f-4bb7-bf34-173888a46d63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:56:20.218320 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44a5e4f-a18f-4bb7-bf34-173888a46d63 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:20.219245 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44a5e4f-a18f-4bb7-bf34-173888a46d63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:20.219729 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44a5e4f-a18f-4bb7-bf34-173888a46d63 admin admin] PATH_INFO: `/v3/projects/4dc5a8b3ae024a0a82ae970e4edd5cfe` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:20.221291 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44a5e4f-a18f-4bb7-bf34-173888a46d63 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4dc5a8b3ae024a0a82ae970e4edd5cfe)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:56:20.224321 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44a5e4f-a18f-4bb7-bf34-173888a46d63 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:56:20.264950 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:56:20.301994 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-b44a5e4f-a18f-4bb7-bf34-173888a46d63 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4dc5a8b3ae024a0a82ae970e4edd5cfe', 'request_id': 'req-b44a5e4f-a18f-4bb7-bf34-173888a46d63'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:56:20.318591 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-b44a5e4f-a18f-4bb7-bf34-173888a46d63 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4dc5a8b3ae024a0a82ae970e4edd5cfe', 'request_id': 'req-b44a5e4f-a18f-4bb7-bf34-173888a46d63'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:56:20.347316 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-b44a5e4f-a18f-4bb7-bf34-173888a46d63 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4dc5a8b3ae024a0a82ae970e4edd5cfe', 'request_id': 'req-b44a5e4f-a18f-4bb7-bf34-173888a46d63'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:56:20.365386 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-b44a5e4f-a18f-4bb7-bf34-173888a46d63 admin admin] The token cache is being invalidate because project 4dc5a8b3ae024a0a82ae970e4edd5cfe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81431) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 07:56:20.365858 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-b44a5e4f-a18f-4bb7-bf34-173888a46d63 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:56:20.366698 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-b44a5e4f-a18f-4bb7-bf34-173888a46d63 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:56:20.369124 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1105/2203] 10.222.0.57 () {58 vars in 1233 bytes} [Fri Sep 16 07:56:20 2022] DELETE /identity/v3/projects/4dc5a8b3ae024a0a82ae970e4edd5cfe => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 16 07:56:20.375198 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e1959a-3617-46d1-addf-2267bca2d226 None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:20.375957 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e1959a-3617-46d1-addf-2267bca2d226 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:20.376320 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e1959a-3617-46d1-addf-2267bca2d226 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:20.436179 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-13e1959a-3617-46d1-addf-2267bca2d226 None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:56:20.437572 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-13e1959a-3617-46d1-addf-2267bca2d226 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:56:20.530657 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1099/2204] 10.222.0.57 () {58 vars in 958 bytes} [Fri Sep 16 07:56:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 07:56:20.539739 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7916c9b2-7960-4ef6-94a8-31b5c757b14b None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:20.541088 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7916c9b2-7960-4ef6-94a8-31b5c757b14b None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:20.541506 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7916c9b2-7960-4ef6-94a8-31b5c757b14b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:20.566029 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-7916c9b2-7960-4ef6-94a8-31b5c757b14b None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:56:20.567260 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-7916c9b2-7960-4ef6-94a8-31b5c757b14b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:56:20.576155 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1106/2205] 10.222.0.57 () {58 vars in 958 bytes} [Fri Sep 16 07:56:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 07:56:20.581255 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e1959a-3617-46d1-addf-2267bca2d226 None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:56:20.600621 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e1959a-3617-46d1-addf-2267bca2d226 None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:56:20.605346 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec978c9-9c29-40af-b693-1153445d08ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:56:20.606027 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec978c9-9c29-40af-b693-1153445d08ac admin admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:20.606306 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec978c9-9c29-40af-b693-1153445d08ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:20.606546 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec978c9-9c29-40af-b693-1153445d08ac admin admin] PATH_INFO: `/v3/domains` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:20.607159 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec978c9-9c29-40af-b693-1153445d08ac admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:56:20.607484 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec978c9-9c29-40af-b693-1153445d08ac admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:56:20.610191 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec978c9-9c29-40af-b693-1153445d08ac admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:56:20.652352 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1100/2206] 10.222.0.57 () {58 vars in 1153 bytes} [Fri Sep 16 07:56:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:56:20.657215 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7916c9b2-7960-4ef6-94a8-31b5c757b14b None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:56:20.670136 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7916c9b2-7960-4ef6-94a8-31b5c757b14b None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:56:20.677628 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418fb0ad-ad79-45b5-b737-2850fca53c5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:56:20.678271 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418fb0ad-ad79-45b5-b737-2850fca53c5b admin admin] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:20.678618 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418fb0ad-ad79-45b5-b737-2850fca53c5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:20.678938 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418fb0ad-ad79-45b5-b737-2850fca53c5b admin admin] PATH_INFO: `/v3/projects` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:20.679635 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418fb0ad-ad79-45b5-b737-2850fca53c5b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:56:20.682769 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418fb0ad-ad79-45b5-b737-2850fca53c5b admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:56:20.734784 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1107/2207] 10.222.0.57 () {60 vars in 1153 bytes} [Fri Sep 16 07:56:20 2022] POST /identity/v3/projects => generated 403 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 07:56:20.735824 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec978c9-9c29-40af-b693-1153445d08ac admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:56:20.747677 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec978c9-9c29-40af-b693-1153445d08ac admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:56:20.818201 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15b16d2-cf2d-4d79-b410-e60933e5eef2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:56:20.819210 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15b16d2-cf2d-4d79-b410-e60933e5eef2 admin admin] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:20.819666 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15b16d2-cf2d-4d79-b410-e60933e5eef2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:20.820008 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15b16d2-cf2d-4d79-b410-e60933e5eef2 admin admin] PATH_INFO: `/v3/users` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:20.820835 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15b16d2-cf2d-4d79-b410-e60933e5eef2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:56:20.823521 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15b16d2-cf2d-4d79-b410-e60933e5eef2 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:56:20.846230 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1101/2208] 10.222.0.57 () {60 vars in 1144 bytes} [Fri Sep 16 07:56:20 2022] POST /identity/v3/users => generated 302 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 07:56:20.850477 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418fb0ad-ad79-45b5-b737-2850fca53c5b admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:56:20.861445 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418fb0ad-ad79-45b5-b737-2850fca53c5b admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:56:20.865931 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5d41f9-22a9-42be-ba0f-d0e996f186d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:56:20.866550 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5d41f9-22a9-42be-ba0f-d0e996f186d8 admin admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:20.866821 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5d41f9-22a9-42be-ba0f-d0e996f186d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:20.867089 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5d41f9-22a9-42be-ba0f-d0e996f186d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:20.867988 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5d41f9-22a9-42be-ba0f-d0e996f186d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:56:20.869559 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5d41f9-22a9-42be-ba0f-d0e996f186d8 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:56:20.879433 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1108/2209] 10.222.0.57 () {58 vars in 1122 bytes} [Fri Sep 16 07:56:20 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 07:56:20.883853 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15b16d2-cf2d-4d79-b410-e60933e5eef2 admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:56:20.894100 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15b16d2-cf2d-4d79-b410-e60933e5eef2 admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:56:20.898864 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc80ad6-85dc-4b58-b74e-3eb54de5db66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:56:20.899553 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc80ad6-85dc-4b58-b74e-3eb54de5db66 admin admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:20.899836 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc80ad6-85dc-4b58-b74e-3eb54de5db66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:20.900112 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc80ad6-85dc-4b58-b74e-3eb54de5db66 admin admin] PATH_INFO: `/v3/roles` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:20.900879 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc80ad6-85dc-4b58-b74e-3eb54de5db66 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:56:20.902917 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc80ad6-85dc-4b58-b74e-3eb54de5db66 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:56:20.918456 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1102/2210] 10.222.0.57 () {58 vars in 1122 bytes} [Fri Sep 16 07:56:20 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 16 07:56:20.919644 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5d41f9-22a9-42be-ba0f-d0e996f186d8 admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:56:20.930768 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5d41f9-22a9-42be-ba0f-d0e996f186d8 admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:56:20.935667 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8ae5a2-ad7c-436d-985b-b3ba8b868336 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:56:20.936326 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8ae5a2-ad7c-436d-985b-b3ba8b868336 admin admin] REQUEST_METHOD: `PUT` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:20.936609 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8ae5a2-ad7c-436d-985b-b3ba8b868336 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:20.936871 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8ae5a2-ad7c-436d-985b-b3ba8b868336 admin admin] PATH_INFO: `/v3/projects/e0397ff7c539408889a65b743b94e8e9/users/4be33c07216c45c6aa06d508d9dcb81c/roles/4818d38cf2564825b312e66c9eb24762` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:20.951130 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8ae5a2-ad7c-436d-985b-b3ba8b868336 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e0397ff7c539408889a65b743b94e8e9, user_id=4be33c07216c45c6aa06d508d9dcb81c, role_id=4818d38cf2564825b312e66c9eb24762)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:56:20.954182 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8ae5a2-ad7c-436d-985b-b3ba8b868336 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:56:20.967021 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1109/2211] 10.222.0.57 () {60 vars in 1483 bytes} [Fri Sep 16 07:56:20 2022] PUT /identity/v3/projects/e0397ff7c539408889a65b743b94e8e9/users/4be33c07216c45c6aa06d508d9dcb81c/roles/4818d38cf2564825b312e66c9eb24762 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 16 07:56:20.973021 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0371c03-d722-4d17-9c95-67a5307c0a43 None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:20.973307 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0371c03-d722-4d17-9c95-67a5307c0a43 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:20.973582 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0371c03-d722-4d17-9c95-67a5307c0a43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:20.994284 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-d0371c03-d722-4d17-9c95-67a5307c0a43 None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:56:20.995757 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-d0371c03-d722-4d17-9c95-67a5307c0a43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:56:21.000966 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:56:21.057034 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1103/2212] 10.222.0.57 () {58 vars in 958 bytes} [Fri Sep 16 07:56:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 07:56:21.066946 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8ae5a2-ad7c-436d-985b-b3ba8b868336 admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:56:21.069066 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-bf8ae5a2-ad7c-436d-985b-b3ba8b868336 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:56:21.129183 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8ae5a2-ad7c-436d-985b-b3ba8b868336 admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:56:21.132836 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a663ada7-2e35-4b4c-b63f-d368fd5b1f72 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1062e457207a41e4ba4f0a0c4bf36f1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4735f453c0c24cc4a1c14e9ac84a0b46', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:56:21.133442 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a663ada7-2e35-4b4c-b63f-d368fd5b1f72 service neutron] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:21.133839 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a663ada7-2e35-4b4c-b63f-d368fd5b1f72 service neutron] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:21.134139 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a663ada7-2e35-4b4c-b63f-d368fd5b1f72 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:21.143546 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a663ada7-2e35-4b4c-b63f-d368fd5b1f72 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:56:21.145006 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a663ada7-2e35-4b4c-b63f-d368fd5b1f72 service neutron] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:56:21.155029 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1110/2213] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Sep 16 07:56:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 07:56:22.092739 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54d1f29-6677-47da-a935-53ad997e1121 None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:22.093253 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54d1f29-6677-47da-a935-53ad997e1121 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:22.093666 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54d1f29-6677-47da-a935-53ad997e1121 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:22.151968 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-c54d1f29-6677-47da-a935-53ad997e1121 None None] MFA Rules not processed for user `4be33c07216c45c6aa06d508d9dcb81c`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:56:22.153696 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-c54d1f29-6677-47da-a935-53ad997e1121 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:56:22.241959 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1104/2214] 10.222.0.57 () {58 vars in 958 bytes} [Fri Sep 16 07:56:22 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 07:56:22.246475 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a663ada7-2e35-4b4c-b63f-d368fd5b1f72 service neutron] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:56:22.260191 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a663ada7-2e35-4b4c-b63f-d368fd5b1f72 service neutron] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:56:22.267655 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45213dc7-3a32-4b70-809b-1d16893c3be7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:56:22.268448 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45213dc7-3a32-4b70-809b-1d16893c3be7 admin admin] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:22.268766 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45213dc7-3a32-4b70-809b-1d16893c3be7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:22.269127 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45213dc7-3a32-4b70-809b-1d16893c3be7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:22.269909 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45213dc7-3a32-4b70-809b-1d16893c3be7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:56:22.272502 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45213dc7-3a32-4b70-809b-1d16893c3be7 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:56:22.280116 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54d1f29-6677-47da-a935-53ad997e1121 None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:56:22.282050 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-c54d1f29-6677-47da-a935-53ad997e1121 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:56:22.302572 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1111/2215] 10.222.0.57 () {60 vars in 1153 bytes} [Fri Sep 16 07:56:22 2022] POST /identity/v3/projects => generated 405 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 07:56:22.306478 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45213dc7-3a32-4b70-809b-1d16893c3be7 admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:56:22.342102 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:56:22.347044 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54d1f29-6677-47da-a935-53ad997e1121 None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:56:22.376310 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45213dc7-3a32-4b70-809b-1d16893c3be7 admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:56:22.381348 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef83c24f-a2cc-463c-aec6-0ad5e8678656 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:56:22.381986 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef83c24f-a2cc-463c-aec6-0ad5e8678656 admin admin] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:22.382351 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef83c24f-a2cc-463c-aec6-0ad5e8678656 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:22.382672 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef83c24f-a2cc-463c-aec6-0ad5e8678656 admin admin] PATH_INFO: `/v3/users` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:22.383457 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef83c24f-a2cc-463c-aec6-0ad5e8678656 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:56:22.385462 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef83c24f-a2cc-463c-aec6-0ad5e8678656 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:56:22.400398 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed89ec49-40d1-4aab-90d8-ad27fd3e8afa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544bf6be4c24454a013ca110c43cef2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4735f453c0c24cc4a1c14e9ac84a0b46', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:56:22.401041 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed89ec49-40d1-4aab-90d8-ad27fd3e8afa service cinder] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:22.401321 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed89ec49-40d1-4aab-90d8-ad27fd3e8afa service cinder] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:22.401673 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed89ec49-40d1-4aab-90d8-ad27fd3e8afa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:22.403640 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-ed89ec49-40d1-4aab-90d8-ad27fd3e8afa service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:56:22.406898 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1112/2216] 10.222.0.57 () {60 vars in 1144 bytes} [Fri Sep 16 07:56:22 2022] POST /identity/v3/users => generated 309 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 16 07:56:22.412679 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef83c24f-a2cc-463c-aec6-0ad5e8678656 admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:56:22.416967 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:56:22.424781 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef83c24f-a2cc-463c-aec6-0ad5e8678656 admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:56:22.429900 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecacf4b5-0737-4c8d-bc2e-ee17a1c62090 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:56:22.430498 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecacf4b5-0737-4c8d-bc2e-ee17a1c62090 admin admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:22.430774 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecacf4b5-0737-4c8d-bc2e-ee17a1c62090 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:22.431043 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecacf4b5-0737-4c8d-bc2e-ee17a1c62090 admin admin] PATH_INFO: `/v3/roles` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:22.431673 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecacf4b5-0737-4c8d-bc2e-ee17a1c62090 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:56:22.433337 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecacf4b5-0737-4c8d-bc2e-ee17a1c62090 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:56:22.443145 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1113/2217] 10.222.0.57 () {58 vars in 1122 bytes} [Fri Sep 16 07:56:22 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 16 07:56:22.447238 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecacf4b5-0737-4c8d-bc2e-ee17a1c62090 admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:56:22.456929 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecacf4b5-0737-4c8d-bc2e-ee17a1c62090 admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:56:22.461593 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc46848-4306-495a-aed6-115a5b06c0d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:56:22.462254 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc46848-4306-495a-aed6-115a5b06c0d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:22.462529 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc46848-4306-495a-aed6-115a5b06c0d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:22.462799 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc46848-4306-495a-aed6-115a5b06c0d6 admin admin] PATH_INFO: `/v3/projects/1f4890f61eee49ada09f6acfe65398af/users/9fd55d7c6b6f4b3b8e72babea4cf3e06/roles/567db03c91854ad9af1e9a87ec1bd275` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:22.466993 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed89ec49-40d1-4aab-90d8-ad27fd3e8afa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:56:22.468987 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed89ec49-40d1-4aab-90d8-ad27fd3e8afa service cinder] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:56:22.478219 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1105/2218] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Sep 16 07:56:22 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 07:56:22.478765 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc46848-4306-495a-aed6-115a5b06c0d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1f4890f61eee49ada09f6acfe65398af, user_id=9fd55d7c6b6f4b3b8e72babea4cf3e06, role_id=567db03c91854ad9af1e9a87ec1bd275)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:56:22.481491 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc46848-4306-495a-aed6-115a5b06c0d6 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:56:22.495743 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1114/2219] 10.222.0.57 () {60 vars in 1483 bytes} [Fri Sep 16 07:56:22 2022] PUT /identity/v3/projects/1f4890f61eee49ada09f6acfe65398af/users/9fd55d7c6b6f4b3b8e72babea4cf3e06/roles/567db03c91854ad9af1e9a87ec1bd275 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 16 07:56:22.499908 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed89ec49-40d1-4aab-90d8-ad27fd3e8afa service cinder] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:56:22.510778 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed89ec49-40d1-4aab-90d8-ad27fd3e8afa service cinder] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:56:22.574361 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0faefb-7664-4c7d-9907-1d831c024ce9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:56:22.575069 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0faefb-7664-4c7d-9907-1d831c024ce9 admin admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:22.575374 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0faefb-7664-4c7d-9907-1d831c024ce9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:22.575647 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0faefb-7664-4c7d-9907-1d831c024ce9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:22.576286 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0faefb-7664-4c7d-9907-1d831c024ce9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:56:22.578498 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0faefb-7664-4c7d-9907-1d831c024ce9 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:56:22.588676 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1106/2220] 10.222.0.57 () {58 vars in 1122 bytes} [Fri Sep 16 07:56:22 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 07:56:22.593118 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc46848-4306-495a-aed6-115a5b06c0d6 admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:56:22.605819 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc46848-4306-495a-aed6-115a5b06c0d6 admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:56:22.612352 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d483e3-4c77-4f51-ace4-5e63149f3fb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:56:22.613145 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d483e3-4c77-4f51-ace4-5e63149f3fb1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:22.613522 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d483e3-4c77-4f51-ace4-5e63149f3fb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:22.613932 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d483e3-4c77-4f51-ace4-5e63149f3fb1 admin admin] PATH_INFO: `/v3/projects/1f4890f61eee49ada09f6acfe65398af/users/9fd55d7c6b6f4b3b8e72babea4cf3e06/roles/567db03c91854ad9af1e9a87ec1bd275` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:22.615924 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d483e3-4c77-4f51-ace4-5e63149f3fb1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1f4890f61eee49ada09f6acfe65398af, user_id=9fd55d7c6b6f4b3b8e72babea4cf3e06, role_id=567db03c91854ad9af1e9a87ec1bd275)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:56:22.618969 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d483e3-4c77-4f51-ace4-5e63149f3fb1 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:56:22.632025 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1115/2221] 10.222.0.57 () {60 vars in 1483 bytes} [Fri Sep 16 07:56:22 2022] PUT /identity/v3/projects/1f4890f61eee49ada09f6acfe65398af/users/9fd55d7c6b6f4b3b8e72babea4cf3e06/roles/567db03c91854ad9af1e9a87ec1bd275 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 07:56:23.719685 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01309a4e-2d17-4fb5-a454-8b563020886c None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:23.720289 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01309a4e-2d17-4fb5-a454-8b563020886c None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:23.720413 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01309a4e-2d17-4fb5-a454-8b563020886c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:23.766718 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-01309a4e-2d17-4fb5-a454-8b563020886c None None] MFA Rules not processed for user `9fd55d7c6b6f4b3b8e72babea4cf3e06`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:56:23.768461 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-01309a4e-2d17-4fb5-a454-8b563020886c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:56:23.880479 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1107/2222] 10.222.0.57 () {58 vars in 958 bytes} [Fri Sep 16 07:56:23 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 07:56:25.059683 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d483e3-4c77-4f51-ace4-5e63149f3fb1 admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:56:25.062034 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-41d483e3-4c77-4f51-ace4-5e63149f3fb1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:56:25.129751 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01309a4e-2d17-4fb5-a454-8b563020886c None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:56:25.185084 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:56:25.193864 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d483e3-4c77-4f51-ace4-5e63149f3fb1 admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:56:25.199883 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1168833b-7795-4bd5-8a11-e87140a3ab09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:56:25.200516 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1168833b-7795-4bd5-8a11-e87140a3ab09 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:25.200800 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1168833b-7795-4bd5-8a11-e87140a3ab09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:25.201073 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1168833b-7795-4bd5-8a11-e87140a3ab09 admin admin] PATH_INFO: `/v3/users/f2c1c64c17304af28de1204ea79c9064` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:25.202241 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1168833b-7795-4bd5-8a11-e87140a3ab09 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f2c1c64c17304af28de1204ea79c9064)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:56:25.204896 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1168833b-7795-4bd5-8a11-e87140a3ab09 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:56:25.221307 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01309a4e-2d17-4fb5-a454-8b563020886c None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:56:25.226656 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cb9330-93d0-48ba-bde8-776d69cf5e52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:56:25.227535 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cb9330-93d0-48ba-bde8-776d69cf5e52 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:25.227791 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cb9330-93d0-48ba-bde8-776d69cf5e52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:25.228058 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cb9330-93d0-48ba-bde8-776d69cf5e52 admin admin] PATH_INFO: `/v3/users/4be33c07216c45c6aa06d508d9dcb81c` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:25.230212 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6cb9330-93d0-48ba-bde8-776d69cf5e52 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4be33c07216c45c6aa06d508d9dcb81c)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:56:25.231371 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6cb9330-93d0-48ba-bde8-776d69cf5e52 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:56:25.267037 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-1168833b-7795-4bd5-8a11-e87140a3ab09 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f2c1c64c17304af28de1204ea79c9064'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:56:25.280859 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-1168833b-7795-4bd5-8a11-e87140a3ab09 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f2c1c64c17304af28de1204ea79c9064'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:56:25.281925 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-1168833b-7795-4bd5-8a11-e87140a3ab09 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f2c1c64c17304af28de1204ea79c9064'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:56:25.290181 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-e6cb9330-93d0-48ba-bde8-776d69cf5e52 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4be33c07216c45c6aa06d508d9dcb81c'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:56:25.290971 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-e6cb9330-93d0-48ba-bde8-776d69cf5e52 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4be33c07216c45c6aa06d508d9dcb81c'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:56:25.294596 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-1168833b-7795-4bd5-8a11-e87140a3ab09 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f2c1c64c17304af28de1204ea79c9064'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:56:25.298869 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-e6cb9330-93d0-48ba-bde8-776d69cf5e52 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4be33c07216c45c6aa06d508d9dcb81c'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:56:25.300728 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=84,keystone:INSERT=6,keystone:DELETE=10 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:56:25.303973 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-1168833b-7795-4bd5-8a11-e87140a3ab09 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f2c1c64c17304af28de1204ea79c9064'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:56:25.314426 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1116/2223] 10.222.0.57 () {58 vars in 1224 bytes} [Fri Sep 16 07:56:25 2022] DELETE /identity/v3/users/f2c1c64c17304af28de1204ea79c9064 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 07:56:25.316430 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-e6cb9330-93d0-48ba-bde8-776d69cf5e52 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4be33c07216c45c6aa06d508d9dcb81c'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:56:25.318878 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401239e7-8608-4331-a1d1-e76f3b5e1322 None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:25.319164 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401239e7-8608-4331-a1d1-e76f3b5e1322 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:25.319470 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401239e7-8608-4331-a1d1-e76f3b5e1322 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:25.325851 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-e6cb9330-93d0-48ba-bde8-776d69cf5e52 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4be33c07216c45c6aa06d508d9dcb81c'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:56:25.332720 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1108/2224] 10.222.0.57 () {58 vars in 1224 bytes} [Fri Sep 16 07:56:25 2022] DELETE /identity/v3/users/4be33c07216c45c6aa06d508d9dcb81c => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 07:56:25.342223 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-401239e7-8608-4331-a1d1-e76f3b5e1322 None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:56:25.343944 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-401239e7-8608-4331-a1d1-e76f3b5e1322 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:56:25.433801 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1117/2225] 10.222.0.57 () {58 vars in 958 bytes} [Fri Sep 16 07:56:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 16 07:56:25.451179 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cb9330-93d0-48ba-bde8-776d69cf5e52 admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:56:25.453562 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-e6cb9330-93d0-48ba-bde8-776d69cf5e52 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:56:25.525991 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401239e7-8608-4331-a1d1-e76f3b5e1322 None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:56:25.528234 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-401239e7-8608-4331-a1d1-e76f3b5e1322 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:56:25.529800 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cb9330-93d0-48ba-bde8-776d69cf5e52 admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:56:25.540702 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec41977-a96e-48f1-8644-29fba0440d17 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1062e457207a41e4ba4f0a0c4bf36f1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4735f453c0c24cc4a1c14e9ac84a0b46', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:56:25.541321 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec41977-a96e-48f1-8644-29fba0440d17 service neutron] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:25.541646 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec41977-a96e-48f1-8644-29fba0440d17 service neutron] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:25.541952 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec41977-a96e-48f1-8644-29fba0440d17 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:25.543660 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401239e7-8608-4331-a1d1-e76f3b5e1322 None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:56:25.549006 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2d0755-a9c0-461e-8d96-921bafa89a32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:56:25.549646 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2d0755-a9c0-461e-8d96-921bafa89a32 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:25.549953 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2d0755-a9c0-461e-8d96-921bafa89a32 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:25.550223 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2d0755-a9c0-461e-8d96-921bafa89a32 admin admin] PATH_INFO: `/v3/users/cde4d407713f47bcb07b2f8b98209d1c` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:25.551499 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2d0755-a9c0-461e-8d96-921bafa89a32 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cde4d407713f47bcb07b2f8b98209d1c)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:56:25.553236 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec41977-a96e-48f1-8644-29fba0440d17 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:56:25.553419 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2d0755-a9c0-461e-8d96-921bafa89a32 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:56:25.554924 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec41977-a96e-48f1-8644-29fba0440d17 service neutron] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:56:25.566366 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1109/2226] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Sep 16 07:56:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 07:56:25.567145 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec41977-a96e-48f1-8644-29fba0440d17 service neutron] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:56:25.568486 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-0ec41977-a96e-48f1-8644-29fba0440d17 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:56:25.590879 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec41977-a96e-48f1-8644-29fba0440d17 service neutron] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:56:25.597554 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a8ee3e-7c2e-4c16-bc44-22338926e3be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:56:25.598678 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a8ee3e-7c2e-4c16-bc44-22338926e3be admin admin] REQUEST_METHOD: `DELETE` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:25.599226 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a8ee3e-7c2e-4c16-bc44-22338926e3be admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:25.599509 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a8ee3e-7c2e-4c16-bc44-22338926e3be admin admin] PATH_INFO: `/v3/projects/e0397ff7c539408889a65b743b94e8e9` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:25.600932 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a8ee3e-7c2e-4c16-bc44-22338926e3be admin admin] RBAC: Authorizing `identity:delete_project(project_id=e0397ff7c539408889a65b743b94e8e9)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:56:25.602886 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a8ee3e-7c2e-4c16-bc44-22338926e3be admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:56:25.625256 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-1e2d0755-a9c0-461e-8d96-921bafa89a32 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cde4d407713f47bcb07b2f8b98209d1c'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:56:25.639781 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-1e2d0755-a9c0-461e-8d96-921bafa89a32 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cde4d407713f47bcb07b2f8b98209d1c'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:56:25.640626 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-1e2d0755-a9c0-461e-8d96-921bafa89a32 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cde4d407713f47bcb07b2f8b98209d1c'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:56:25.649074 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-1e2d0755-a9c0-461e-8d96-921bafa89a32 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cde4d407713f47bcb07b2f8b98209d1c'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:56:25.657866 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-1e2d0755-a9c0-461e-8d96-921bafa89a32 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cde4d407713f47bcb07b2f8b98209d1c'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:56:25.664999 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1118/2227] 10.222.0.57 () {58 vars in 1224 bytes} [Fri Sep 16 07:56:25 2022] DELETE /identity/v3/users/cde4d407713f47bcb07b2f8b98209d1c => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 07:56:25.666581 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-11a8ee3e-7c2e-4c16-bc44-22338926e3be admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e0397ff7c539408889a65b743b94e8e9', 'request_id': 'req-11a8ee3e-7c2e-4c16-bc44-22338926e3be'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:56:25.668944 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:56:25.669454 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97077051-2f63-421b-aead-bbb08e2adc6d None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:25.670005 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97077051-2f63-421b-aead-bbb08e2adc6d None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:25.670600 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97077051-2f63-421b-aead-bbb08e2adc6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:25.678983 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-11a8ee3e-7c2e-4c16-bc44-22338926e3be admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e0397ff7c539408889a65b743b94e8e9', 'request_id': 'req-11a8ee3e-7c2e-4c16-bc44-22338926e3be'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:56:25.687704 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-11a8ee3e-7c2e-4c16-bc44-22338926e3be admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e0397ff7c539408889a65b743b94e8e9', 'request_id': 'req-11a8ee3e-7c2e-4c16-bc44-22338926e3be'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:56:25.701423 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-97077051-2f63-421b-aead-bbb08e2adc6d None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:56:25.703308 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-97077051-2f63-421b-aead-bbb08e2adc6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:56:25.706345 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-11a8ee3e-7c2e-4c16-bc44-22338926e3be admin admin] The token cache is being invalidate because project e0397ff7c539408889a65b743b94e8e9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81430) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 07:56:25.706928 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-11a8ee3e-7c2e-4c16-bc44-22338926e3be admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:56:25.707737 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-11a8ee3e-7c2e-4c16-bc44-22338926e3be admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:56:25.709873 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1110/2228] 10.222.0.57 () {58 vars in 1233 bytes} [Fri Sep 16 07:56:25 2022] DELETE /identity/v3/projects/e0397ff7c539408889a65b743b94e8e9 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 07:56:25.713963 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a8ee3e-7c2e-4c16-bc44-22338926e3be admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:56:25.715656 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-11a8ee3e-7c2e-4c16-bc44-22338926e3be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:56:25.809494 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1119/2229] 10.222.0.57 () {58 vars in 958 bytes} [Fri Sep 16 07:56:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 16 07:56:25.821205 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a8ee3e-7c2e-4c16-bc44-22338926e3be admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:56:25.821786 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97077051-2f63-421b-aead-bbb08e2adc6d None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:56:25.823873 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-97077051-2f63-421b-aead-bbb08e2adc6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:56:25.828994 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd7e808-de32-4517-b726-469e54499118 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:56:25.831057 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd7e808-de32-4517-b726-469e54499118 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:25.832314 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd7e808-de32-4517-b726-469e54499118 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:25.833575 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd7e808-de32-4517-b726-469e54499118 admin admin] PATH_INFO: `/v3/users/9fd55d7c6b6f4b3b8e72babea4cf3e06` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:25.835082 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd7e808-de32-4517-b726-469e54499118 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9fd55d7c6b6f4b3b8e72babea4cf3e06)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:56:25.835688 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:56:25.839659 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd7e808-de32-4517-b726-469e54499118 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:56:25.909707 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97077051-2f63-421b-aead-bbb08e2adc6d None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:56:25.914266 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9685141a-fb47-439d-91f6-38d06a746dca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1062e457207a41e4ba4f0a0c4bf36f1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4735f453c0c24cc4a1c14e9ac84a0b46', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:56:25.915308 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9685141a-fb47-439d-91f6-38d06a746dca service neutron] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:25.915940 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9685141a-fb47-439d-91f6-38d06a746dca service neutron] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:25.916428 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9685141a-fb47-439d-91f6-38d06a746dca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:25.921084 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-bbd7e808-de32-4517-b726-469e54499118 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9fd55d7c6b6f4b3b8e72babea4cf3e06'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:56:25.925883 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-bbd7e808-de32-4517-b726-469e54499118 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9fd55d7c6b6f4b3b8e72babea4cf3e06'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:56:25.929140 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9685141a-fb47-439d-91f6-38d06a746dca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:56:25.931045 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9685141a-fb47-439d-91f6-38d06a746dca service neutron] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:56:25.942379 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-bbd7e808-de32-4517-b726-469e54499118 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9fd55d7c6b6f4b3b8e72babea4cf3e06'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:56:25.946569 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1120/2230] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Sep 16 07:56:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 16 07:56:25.957373 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-bbd7e808-de32-4517-b726-469e54499118 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9fd55d7c6b6f4b3b8e72babea4cf3e06'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:56:25.964913 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-bbd7e808-de32-4517-b726-469e54499118 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9fd55d7c6b6f4b3b8e72babea4cf3e06'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:56:25.972257 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1111/2231] 10.222.0.57 () {58 vars in 1224 bytes} [Fri Sep 16 07:56:25 2022] DELETE /identity/v3/users/9fd55d7c6b6f4b3b8e72babea4cf3e06 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 07:56:26.157009 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9685141a-fb47-439d-91f6-38d06a746dca service neutron] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:56:26.158893 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-9685141a-fb47-439d-91f6-38d06a746dca service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:56:26.178106 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9685141a-fb47-439d-91f6-38d06a746dca service neutron] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:56:26.199677 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd7e808-de32-4517-b726-469e54499118 admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:56:26.201235 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-bbd7e808-de32-4517-b726-469e54499118 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:56:26.366450 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bd8470-a36a-42e7-87d3-430eb866fcc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:56:26.367156 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bd8470-a36a-42e7-87d3-430eb866fcc8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:26.367972 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bd8470-a36a-42e7-87d3-430eb866fcc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:26.368169 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bd8470-a36a-42e7-87d3-430eb866fcc8 admin admin] PATH_INFO: `/v3/projects/3b71450e42dc4179b58d10d6ed1881cb` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:26.369375 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bd8470-a36a-42e7-87d3-430eb866fcc8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3b71450e42dc4179b58d10d6ed1881cb)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:56:26.371365 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bd8470-a36a-42e7-87d3-430eb866fcc8 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:56:26.373358 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:INSERT=2,keystone:DELETE=13,keystone:SELECT=85 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:56:26.385889 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd7e808-de32-4517-b726-469e54499118 admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:56:26.396405 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c31f14-eb02-4b69-8990-4b8c0e1720fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:56:26.397172 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c31f14-eb02-4b69-8990-4b8c0e1720fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:26.398706 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c31f14-eb02-4b69-8990-4b8c0e1720fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:26.398706 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c31f14-eb02-4b69-8990-4b8c0e1720fc admin admin] PATH_INFO: `/v3/projects/1f4890f61eee49ada09f6acfe65398af` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:26.400114 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c31f14-eb02-4b69-8990-4b8c0e1720fc admin admin] RBAC: Authorizing `identity:delete_project(project_id=1f4890f61eee49ada09f6acfe65398af)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:56:26.403566 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c31f14-eb02-4b69-8990-4b8c0e1720fc admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:56:26.454965 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-74bd8470-a36a-42e7-87d3-430eb866fcc8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3b71450e42dc4179b58d10d6ed1881cb', 'request_id': 'req-74bd8470-a36a-42e7-87d3-430eb866fcc8'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:56:26.466886 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-74bd8470-a36a-42e7-87d3-430eb866fcc8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3b71450e42dc4179b58d10d6ed1881cb', 'request_id': 'req-74bd8470-a36a-42e7-87d3-430eb866fcc8'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:56:26.476969 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-74bd8470-a36a-42e7-87d3-430eb866fcc8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3b71450e42dc4179b58d10d6ed1881cb', 'request_id': 'req-74bd8470-a36a-42e7-87d3-430eb866fcc8'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:56:26.493321 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-74bd8470-a36a-42e7-87d3-430eb866fcc8 admin admin] The token cache is being invalidate because project 3b71450e42dc4179b58d10d6ed1881cb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81431) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 07:56:26.493937 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-74bd8470-a36a-42e7-87d3-430eb866fcc8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:56:26.494558 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-74bd8470-a36a-42e7-87d3-430eb866fcc8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:56:26.496789 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1121/2232] 10.222.0.57 () {58 vars in 1233 bytes} [Fri Sep 16 07:56:26 2022] DELETE /identity/v3/projects/3b71450e42dc4179b58d10d6ed1881cb => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 07:56:26.502181 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bd8470-a36a-42e7-87d3-430eb866fcc8 admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:56:26.505010 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-74bd8470-a36a-42e7-87d3-430eb866fcc8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:56:26.507024 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-40c31f14-eb02-4b69-8990-4b8c0e1720fc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1f4890f61eee49ada09f6acfe65398af', 'request_id': 'req-40c31f14-eb02-4b69-8990-4b8c0e1720fc'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:56:26.523998 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-40c31f14-eb02-4b69-8990-4b8c0e1720fc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1f4890f61eee49ada09f6acfe65398af', 'request_id': 'req-40c31f14-eb02-4b69-8990-4b8c0e1720fc'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:56:26.536139 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-40c31f14-eb02-4b69-8990-4b8c0e1720fc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1f4890f61eee49ada09f6acfe65398af', 'request_id': 'req-40c31f14-eb02-4b69-8990-4b8c0e1720fc'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:56:26.552155 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-40c31f14-eb02-4b69-8990-4b8c0e1720fc admin admin] The token cache is being invalidate because project 1f4890f61eee49ada09f6acfe65398af was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81430) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 07:56:26.558868 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-40c31f14-eb02-4b69-8990-4b8c0e1720fc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:56:26.560963 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-40c31f14-eb02-4b69-8990-4b8c0e1720fc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:56:26.570718 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1112/2233] 10.222.0.57 () {58 vars in 1233 bytes} [Fri Sep 16 07:56:26 2022] DELETE /identity/v3/projects/1f4890f61eee49ada09f6acfe65398af => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 16 07:56:26.572445 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5276b5f9-9e15-4b04-93d0-ae3a3674e25e None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:26.572735 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5276b5f9-9e15-4b04-93d0-ae3a3674e25e None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:26.572884 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:56:26.573066 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5276b5f9-9e15-4b04-93d0-ae3a3674e25e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:26.607766 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-5276b5f9-9e15-4b04-93d0-ae3a3674e25e None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:56:26.609635 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-5276b5f9-9e15-4b04-93d0-ae3a3674e25e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:56:26.628163 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bd8470-a36a-42e7-87d3-430eb866fcc8 admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:56:26.711797 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89ca731-6644-4687-b8c0-c6ddf8327135 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:56:26.712530 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89ca731-6644-4687-b8c0-c6ddf8327135 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:26.712810 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89ca731-6644-4687-b8c0-c6ddf8327135 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:26.713088 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89ca731-6644-4687-b8c0-c6ddf8327135 admin admin] PATH_INFO: `/v3/users/7ba21595ab7542f29817835accf895ca` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:26.714309 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89ca731-6644-4687-b8c0-c6ddf8327135 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7ba21595ab7542f29817835accf895ca)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:56:26.716226 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89ca731-6644-4687-b8c0-c6ddf8327135 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:56:26.720686 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1113/2234] 10.222.0.57 () {58 vars in 958 bytes} [Fri Sep 16 07:56:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 07:56:26.721844 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5276b5f9-9e15-4b04-93d0-ae3a3674e25e None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:56:26.723155 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-5276b5f9-9e15-4b04-93d0-ae3a3674e25e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:56:26.740293 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5276b5f9-9e15-4b04-93d0-ae3a3674e25e None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:56:26.748195 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29fa335-d41d-4aac-891c-d5e344d5c284 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:56:26.748908 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29fa335-d41d-4aac-891c-d5e344d5c284 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:26.749195 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29fa335-d41d-4aac-891c-d5e344d5c284 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:26.749618 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29fa335-d41d-4aac-891c-d5e344d5c284 admin admin] PATH_INFO: `/v3/projects/cd05ad0616b54c3a9394485de7a9fe42` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:26.751440 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29fa335-d41d-4aac-891c-d5e344d5c284 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cd05ad0616b54c3a9394485de7a9fe42)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:56:26.753582 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29fa335-d41d-4aac-891c-d5e344d5c284 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:56:26.791475 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-f89ca731-6644-4687-b8c0-c6ddf8327135 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7ba21595ab7542f29817835accf895ca'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:56:26.806720 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-f89ca731-6644-4687-b8c0-c6ddf8327135 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7ba21595ab7542f29817835accf895ca'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:56:26.807429 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-f89ca731-6644-4687-b8c0-c6ddf8327135 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7ba21595ab7542f29817835accf895ca'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:56:26.818748 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-a29fa335-d41d-4aac-891c-d5e344d5c284 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cd05ad0616b54c3a9394485de7a9fe42', 'request_id': 'req-a29fa335-d41d-4aac-891c-d5e344d5c284'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:56:26.823964 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-f89ca731-6644-4687-b8c0-c6ddf8327135 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7ba21595ab7542f29817835accf895ca'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:56:26.830890 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-a29fa335-d41d-4aac-891c-d5e344d5c284 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cd05ad0616b54c3a9394485de7a9fe42', 'request_id': 'req-a29fa335-d41d-4aac-891c-d5e344d5c284'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:56:26.835545 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-f89ca731-6644-4687-b8c0-c6ddf8327135 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7ba21595ab7542f29817835accf895ca'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:56:26.838604 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-a29fa335-d41d-4aac-891c-d5e344d5c284 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cd05ad0616b54c3a9394485de7a9fe42', 'request_id': 'req-a29fa335-d41d-4aac-891c-d5e344d5c284'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:56:26.842263 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1122/2235] 10.222.0.57 () {58 vars in 1224 bytes} [Fri Sep 16 07:56:26 2022] DELETE /identity/v3/users/7ba21595ab7542f29817835accf895ca => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 07:56:26.844159 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a69595b-d100-43cc-98db-3dc6613066fd None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:26.844448 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a69595b-d100-43cc-98db-3dc6613066fd None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:26.844725 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a69595b-d100-43cc-98db-3dc6613066fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:26.865669 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-a29fa335-d41d-4aac-891c-d5e344d5c284 admin admin] The token cache is being invalidate because project cd05ad0616b54c3a9394485de7a9fe42 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81430) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 07:56:26.866188 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-a29fa335-d41d-4aac-891c-d5e344d5c284 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:56:26.867000 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-a29fa335-d41d-4aac-891c-d5e344d5c284 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:56:26.869045 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1114/2236] 10.222.0.57 () {58 vars in 1233 bytes} [Fri Sep 16 07:56:26 2022] DELETE /identity/v3/projects/cd05ad0616b54c3a9394485de7a9fe42 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 07:56:26.872956 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-7a69595b-d100-43cc-98db-3dc6613066fd None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:56:26.873413 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29fa335-d41d-4aac-891c-d5e344d5c284 admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:56:26.874673 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-7a69595b-d100-43cc-98db-3dc6613066fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:56:26.876215 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-a29fa335-d41d-4aac-891c-d5e344d5c284 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:56:26.904936 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:56:26.996382 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1123/2237] 10.222.0.57 () {58 vars in 958 bytes} [Fri Sep 16 07:56:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 07:56:26.999687 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29fa335-d41d-4aac-891c-d5e344d5c284 admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:56:27.003349 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a69595b-d100-43cc-98db-3dc6613066fd None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:56:27.013274 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3fb333-b2b1-4591-adb0-c49d5cee87f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:56:27.018266 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a69595b-d100-43cc-98db-3dc6613066fd None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:56:27.019534 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3fb333-b2b1-4591-adb0-c49d5cee87f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:27.020041 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3fb333-b2b1-4591-adb0-c49d5cee87f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:27.021464 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3fb333-b2b1-4591-adb0-c49d5cee87f0 admin admin] PATH_INFO: `/v3/users/640071e00a51420eb3015befa5e36bb1` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:27.026004 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3fb333-b2b1-4591-adb0-c49d5cee87f0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=640071e00a51420eb3015befa5e36bb1)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:56:27.027321 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e78d4e-f522-47f6-af40-138eebe4a600 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:56:27.028072 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e78d4e-f522-47f6-af40-138eebe4a600 admin admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:27.028423 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e78d4e-f522-47f6-af40-138eebe4a600 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:27.028771 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e78d4e-f522-47f6-af40-138eebe4a600 admin admin] PATH_INFO: `/v3/domains` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:27.029162 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3fb333-b2b1-4591-adb0-c49d5cee87f0 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:56:27.029567 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e78d4e-f522-47f6-af40-138eebe4a600 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:56:27.030142 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e78d4e-f522-47f6-af40-138eebe4a600 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:56:27.032744 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e78d4e-f522-47f6-af40-138eebe4a600 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:56:27.034611 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:56:27.056132 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1124/2238] 10.222.0.57 () {58 vars in 1153 bytes} [Fri Sep 16 07:56:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:56:27.060082 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e78d4e-f522-47f6-af40-138eebe4a600 admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:56:27.074820 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e78d4e-f522-47f6-af40-138eebe4a600 admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:56:27.082388 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be7ad1c-a5ab-46f5-a9e5-e2c4299c1946 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:56:27.083003 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be7ad1c-a5ab-46f5-a9e5-e2c4299c1946 admin admin] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:27.083279 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be7ad1c-a5ab-46f5-a9e5-e2c4299c1946 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:27.086088 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be7ad1c-a5ab-46f5-a9e5-e2c4299c1946 admin admin] PATH_INFO: `/v3/projects` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:27.087562 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be7ad1c-a5ab-46f5-a9e5-e2c4299c1946 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:56:27.090064 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be7ad1c-a5ab-46f5-a9e5-e2c4299c1946 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:56:27.138917 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-af3fb333-b2b1-4591-adb0-c49d5cee87f0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '640071e00a51420eb3015befa5e36bb1'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:56:27.141514 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-af3fb333-b2b1-4591-adb0-c49d5cee87f0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '640071e00a51420eb3015befa5e36bb1'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:56:27.159263 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-af3fb333-b2b1-4591-adb0-c49d5cee87f0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '640071e00a51420eb3015befa5e36bb1'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:56:27.168313 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1125/2239] 10.222.0.57 () {60 vars in 1153 bytes} [Fri Sep 16 07:56:27 2022] POST /identity/v3/projects => generated 373 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 16 07:56:27.173690 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be7ad1c-a5ab-46f5-a9e5-e2c4299c1946 admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:56:27.190028 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-3be7ad1c-a5ab-46f5-a9e5-e2c4299c1946 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:56:27.193878 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-af3fb333-b2b1-4591-adb0-c49d5cee87f0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '640071e00a51420eb3015befa5e36bb1'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:56:27.209565 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-af3fb333-b2b1-4591-adb0-c49d5cee87f0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '640071e00a51420eb3015befa5e36bb1'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:56:27.220299 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1115/2240] 10.222.0.57 () {58 vars in 1224 bytes} [Fri Sep 16 07:56:26 2022] DELETE /identity/v3/users/640071e00a51420eb3015befa5e36bb1 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 07:56:27.275041 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be7ad1c-a5ab-46f5-a9e5-e2c4299c1946 admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:56:27.294677 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3fb333-b2b1-4591-adb0-c49d5cee87f0 admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:56:27.296192 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-af3fb333-b2b1-4591-adb0-c49d5cee87f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:56:27.362342 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ce35fb-2e58-419e-b9a8-c6713000c136 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:56:27.363116 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ce35fb-2e58-419e-b9a8-c6713000c136 admin admin] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:27.363281 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ce35fb-2e58-419e-b9a8-c6713000c136 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:27.363515 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ce35fb-2e58-419e-b9a8-c6713000c136 admin admin] PATH_INFO: `/v3/users` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:27.364224 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ce35fb-2e58-419e-b9a8-c6713000c136 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:56:27.366099 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ce35fb-2e58-419e-b9a8-c6713000c136 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:56:27.394987 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3fb333-b2b1-4591-adb0-c49d5cee87f0 admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:56:27.400398 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93832815-98a1-47cf-9835-b93cbf5e092c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:56:27.401280 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93832815-98a1-47cf-9835-b93cbf5e092c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:27.401625 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93832815-98a1-47cf-9835-b93cbf5e092c admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:27.402047 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93832815-98a1-47cf-9835-b93cbf5e092c admin admin] PATH_INFO: `/v3/projects/6b736bf89eeb4f8b810891996c5b0a06` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:27.403270 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93832815-98a1-47cf-9835-b93cbf5e092c admin admin] RBAC: Authorizing `identity:delete_project(project_id=6b736bf89eeb4f8b810891996c5b0a06)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:56:27.405412 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93832815-98a1-47cf-9835-b93cbf5e092c admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:56:27.416197 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1126/2241] 10.222.0.57 () {60 vars in 1144 bytes} [Fri Sep 16 07:56:27 2022] POST /identity/v3/users => generated 287 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 16 07:56:27.422262 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ce35fb-2e58-419e-b9a8-c6713000c136 admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:56:27.435700 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ce35fb-2e58-419e-b9a8-c6713000c136 admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:56:27.444131 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4155a904-5ccd-4d43-b59b-8df046e2bca3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:56:27.444828 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4155a904-5ccd-4d43-b59b-8df046e2bca3 admin admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:27.445173 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4155a904-5ccd-4d43-b59b-8df046e2bca3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:27.445653 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4155a904-5ccd-4d43-b59b-8df046e2bca3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:27.446540 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4155a904-5ccd-4d43-b59b-8df046e2bca3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:56:27.448746 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4155a904-5ccd-4d43-b59b-8df046e2bca3 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:56:27.460673 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:56:27.464600 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1127/2242] 10.222.0.57 () {58 vars in 1122 bytes} [Fri Sep 16 07:56:27 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 07:56:27.469224 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4155a904-5ccd-4d43-b59b-8df046e2bca3 admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:56:27.489687 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4155a904-5ccd-4d43-b59b-8df046e2bca3 admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:56:27.491637 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-93832815-98a1-47cf-9835-b93cbf5e092c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6b736bf89eeb4f8b810891996c5b0a06', 'request_id': 'req-93832815-98a1-47cf-9835-b93cbf5e092c'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:56:27.517504 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-93832815-98a1-47cf-9835-b93cbf5e092c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6b736bf89eeb4f8b810891996c5b0a06', 'request_id': 'req-93832815-98a1-47cf-9835-b93cbf5e092c'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:56:27.529195 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-93832815-98a1-47cf-9835-b93cbf5e092c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6b736bf89eeb4f8b810891996c5b0a06', 'request_id': 'req-93832815-98a1-47cf-9835-b93cbf5e092c'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:56:27.546493 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-93832815-98a1-47cf-9835-b93cbf5e092c admin admin] The token cache is being invalidate because project 6b736bf89eeb4f8b810891996c5b0a06 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81430) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 07:56:27.547396 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-93832815-98a1-47cf-9835-b93cbf5e092c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:56:27.548100 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-93832815-98a1-47cf-9835-b93cbf5e092c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:56:27.553787 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1116/2243] 10.222.0.57 () {58 vars in 1233 bytes} [Fri Sep 16 07:56:27 2022] DELETE /identity/v3/projects/6b736bf89eeb4f8b810891996c5b0a06 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 07:56:27.558230 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93832815-98a1-47cf-9835-b93cbf5e092c admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:56:27.565026 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-93832815-98a1-47cf-9835-b93cbf5e092c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:56:27.616507 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:56:27.626347 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408579b3-65e8-4ca7-b159-f2fa43646e4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:56:27.627140 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408579b3-65e8-4ca7-b159-f2fa43646e4a admin admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:27.627482 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408579b3-65e8-4ca7-b159-f2fa43646e4a admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:27.627790 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408579b3-65e8-4ca7-b159-f2fa43646e4a admin admin] PATH_INFO: `/v3/roles` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:27.628482 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408579b3-65e8-4ca7-b159-f2fa43646e4a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:56:27.630427 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408579b3-65e8-4ca7-b159-f2fa43646e4a admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:56:27.662443 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1128/2244] 10.222.0.57 () {58 vars in 1122 bytes} [Fri Sep 16 07:56:27 2022] GET /identity/v3/roles => generated 1420 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 07:56:27.662443 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408579b3-65e8-4ca7-b159-f2fa43646e4a admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:56:27.664614 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-408579b3-65e8-4ca7-b159-f2fa43646e4a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:56:27.680596 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408579b3-65e8-4ca7-b159-f2fa43646e4a admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:56:27.686389 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d480cc4-21ba-4b25-9186-333702e5fa6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:56:27.687441 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d480cc4-21ba-4b25-9186-333702e5fa6d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:27.687723 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d480cc4-21ba-4b25-9186-333702e5fa6d admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:27.687992 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d480cc4-21ba-4b25-9186-333702e5fa6d admin admin] PATH_INFO: `/v3/projects/d146cffa2edd46419cc2ed21057bec5f` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:27.689268 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d480cc4-21ba-4b25-9186-333702e5fa6d admin admin] RBAC: Authorizing `identity:delete_project(project_id=d146cffa2edd46419cc2ed21057bec5f)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:56:27.691246 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d480cc4-21ba-4b25-9186-333702e5fa6d admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:56:27.700061 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93832815-98a1-47cf-9835-b93cbf5e092c admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:56:27.706500 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98fb54e-f223-4be3-8e9a-9913db398ddb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:56:27.707140 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98fb54e-f223-4be3-8e9a-9913db398ddb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:27.707424 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98fb54e-f223-4be3-8e9a-9913db398ddb admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:27.707707 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98fb54e-f223-4be3-8e9a-9913db398ddb admin admin] PATH_INFO: `/v3/users/1a76bd08cb3a4303b600dd6d508fe6fd` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:27.708850 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98fb54e-f223-4be3-8e9a-9913db398ddb admin admin] RBAC: Authorizing `identity:delete_user(user_id=1a76bd08cb3a4303b600dd6d508fe6fd)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:56:27.711837 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98fb54e-f223-4be3-8e9a-9913db398ddb admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:56:27.753021 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-0d480cc4-21ba-4b25-9186-333702e5fa6d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd146cffa2edd46419cc2ed21057bec5f', 'request_id': 'req-0d480cc4-21ba-4b25-9186-333702e5fa6d'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:56:27.760236 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-0d480cc4-21ba-4b25-9186-333702e5fa6d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd146cffa2edd46419cc2ed21057bec5f', 'request_id': 'req-0d480cc4-21ba-4b25-9186-333702e5fa6d'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:56:27.767638 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-c98fb54e-f223-4be3-8e9a-9913db398ddb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1a76bd08cb3a4303b600dd6d508fe6fd'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:56:27.768114 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-c98fb54e-f223-4be3-8e9a-9913db398ddb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1a76bd08cb3a4303b600dd6d508fe6fd'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:56:27.769133 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-0d480cc4-21ba-4b25-9186-333702e5fa6d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd146cffa2edd46419cc2ed21057bec5f', 'request_id': 'req-0d480cc4-21ba-4b25-9186-333702e5fa6d'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:56:27.776713 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-c98fb54e-f223-4be3-8e9a-9913db398ddb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1a76bd08cb3a4303b600dd6d508fe6fd'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:56:27.782806 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-0d480cc4-21ba-4b25-9186-333702e5fa6d admin admin] The token cache is being invalidate because project d146cffa2edd46419cc2ed21057bec5f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81431) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 07:56:27.783163 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-0d480cc4-21ba-4b25-9186-333702e5fa6d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:56:27.783890 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-0d480cc4-21ba-4b25-9186-333702e5fa6d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:56:27.786185 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1129/2245] 10.222.0.57 () {58 vars in 1233 bytes} [Fri Sep 16 07:56:27 2022] DELETE /identity/v3/projects/d146cffa2edd46419cc2ed21057bec5f => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 07:56:27.787182 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d480cc4-21ba-4b25-9186-333702e5fa6d admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:56:27.788947 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-0d480cc4-21ba-4b25-9186-333702e5fa6d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:56:27.794366 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-c98fb54e-f223-4be3-8e9a-9913db398ddb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1a76bd08cb3a4303b600dd6d508fe6fd'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:56:27.802804 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-c98fb54e-f223-4be3-8e9a-9913db398ddb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1a76bd08cb3a4303b600dd6d508fe6fd'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:56:27.811584 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1117/2246] 10.222.0.57 () {58 vars in 1224 bytes} [Fri Sep 16 07:56:27 2022] DELETE /identity/v3/users/1a76bd08cb3a4303b600dd6d508fe6fd => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 07:56:27.813053 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98fb54e-f223-4be3-8e9a-9913db398ddb admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:56:27.818861 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-c98fb54e-f223-4be3-8e9a-9913db398ddb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:56:27.886302 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:56:27.923140 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98fb54e-f223-4be3-8e9a-9913db398ddb admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:56:27.927121 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d480cc4-21ba-4b25-9186-333702e5fa6d admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:56:27.932092 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a9f7ee-6357-491f-84de-085971932952 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:56:27.933027 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a9f7ee-6357-491f-84de-085971932952 admin admin] REQUEST_METHOD: `PUT` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:27.933356 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a9f7ee-6357-491f-84de-085971932952 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:27.933836 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a9f7ee-6357-491f-84de-085971932952 admin admin] PATH_INFO: `/v3/projects/0c67add2448e4ca195f569eef789d0e7/users/75980abad269461aba51fd6387d0147e/roles/4818d38cf2564825b312e66c9eb24762` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:27.938662 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6adc66-0869-4b50-8cf1-19783e410685 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:56:27.939384 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6adc66-0869-4b50-8cf1-19783e410685 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:27.939667 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6adc66-0869-4b50-8cf1-19783e410685 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:27.940010 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6adc66-0869-4b50-8cf1-19783e410685 admin admin] PATH_INFO: `/v3/users/8ceec9b6ae744e07ab5fd21db24bce71` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:27.941285 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6adc66-0869-4b50-8cf1-19783e410685 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8ceec9b6ae744e07ab5fd21db24bce71)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:56:27.944160 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6adc66-0869-4b50-8cf1-19783e410685 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:56:27.958263 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a9f7ee-6357-491f-84de-085971932952 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0c67add2448e4ca195f569eef789d0e7, user_id=75980abad269461aba51fd6387d0147e, role_id=4818d38cf2564825b312e66c9eb24762)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:56:27.962161 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a9f7ee-6357-491f-84de-085971932952 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:56:27.981772 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1130/2247] 10.222.0.57 () {60 vars in 1483 bytes} [Fri Sep 16 07:56:27 2022] PUT /identity/v3/projects/0c67add2448e4ca195f569eef789d0e7/users/75980abad269461aba51fd6387d0147e/roles/4818d38cf2564825b312e66c9eb24762 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 07:56:27.992126 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d25d11-fd1e-4b5b-af6b-2ccc440d037f None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:27.992872 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d25d11-fd1e-4b5b-af6b-2ccc440d037f None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:27.993205 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d25d11-fd1e-4b5b-af6b-2ccc440d037f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:28.019101 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-6b6adc66-0869-4b50-8cf1-19783e410685 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8ceec9b6ae744e07ab5fd21db24bce71'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:56:28.020115 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-6b6adc66-0869-4b50-8cf1-19783e410685 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8ceec9b6ae744e07ab5fd21db24bce71'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:56:28.034570 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-6b6adc66-0869-4b50-8cf1-19783e410685 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8ceec9b6ae744e07ab5fd21db24bce71'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:56:28.036630 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-d9d25d11-fd1e-4b5b-af6b-2ccc440d037f None None] MFA Rules not processed for user `75980abad269461aba51fd6387d0147e`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:56:28.038035 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-d9d25d11-fd1e-4b5b-af6b-2ccc440d037f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:56:28.050782 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-6b6adc66-0869-4b50-8cf1-19783e410685 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8ceec9b6ae744e07ab5fd21db24bce71'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:56:28.058887 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-6b6adc66-0869-4b50-8cf1-19783e410685 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8ceec9b6ae744e07ab5fd21db24bce71'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:56:28.065784 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1118/2248] 10.222.0.57 () {58 vars in 1224 bytes} [Fri Sep 16 07:56:27 2022] DELETE /identity/v3/users/8ceec9b6ae744e07ab5fd21db24bce71 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 07:56:28.095024 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:56:28.123131 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1131/2249] 10.222.0.57 () {58 vars in 958 bytes} [Fri Sep 16 07:56:27 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 07:56:28.128948 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6adc66-0869-4b50-8cf1-19783e410685 admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:56:28.130885 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-6b6adc66-0869-4b50-8cf1-19783e410685 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:56:28.176337 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d25d11-fd1e-4b5b-af6b-2ccc440d037f None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:56:28.178045 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-d9d25d11-fd1e-4b5b-af6b-2ccc440d037f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:56:28.246186 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6adc66-0869-4b50-8cf1-19783e410685 admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:56:28.271221 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3361a298-a7a0-4261-9f30-19ae2e8a4e76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:56:28.271852 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3361a298-a7a0-4261-9f30-19ae2e8a4e76 admin admin] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:28.272138 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3361a298-a7a0-4261-9f30-19ae2e8a4e76 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:28.272417 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3361a298-a7a0-4261-9f30-19ae2e8a4e76 admin admin] PATH_INFO: `/v3/projects` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:28.274467 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3361a298-a7a0-4261-9f30-19ae2e8a4e76 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:56:28.276310 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3361a298-a7a0-4261-9f30-19ae2e8a4e76 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:56:28.302391 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d25d11-fd1e-4b5b-af6b-2ccc440d037f None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:56:28.320682 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf79204c-1b9f-49fc-a9e3-70e51b4220aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:56:28.321673 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf79204c-1b9f-49fc-a9e3-70e51b4220aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:28.321673 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf79204c-1b9f-49fc-a9e3-70e51b4220aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:28.323753 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf79204c-1b9f-49fc-a9e3-70e51b4220aa admin admin] PATH_INFO: `/v3/projects/ce9822ca1e20424f83b2b00811134383` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:28.327999 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf79204c-1b9f-49fc-a9e3-70e51b4220aa admin admin] RBAC: Authorizing `identity:delete_project(project_id=ce9822ca1e20424f83b2b00811134383)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:56:28.328156 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf79204c-1b9f-49fc-a9e3-70e51b4220aa admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:56:28.351870 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1119/2250] 10.222.0.57 () {60 vars in 1153 bytes} [Fri Sep 16 07:56:28 2022] POST /identity/v3/projects => generated 373 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 07:56:28.357019 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3361a298-a7a0-4261-9f30-19ae2e8a4e76 admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:56:28.438101 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:56:28.451912 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-cf79204c-1b9f-49fc-a9e3-70e51b4220aa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ce9822ca1e20424f83b2b00811134383', 'request_id': 'req-cf79204c-1b9f-49fc-a9e3-70e51b4220aa'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:56:28.463274 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-cf79204c-1b9f-49fc-a9e3-70e51b4220aa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ce9822ca1e20424f83b2b00811134383', 'request_id': 'req-cf79204c-1b9f-49fc-a9e3-70e51b4220aa'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:56:28.474626 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-cf79204c-1b9f-49fc-a9e3-70e51b4220aa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ce9822ca1e20424f83b2b00811134383', 'request_id': 'req-cf79204c-1b9f-49fc-a9e3-70e51b4220aa'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:56:28.476845 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3361a298-a7a0-4261-9f30-19ae2e8a4e76 admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:56:28.499642 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-cf79204c-1b9f-49fc-a9e3-70e51b4220aa admin admin] The token cache is being invalidate because project ce9822ca1e20424f83b2b00811134383 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81431) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 07:56:28.500069 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-cf79204c-1b9f-49fc-a9e3-70e51b4220aa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:56:28.501130 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-cf79204c-1b9f-49fc-a9e3-70e51b4220aa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:56:28.503160 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1132/2251] 10.222.0.57 () {58 vars in 1233 bytes} [Fri Sep 16 07:56:28 2022] DELETE /identity/v3/projects/ce9822ca1e20424f83b2b00811134383 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 07:56:28.508455 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615eeec4-3881-4f7b-948f-c8000c739ccd None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:28.513976 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615eeec4-3881-4f7b-948f-c8000c739ccd None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:28.514352 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615eeec4-3881-4f7b-948f-c8000c739ccd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:28.551857 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-615eeec4-3881-4f7b-948f-c8000c739ccd None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:56:28.553139 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-615eeec4-3881-4f7b-948f-c8000c739ccd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:56:28.575139 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f1c05e-cb68-4a4b-aa24-8c0111625a1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:56:28.575982 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f1c05e-cb68-4a4b-aa24-8c0111625a1b admin admin] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:28.576188 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f1c05e-cb68-4a4b-aa24-8c0111625a1b admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:28.577055 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f1c05e-cb68-4a4b-aa24-8c0111625a1b admin admin] PATH_INFO: `/v3/users` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:28.578254 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f1c05e-cb68-4a4b-aa24-8c0111625a1b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:56:28.580373 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f1c05e-cb68-4a4b-aa24-8c0111625a1b admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:56:28.603603 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1120/2252] 10.222.0.57 () {60 vars in 1144 bytes} [Fri Sep 16 07:56:28 2022] POST /identity/v3/users => generated 293 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 16 07:56:28.604407 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f1c05e-cb68-4a4b-aa24-8c0111625a1b admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:56:28.606355 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-30f1c05e-cb68-4a4b-aa24-8c0111625a1b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:56:28.618783 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f1c05e-cb68-4a4b-aa24-8c0111625a1b admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:56:28.621792 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1133/2253] 10.222.0.57 () {58 vars in 958 bytes} [Fri Sep 16 07:56:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 07:56:28.622178 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615eeec4-3881-4f7b-948f-c8000c739ccd None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:56:28.623529 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-615eeec4-3881-4f7b-948f-c8000c739ccd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:56:28.627525 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0532f2-5b24-4927-99a4-f6be8c128d26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:56:28.628244 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0532f2-5b24-4927-99a4-f6be8c128d26 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:28.628597 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0532f2-5b24-4927-99a4-f6be8c128d26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:28.628895 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0532f2-5b24-4927-99a4-f6be8c128d26 admin admin] PATH_INFO: `/v3/projects/363bf96a91894a5f8cb4a70c0b064a10` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:28.630047 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0532f2-5b24-4927-99a4-f6be8c128d26 admin admin] RBAC: Authorizing `identity:delete_project(project_id=363bf96a91894a5f8cb4a70c0b064a10)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:56:28.631951 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0532f2-5b24-4927-99a4-f6be8c128d26 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:56:28.635378 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615eeec4-3881-4f7b-948f-c8000c739ccd None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:56:28.640929 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9c833f-0417-42f3-b765-973e5ef30054 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:56:28.641537 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9c833f-0417-42f3-b765-973e5ef30054 admin admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:28.642213 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9c833f-0417-42f3-b765-973e5ef30054 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:28.642213 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9c833f-0417-42f3-b765-973e5ef30054 admin admin] PATH_INFO: `/v3/roles` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:28.642725 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9c833f-0417-42f3-b765-973e5ef30054 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:56:28.644320 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9c833f-0417-42f3-b765-973e5ef30054 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:56:28.654610 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1134/2254] 10.222.0.57 () {58 vars in 1122 bytes} [Fri Sep 16 07:56:28 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 07:56:28.656724 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19af683b-8802-4f54-a593-52b697ffe641 None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:28.657011 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19af683b-8802-4f54-a593-52b697ffe641 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:28.657284 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19af683b-8802-4f54-a593-52b697ffe641 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:28.677386 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-19af683b-8802-4f54-a593-52b697ffe641 None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:56:28.678654 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-19af683b-8802-4f54-a593-52b697ffe641 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:56:28.683819 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:56:28.693981 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-ff0532f2-5b24-4927-99a4-f6be8c128d26 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '363bf96a91894a5f8cb4a70c0b064a10', 'request_id': 'req-ff0532f2-5b24-4927-99a4-f6be8c128d26'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:56:28.702166 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-ff0532f2-5b24-4927-99a4-f6be8c128d26 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '363bf96a91894a5f8cb4a70c0b064a10', 'request_id': 'req-ff0532f2-5b24-4927-99a4-f6be8c128d26'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:56:28.709865 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-ff0532f2-5b24-4927-99a4-f6be8c128d26 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '363bf96a91894a5f8cb4a70c0b064a10', 'request_id': 'req-ff0532f2-5b24-4927-99a4-f6be8c128d26'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:56:28.727269 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-ff0532f2-5b24-4927-99a4-f6be8c128d26 admin admin] The token cache is being invalidate because project 363bf96a91894a5f8cb4a70c0b064a10 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81430) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 07:56:28.727561 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-ff0532f2-5b24-4927-99a4-f6be8c128d26 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:56:28.728664 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-ff0532f2-5b24-4927-99a4-f6be8c128d26 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:56:28.730341 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1121/2255] 10.222.0.57 () {58 vars in 1233 bytes} [Fri Sep 16 07:56:28 2022] DELETE /identity/v3/projects/363bf96a91894a5f8cb4a70c0b064a10 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 07:56:28.731198 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0532f2-5b24-4927-99a4-f6be8c128d26 admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:56:28.732826 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-ff0532f2-5b24-4927-99a4-f6be8c128d26 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:56:28.770503 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1135/2256] 10.222.0.57 () {58 vars in 958 bytes} [Fri Sep 16 07:56:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 07:56:28.772072 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f314db-45e9-4dd8-84f5-462412b97cb2 None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:28.772554 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f314db-45e9-4dd8-84f5-462412b97cb2 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:28.772830 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f314db-45e9-4dd8-84f5-462412b97cb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:28.793541 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-c6f314db-45e9-4dd8-84f5-462412b97cb2 None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:56:28.795508 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-c6f314db-45e9-4dd8-84f5-462412b97cb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:56:28.803364 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0532f2-5b24-4927-99a4-f6be8c128d26 admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:56:28.804910 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1136/2257] 10.222.0.57 () {58 vars in 958 bytes} [Fri Sep 16 07:56:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 07:56:28.805786 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f314db-45e9-4dd8-84f5-462412b97cb2 None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:56:28.808305 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfa2fd5-3857-413e-885c-2b00d97a219a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:56:28.808973 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfa2fd5-3857-413e-885c-2b00d97a219a admin admin] REQUEST_METHOD: `PUT` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:28.809260 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfa2fd5-3857-413e-885c-2b00d97a219a admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:28.809530 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfa2fd5-3857-413e-885c-2b00d97a219a admin admin] PATH_INFO: `/v3/projects/38afdc8f944844ab94c82617b7c8a035/users/62655d0e639e4397b1e1dc7d50b1df9b/roles/567db03c91854ad9af1e9a87ec1bd275` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:28.820887 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:56:28.822980 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f314db-45e9-4dd8-84f5-462412b97cb2 None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:56:28.827246 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcfa2fd5-3857-413e-885c-2b00d97a219a admin admin] RBAC: Authorizing `identity:create_grant(project_id=38afdc8f944844ab94c82617b7c8a035, user_id=62655d0e639e4397b1e1dc7d50b1df9b, role_id=567db03c91854ad9af1e9a87ec1bd275)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:56:28.830052 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526837a1-54b2-4916-baf0-32a42b440177 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:56:28.830714 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526837a1-54b2-4916-baf0-32a42b440177 admin admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:28.830998 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526837a1-54b2-4916-baf0-32a42b440177 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:28.831141 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcfa2fd5-3857-413e-885c-2b00d97a219a admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:56:28.831278 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526837a1-54b2-4916-baf0-32a42b440177 admin admin] PATH_INFO: `/v3/domains` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:28.831924 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526837a1-54b2-4916-baf0-32a42b440177 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:56:28.832228 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526837a1-54b2-4916-baf0-32a42b440177 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:56:28.833831 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526837a1-54b2-4916-baf0-32a42b440177 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:56:28.846673 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1122/2258] 10.222.0.57 () {60 vars in 1483 bytes} [Fri Sep 16 07:56:28 2022] PUT /identity/v3/projects/38afdc8f944844ab94c82617b7c8a035/users/62655d0e639e4397b1e1dc7d50b1df9b/roles/567db03c91854ad9af1e9a87ec1bd275 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 07:56:28.851725 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00bc695-cd8a-4208-9a0c-e294f945ced4 None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:28.851860 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1137/2259] 10.222.0.57 () {58 vars in 1153 bytes} [Fri Sep 16 07:56:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:56:28.851982 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00bc695-cd8a-4208-9a0c-e294f945ced4 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:28.851982 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00bc695-cd8a-4208-9a0c-e294f945ced4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:28.852142 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526837a1-54b2-4916-baf0-32a42b440177 admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:56:28.861098 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526837a1-54b2-4916-baf0-32a42b440177 admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:56:28.868024 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-d00bc695-cd8a-4208-9a0c-e294f945ced4 None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:56:28.869217 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-d00bc695-cd8a-4208-9a0c-e294f945ced4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:56:28.931999 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70b3398-82fa-40b2-b9c5-b4356be77f06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:56:28.932896 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70b3398-82fa-40b2-b9c5-b4356be77f06 admin admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:28.933175 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70b3398-82fa-40b2-b9c5-b4356be77f06 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:28.933449 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70b3398-82fa-40b2-b9c5-b4356be77f06 admin admin] PATH_INFO: `/v3/roles` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:28.934127 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70b3398-82fa-40b2-b9c5-b4356be77f06 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:56:28.935802 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70b3398-82fa-40b2-b9c5-b4356be77f06 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:56:28.938785 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1123/2260] 10.222.0.57 () {58 vars in 958 bytes} [Fri Sep 16 07:56:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 07:56:28.939735 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00bc695-cd8a-4208-9a0c-e294f945ced4 None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:56:28.952464 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1138/2261] 10.222.0.57 () {58 vars in 1122 bytes} [Fri Sep 16 07:56:28 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 16 07:56:28.952464 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70b3398-82fa-40b2-b9c5-b4356be77f06 admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:56:28.953269 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00bc695-cd8a-4208-9a0c-e294f945ced4 None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:56:28.957589 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be28e805-eee0-4510-990c-693f7e610efc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:56:28.958407 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be28e805-eee0-4510-990c-693f7e610efc admin admin] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:28.958604 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be28e805-eee0-4510-990c-693f7e610efc admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:28.958875 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be28e805-eee0-4510-990c-693f7e610efc admin admin] PATH_INFO: `/v3/projects` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:28.959506 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be28e805-eee0-4510-990c-693f7e610efc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:56:28.961398 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be28e805-eee0-4510-990c-693f7e610efc admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:56:28.964084 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70b3398-82fa-40b2-b9c5-b4356be77f06 admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:56:28.969972 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adb3fbe-3f6b-4444-9c9b-3d9b09f152a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:56:28.970676 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adb3fbe-3f6b-4444-9c9b-3d9b09f152a4 admin admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:28.971027 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adb3fbe-3f6b-4444-9c9b-3d9b09f152a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:28.971372 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adb3fbe-3f6b-4444-9c9b-3d9b09f152a4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:28.972551 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0adb3fbe-3f6b-4444-9c9b-3d9b09f152a4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:56:28.972954 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0adb3fbe-3f6b-4444-9c9b-3d9b09f152a4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:56:28.974660 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0adb3fbe-3f6b-4444-9c9b-3d9b09f152a4 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:56:28.992809 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1139/2262] 10.222.0.57 () {58 vars in 1153 bytes} [Fri Sep 16 07:56:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:56:28.992809 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adb3fbe-3f6b-4444-9c9b-3d9b09f152a4 admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:56:28.998253 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1124/2263] 10.222.0.57 () {60 vars in 1153 bytes} [Fri Sep 16 07:56:28 2022] POST /identity/v3/projects => generated 373 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 07:56:29.001417 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adb3fbe-3f6b-4444-9c9b-3d9b09f152a4 admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:56:29.002843 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be28e805-eee0-4510-990c-693f7e610efc admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:56:29.086326 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a4c5c9-a7a7-40b1-9dfa-0b5f8f129687 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:56:29.087872 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be28e805-eee0-4510-990c-693f7e610efc admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:56:29.088927 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a4c5c9-a7a7-40b1-9dfa-0b5f8f129687 admin admin] REQUEST_METHOD: `PUT` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:29.089273 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a4c5c9-a7a7-40b1-9dfa-0b5f8f129687 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:29.089942 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a4c5c9-a7a7-40b1-9dfa-0b5f8f129687 admin admin] PATH_INFO: `/v3/projects/38afdc8f944844ab94c82617b7c8a035/users/62655d0e639e4397b1e1dc7d50b1df9b/roles/567db03c91854ad9af1e9a87ec1bd275` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:29.092561 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a4c5c9-a7a7-40b1-9dfa-0b5f8f129687 admin admin] RBAC: Authorizing `identity:create_grant(project_id=38afdc8f944844ab94c82617b7c8a035, user_id=62655d0e639e4397b1e1dc7d50b1df9b, role_id=567db03c91854ad9af1e9a87ec1bd275)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:56:29.093124 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c8245a-a8b8-4327-9b7f-fedb55940c56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:56:29.093878 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c8245a-a8b8-4327-9b7f-fedb55940c56 admin admin] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:29.094351 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c8245a-a8b8-4327-9b7f-fedb55940c56 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:29.094680 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c8245a-a8b8-4327-9b7f-fedb55940c56 admin admin] PATH_INFO: `/v3/projects` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:29.095410 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c8245a-a8b8-4327-9b7f-fedb55940c56 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:56:29.096388 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a4c5c9-a7a7-40b1-9dfa-0b5f8f129687 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:56:29.097371 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c8245a-a8b8-4327-9b7f-fedb55940c56 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:56:29.116653 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1140/2264] 10.222.0.57 () {60 vars in 1483 bytes} [Fri Sep 16 07:56:28 2022] PUT /identity/v3/projects/38afdc8f944844ab94c82617b7c8a035/users/62655d0e639e4397b1e1dc7d50b1df9b/roles/567db03c91854ad9af1e9a87ec1bd275 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 07:56:29.117800 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a4c5c9-a7a7-40b1-9dfa-0b5f8f129687 admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:56:29.127427 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:56:29.142853 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1125/2265] 10.222.0.57 () {60 vars in 1153 bytes} [Fri Sep 16 07:56:29 2022] POST /identity/v3/projects => generated 361 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 07:56:29.142853 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f13769-cdf5-41e0-83d1-263db7251804 None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:29.142853 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f13769-cdf5-41e0-83d1-263db7251804 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:29.142853 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f13769-cdf5-41e0-83d1-263db7251804 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:29.175018 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-87f13769-cdf5-41e0-83d1-263db7251804 None None] MFA Rules not processed for user `62655d0e639e4397b1e1dc7d50b1df9b`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:56:29.176226 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-87f13769-cdf5-41e0-83d1-263db7251804 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:56:29.198568 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a4c5c9-a7a7-40b1-9dfa-0b5f8f129687 admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:56:29.220961 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:56:29.255449 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1126/2266] 10.222.0.57 () {58 vars in 958 bytes} [Fri Sep 16 07:56:29 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 07:56:29.260152 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f13769-cdf5-41e0-83d1-263db7251804 None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:56:29.263028 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ac5761-1fe8-4824-854b-ca3d61f268a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:56:29.263846 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ac5761-1fe8-4824-854b-ca3d61f268a0 admin admin] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:29.263972 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ac5761-1fe8-4824-854b-ca3d61f268a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:29.264153 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ac5761-1fe8-4824-854b-ca3d61f268a0 admin admin] PATH_INFO: `/v3/users` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:29.264781 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ac5761-1fe8-4824-854b-ca3d61f268a0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:56:29.267738 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ac5761-1fe8-4824-854b-ca3d61f268a0 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:56:29.289921 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1141/2267] 10.222.0.57 () {60 vars in 1144 bytes} [Fri Sep 16 07:56:29 2022] POST /identity/v3/users => generated 287 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 07:56:29.290927 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ac5761-1fe8-4824-854b-ca3d61f268a0 admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:56:29.293524 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-16ac5761-1fe8-4824-854b-ca3d61f268a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:56:29.326363 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f13769-cdf5-41e0-83d1-263db7251804 None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:56:29.331950 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05acaed-e0cd-49a7-ba77-ee720a87140c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:56:29.332581 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05acaed-e0cd-49a7-ba77-ee720a87140c admin admin] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:29.332861 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05acaed-e0cd-49a7-ba77-ee720a87140c admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:29.333131 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05acaed-e0cd-49a7-ba77-ee720a87140c admin admin] PATH_INFO: `/v3/users` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:29.333802 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05acaed-e0cd-49a7-ba77-ee720a87140c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:56:29.335749 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05acaed-e0cd-49a7-ba77-ee720a87140c admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:56:29.354206 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ac5761-1fe8-4824-854b-ca3d61f268a0 admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:56:29.359134 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88187d86-9f98-462c-92e1-52ca171b658f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544bf6be4c24454a013ca110c43cef2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4735f453c0c24cc4a1c14e9ac84a0b46', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:56:29.360002 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88187d86-9f98-462c-92e1-52ca171b658f service cinder] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:29.360344 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88187d86-9f98-462c-92e1-52ca171b658f service cinder] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:29.360615 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88187d86-9f98-462c-92e1-52ca171b658f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:29.360992 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1127/2268] 10.222.0.57 () {60 vars in 1144 bytes} [Fri Sep 16 07:56:29 2022] POST /identity/v3/users => generated 281 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 07:56:29.361902 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05acaed-e0cd-49a7-ba77-ee720a87140c admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:56:29.371475 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88187d86-9f98-462c-92e1-52ca171b658f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:56:29.371759 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05acaed-e0cd-49a7-ba77-ee720a87140c admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:56:29.373024 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88187d86-9f98-462c-92e1-52ca171b658f service cinder] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:56:29.377562 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba04b323-80db-4c6a-9396-06d307412795 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:56:29.378207 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba04b323-80db-4c6a-9396-06d307412795 admin admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:29.378475 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba04b323-80db-4c6a-9396-06d307412795 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:29.378747 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba04b323-80db-4c6a-9396-06d307412795 admin admin] PATH_INFO: `/v3/roles` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:29.379418 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba04b323-80db-4c6a-9396-06d307412795 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:56:29.381008 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba04b323-80db-4c6a-9396-06d307412795 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:56:29.384118 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1142/2269] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Sep 16 07:56:29 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 07:56:29.384922 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88187d86-9f98-462c-92e1-52ca171b658f service cinder] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:56:29.394603 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1128/2270] 10.222.0.57 () {58 vars in 1122 bytes} [Fri Sep 16 07:56:29 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 07:56:29.398687 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88187d86-9f98-462c-92e1-52ca171b658f service cinder] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:56:29.398880 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba04b323-80db-4c6a-9396-06d307412795 admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:56:29.403590 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e146a6-9c91-4019-baf2-b2cf3ee00468 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:56:29.404341 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e146a6-9c91-4019-baf2-b2cf3ee00468 admin admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:29.404474 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e146a6-9c91-4019-baf2-b2cf3ee00468 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:29.404743 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e146a6-9c91-4019-baf2-b2cf3ee00468 admin admin] PATH_INFO: `/v3/roles` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:29.406452 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e146a6-9c91-4019-baf2-b2cf3ee00468 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:56:29.408506 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e146a6-9c91-4019-baf2-b2cf3ee00468 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:56:29.411083 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba04b323-80db-4c6a-9396-06d307412795 admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:56:29.418058 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402168ee-198c-49e4-95a4-c5b8c0802d2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:56:29.418858 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402168ee-198c-49e4-95a4-c5b8c0802d2c admin admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:29.419110 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402168ee-198c-49e4-95a4-c5b8c0802d2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:29.419901 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402168ee-198c-49e4-95a4-c5b8c0802d2c admin admin] PATH_INFO: `/v3/roles` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:29.429518 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402168ee-198c-49e4-95a4-c5b8c0802d2c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:56:29.429983 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1143/2271] 10.222.0.57 () {58 vars in 1122 bytes} [Fri Sep 16 07:56:29 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 07:56:29.430084 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402168ee-198c-49e4-95a4-c5b8c0802d2c admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:56:29.432340 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e146a6-9c91-4019-baf2-b2cf3ee00468 admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:56:29.435166 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1129/2272] 10.222.0.57 () {58 vars in 1122 bytes} [Fri Sep 16 07:56:29 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 07:56:29.440350 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402168ee-198c-49e4-95a4-c5b8c0802d2c admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:56:29.444652 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e146a6-9c91-4019-baf2-b2cf3ee00468 admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:56:29.449889 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56a8b0d-bd41-45e0-a81b-8264cf58b0e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:56:29.450710 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56a8b0d-bd41-45e0-a81b-8264cf58b0e6 admin admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:29.451051 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56a8b0d-bd41-45e0-a81b-8264cf58b0e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:29.451310 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56a8b0d-bd41-45e0-a81b-8264cf58b0e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:29.451928 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402168ee-198c-49e4-95a4-c5b8c0802d2c admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:56:29.452055 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56a8b0d-bd41-45e0-a81b-8264cf58b0e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:56:29.454204 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56a8b0d-bd41-45e0-a81b-8264cf58b0e6 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:56:29.463422 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f4613e-9855-4e21-b65e-c29df9d97087 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:56:29.464112 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f4613e-9855-4e21-b65e-c29df9d97087 admin admin] REQUEST_METHOD: `PUT` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:29.464390 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f4613e-9855-4e21-b65e-c29df9d97087 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:29.464661 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f4613e-9855-4e21-b65e-c29df9d97087 admin admin] PATH_INFO: `/v3/projects/65db6ec3249b4c778f0c0c3207d65253/users/ed7a1886d2184619bb493de128365fa2/roles/4818d38cf2564825b312e66c9eb24762` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:29.469865 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1144/2273] 10.222.0.57 () {58 vars in 1122 bytes} [Fri Sep 16 07:56:29 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 07:56:29.478842 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56a8b0d-bd41-45e0-a81b-8264cf58b0e6 admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:56:29.490661 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f4613e-9855-4e21-b65e-c29df9d97087 admin admin] RBAC: Authorizing `identity:create_grant(project_id=65db6ec3249b4c778f0c0c3207d65253, user_id=ed7a1886d2184619bb493de128365fa2, role_id=4818d38cf2564825b312e66c9eb24762)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:56:29.493124 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56a8b0d-bd41-45e0-a81b-8264cf58b0e6 admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:56:29.493767 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f4613e-9855-4e21-b65e-c29df9d97087 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:56:29.498430 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e59a20-b803-45c8-b1d9-27c18337add5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:56:29.499184 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e59a20-b803-45c8-b1d9-27c18337add5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:29.500163 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e59a20-b803-45c8-b1d9-27c18337add5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:29.500482 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e59a20-b803-45c8-b1d9-27c18337add5 admin admin] PATH_INFO: `/v3/projects/a2d41e31cdce4db9bcd851ec4477db6a/users/f3d4283646be40c58f9008ed309f285e/roles/4818d38cf2564825b312e66c9eb24762` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:29.510014 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1130/2274] 10.222.0.57 () {60 vars in 1483 bytes} [Fri Sep 16 07:56:29 2022] PUT /identity/v3/projects/65db6ec3249b4c778f0c0c3207d65253/users/ed7a1886d2184619bb493de128365fa2/roles/4818d38cf2564825b312e66c9eb24762 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 16 07:56:29.510226 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f4613e-9855-4e21-b65e-c29df9d97087 admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:56:29.527985 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e59a20-b803-45c8-b1d9-27c18337add5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a2d41e31cdce4db9bcd851ec4477db6a, user_id=f3d4283646be40c58f9008ed309f285e, role_id=4818d38cf2564825b312e66c9eb24762)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:56:29.531805 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e59a20-b803-45c8-b1d9-27c18337add5 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:56:29.548088 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:56:29.563850 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1145/2275] 10.222.0.57 () {60 vars in 1483 bytes} [Fri Sep 16 07:56:29 2022] PUT /identity/v3/projects/a2d41e31cdce4db9bcd851ec4477db6a/users/f3d4283646be40c58f9008ed309f285e/roles/4818d38cf2564825b312e66c9eb24762 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 07:56:29.563850 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f47c9c2-2800-4560-a073-0b72a657256a None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:29.563850 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f47c9c2-2800-4560-a073-0b72a657256a None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:29.563850 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f47c9c2-2800-4560-a073-0b72a657256a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:29.585118 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-3f47c9c2-2800-4560-a073-0b72a657256a None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:56:29.587044 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-3f47c9c2-2800-4560-a073-0b72a657256a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:56:29.595095 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f4613e-9855-4e21-b65e-c29df9d97087 admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:56:29.685131 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:56:29.690739 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1146/2276] 10.222.0.57 () {58 vars in 958 bytes} [Fri Sep 16 07:56:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 07:56:29.690739 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc466ed7-451d-4a44-b3cd-359331e7423d None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:29.698269 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc466ed7-451d-4a44-b3cd-359331e7423d None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:29.699544 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc466ed7-451d-4a44-b3cd-359331e7423d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:29.701024 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20b57c9-7b0e-44be-97d5-8ae57aec4a18 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544bf6be4c24454a013ca110c43cef2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4735f453c0c24cc4a1c14e9ac84a0b46', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:56:29.701694 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20b57c9-7b0e-44be-97d5-8ae57aec4a18 service cinder] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:29.702023 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20b57c9-7b0e-44be-97d5-8ae57aec4a18 service cinder] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:29.702302 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20b57c9-7b0e-44be-97d5-8ae57aec4a18 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:29.704559 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-d20b57c9-7b0e-44be-97d5-8ae57aec4a18 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:56:29.741675 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-bc466ed7-451d-4a44-b3cd-359331e7423d None None] MFA Rules not processed for user `f3d4283646be40c58f9008ed309f285e`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:56:29.743200 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-bc466ed7-451d-4a44-b3cd-359331e7423d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:56:29.802214 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20b57c9-7b0e-44be-97d5-8ae57aec4a18 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:56:29.803667 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20b57c9-7b0e-44be-97d5-8ae57aec4a18 service cinder] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:56:29.814912 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1131/2277] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Sep 16 07:56:29 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 07:56:29.815829 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20b57c9-7b0e-44be-97d5-8ae57aec4a18 service cinder] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:56:29.817199 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-d20b57c9-7b0e-44be-97d5-8ae57aec4a18 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:56:29.876934 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1147/2278] 10.222.0.57 () {58 vars in 958 bytes} [Fri Sep 16 07:56:29 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 07:56:29.909196 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20b57c9-7b0e-44be-97d5-8ae57aec4a18 service cinder] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:56:29.911007 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc466ed7-451d-4a44-b3cd-359331e7423d None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:56:29.912982 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-bc466ed7-451d-4a44-b3cd-359331e7423d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:56:29.922114 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b54bd82-2f9d-4bf6-900f-4fcecbd795e7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1062e457207a41e4ba4f0a0c4bf36f1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4735f453c0c24cc4a1c14e9ac84a0b46', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:56:29.923426 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b54bd82-2f9d-4bf6-900f-4fcecbd795e7 service neutron] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:29.923949 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b54bd82-2f9d-4bf6-900f-4fcecbd795e7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:29.924252 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b54bd82-2f9d-4bf6-900f-4fcecbd795e7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:29.945637 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc466ed7-451d-4a44-b3cd-359331e7423d None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:56:29.959166 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b07350-8b0a-4f1b-8523-bb924625de63 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544bf6be4c24454a013ca110c43cef2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4735f453c0c24cc4a1c14e9ac84a0b46', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:56:29.959753 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b54bd82-2f9d-4bf6-900f-4fcecbd795e7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:56:29.960726 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b07350-8b0a-4f1b-8523-bb924625de63 service cinder] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:29.961185 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b07350-8b0a-4f1b-8523-bb924625de63 service cinder] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:29.961462 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b07350-8b0a-4f1b-8523-bb924625de63 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:29.961558 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b54bd82-2f9d-4bf6-900f-4fcecbd795e7 service neutron] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:56:29.973584 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b07350-8b0a-4f1b-8523-bb924625de63 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:56:29.974541 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1132/2279] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Sep 16 07:56:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 07:56:29.975474 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b07350-8b0a-4f1b-8523-bb924625de63 service cinder] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:56:29.988558 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1148/2280] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Sep 16 07:56:29 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 07:56:30.003726 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b54bd82-2f9d-4bf6-900f-4fcecbd795e7 service neutron] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:56:30.014970 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b54bd82-2f9d-4bf6-900f-4fcecbd795e7 service neutron] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:56:30.022577 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5438cd87-1acd-409e-80c8-9473ad0250e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:56:30.023221 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5438cd87-1acd-409e-80c8-9473ad0250e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:30.023497 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5438cd87-1acd-409e-80c8-9473ad0250e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:30.023834 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5438cd87-1acd-409e-80c8-9473ad0250e7 admin admin] PATH_INFO: `/v3/users/f3d4283646be40c58f9008ed309f285e` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:30.031239 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5438cd87-1acd-409e-80c8-9473ad0250e7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f3d4283646be40c58f9008ed309f285e)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:56:30.031239 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5438cd87-1acd-409e-80c8-9473ad0250e7 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:56:30.115945 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-5438cd87-1acd-409e-80c8-9473ad0250e7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f3d4283646be40c58f9008ed309f285e'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:56:30.116935 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-5438cd87-1acd-409e-80c8-9473ad0250e7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f3d4283646be40c58f9008ed309f285e'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:56:30.132047 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-5438cd87-1acd-409e-80c8-9473ad0250e7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f3d4283646be40c58f9008ed309f285e'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:56:30.148743 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-5438cd87-1acd-409e-80c8-9473ad0250e7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f3d4283646be40c58f9008ed309f285e'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:56:30.159069 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-5438cd87-1acd-409e-80c8-9473ad0250e7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f3d4283646be40c58f9008ed309f285e'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:56:30.168681 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1133/2281] 10.222.0.57 () {58 vars in 1224 bytes} [Fri Sep 16 07:56:30 2022] DELETE /identity/v3/users/f3d4283646be40c58f9008ed309f285e => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 07:56:30.173422 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6316ba5e-613f-42c4-98c6-31a978793035 None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:30.174042 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6316ba5e-613f-42c4-98c6-31a978793035 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:30.174608 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6316ba5e-613f-42c4-98c6-31a978793035 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:30.206284 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-6316ba5e-613f-42c4-98c6-31a978793035 None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:56:30.207706 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-6316ba5e-613f-42c4-98c6-31a978793035 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:56:30.310770 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1149/2282] 10.222.0.57 () {58 vars in 958 bytes} [Fri Sep 16 07:56:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 07:56:30.323986 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5438cd87-1acd-409e-80c8-9473ad0250e7 admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:56:30.327052 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-5438cd87-1acd-409e-80c8-9473ad0250e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:56:30.351497 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:56:30.362867 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4da702-44b4-42d0-825d-717cc1c22bc5 None None] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:30.363034 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4da702-44b4-42d0-825d-717cc1c22bc5 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:30.366556 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4da702-44b4-42d0-825d-717cc1c22bc5 None None] PATH_INFO: `/` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:30.370785 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1150/2283] 10.222.0.57 () {54 vars in 921 bytes} [Fri Sep 16 07:56:30 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 07:56:30.458308 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5438cd87-1acd-409e-80c8-9473ad0250e7 admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:56:30.461763 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a495f5fb-9647-425c-bc82-b755b77c8311 None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:30.461763 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a495f5fb-9647-425c-bc82-b755b77c8311 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:30.461763 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a495f5fb-9647-425c-bc82-b755b77c8311 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:30.503385 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedc9f3b-8aec-48a9-9971-83f871180cb7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1062e457207a41e4ba4f0a0c4bf36f1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4735f453c0c24cc4a1c14e9ac84a0b46', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:56:30.503974 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedc9f3b-8aec-48a9-9971-83f871180cb7 service neutron] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:30.504187 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedc9f3b-8aec-48a9-9971-83f871180cb7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:30.504545 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedc9f3b-8aec-48a9-9971-83f871180cb7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:30.508066 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-a495f5fb-9647-425c-bc82-b755b77c8311 None None] MFA Rules not processed for user `c7d4ccdd6ef9400ba9e344df0964da1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:56:30.512187 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-a495f5fb-9647-425c-bc82-b755b77c8311 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:56:30.527655 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:56:30.528436 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fedc9f3b-8aec-48a9-9971-83f871180cb7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:56:30.531730 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fedc9f3b-8aec-48a9-9971-83f871180cb7 service neutron] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:56:30.557909 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1134/2284] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Sep 16 07:56:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 16 07:56:30.599023 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1151/2285] 10.222.0.57 () {58 vars in 1018 bytes} [Fri Sep 16 07:56:30 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 07:56:30.618068 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedc9f3b-8aec-48a9-9971-83f871180cb7 service neutron] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:56:30.619837 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-fedc9f3b-8aec-48a9-9971-83f871180cb7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:56:30.637069 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedc9f3b-8aec-48a9-9971-83f871180cb7 service neutron] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:56:30.643253 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc305c8-5bfe-4bf5-b2ba-ea517d699d4e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7d4ccdd6ef9400ba9e344df0964da1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4735f453c0c24cc4a1c14e9ac84a0b46', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:56:30.643871 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc305c8-5bfe-4bf5-b2ba-ea517d699d4e service placement] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:30.644157 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc305c8-5bfe-4bf5-b2ba-ea517d699d4e service placement] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:30.644570 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc305c8-5bfe-4bf5-b2ba-ea517d699d4e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:30.653942 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc305c8-5bfe-4bf5-b2ba-ea517d699d4e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:56:30.656032 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc305c8-5bfe-4bf5-b2ba-ea517d699d4e service placement] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:56:30.668657 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1135/2286] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Sep 16 07:56:30 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 07:56:31.102023 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a495f5fb-9647-425c-bc82-b755b77c8311 None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:56:31.106177 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-a495f5fb-9647-425c-bc82-b755b77c8311 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:56:31.150420 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a495f5fb-9647-425c-bc82-b755b77c8311 None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:56:31.162824 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29d7e17-988e-46de-bc36-70ff803ed3aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:56:31.163558 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29d7e17-988e-46de-bc36-70ff803ed3aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:31.164466 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29d7e17-988e-46de-bc36-70ff803ed3aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:31.164808 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29d7e17-988e-46de-bc36-70ff803ed3aa admin admin] PATH_INFO: `/v3/projects/a2d41e31cdce4db9bcd851ec4477db6a` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:31.166909 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29d7e17-988e-46de-bc36-70ff803ed3aa admin admin] RBAC: Authorizing `identity:delete_project(project_id=a2d41e31cdce4db9bcd851ec4477db6a)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:56:31.169408 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29d7e17-988e-46de-bc36-70ff803ed3aa admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:56:31.247603 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-e29d7e17-988e-46de-bc36-70ff803ed3aa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a2d41e31cdce4db9bcd851ec4477db6a', 'request_id': 'req-e29d7e17-988e-46de-bc36-70ff803ed3aa'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:56:31.256221 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-e29d7e17-988e-46de-bc36-70ff803ed3aa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a2d41e31cdce4db9bcd851ec4477db6a', 'request_id': 'req-e29d7e17-988e-46de-bc36-70ff803ed3aa'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:56:31.269016 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-e29d7e17-988e-46de-bc36-70ff803ed3aa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a2d41e31cdce4db9bcd851ec4477db6a', 'request_id': 'req-e29d7e17-988e-46de-bc36-70ff803ed3aa'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:56:31.281751 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-e29d7e17-988e-46de-bc36-70ff803ed3aa admin admin] The token cache is being invalidate because project a2d41e31cdce4db9bcd851ec4477db6a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81431) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 07:56:31.282142 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-e29d7e17-988e-46de-bc36-70ff803ed3aa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:56:31.282881 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-e29d7e17-988e-46de-bc36-70ff803ed3aa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:56:31.286180 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1152/2287] 10.222.0.57 () {58 vars in 1233 bytes} [Fri Sep 16 07:56:31 2022] DELETE /identity/v3/projects/a2d41e31cdce4db9bcd851ec4477db6a => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 07:56:31.291850 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692d2cbc-ec8b-4105-b78c-92e3c47947b3 None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:31.292154 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692d2cbc-ec8b-4105-b78c-92e3c47947b3 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:31.292429 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692d2cbc-ec8b-4105-b78c-92e3c47947b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:31.335909 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-692d2cbc-ec8b-4105-b78c-92e3c47947b3 None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:56:31.337344 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-692d2cbc-ec8b-4105-b78c-92e3c47947b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:56:31.340685 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29d7e17-988e-46de-bc36-70ff803ed3aa admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:56:31.342306 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-e29d7e17-988e-46de-bc36-70ff803ed3aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:56:31.447762 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1136/2288] 10.222.0.57 () {58 vars in 958 bytes} [Fri Sep 16 07:56:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 07:56:31.462328 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86887fd6-075b-44d9-ae0c-013703ab85db None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:31.463475 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86887fd6-075b-44d9-ae0c-013703ab85db None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:31.467034 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86887fd6-075b-44d9-ae0c-013703ab85db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:31.471663 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29d7e17-988e-46de-bc36-70ff803ed3aa admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:56:31.481682 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e045a52-4407-4176-b67a-868d38e58130 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:56:31.482363 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e045a52-4407-4176-b67a-868d38e58130 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:31.482654 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e045a52-4407-4176-b67a-868d38e58130 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:31.484041 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e045a52-4407-4176-b67a-868d38e58130 admin admin] PATH_INFO: `/v3/users/1c7a0339a9644455940a4975dce12a6a` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:31.486487 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e045a52-4407-4176-b67a-868d38e58130 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1c7a0339a9644455940a4975dce12a6a)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:56:31.488584 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e045a52-4407-4176-b67a-868d38e58130 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:56:31.510249 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-86887fd6-075b-44d9-ae0c-013703ab85db None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:56:31.510821 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-86887fd6-075b-44d9-ae0c-013703ab85db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:56:31.521501 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1137/2289] 10.222.0.57 () {58 vars in 958 bytes} [Fri Sep 16 07:56:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 07:56:31.525891 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86887fd6-075b-44d9-ae0c-013703ab85db None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:56:31.545612 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86887fd6-075b-44d9-ae0c-013703ab85db None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:56:31.551575 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b13e38e-6d69-49d7-bf60-d86ea7238477 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:56:31.552681 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b13e38e-6d69-49d7-bf60-d86ea7238477 admin admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:31.552994 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b13e38e-6d69-49d7-bf60-d86ea7238477 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:31.553448 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b13e38e-6d69-49d7-bf60-d86ea7238477 admin admin] PATH_INFO: `/v3/domains` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:31.554235 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b13e38e-6d69-49d7-bf60-d86ea7238477 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:56:31.554553 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b13e38e-6d69-49d7-bf60-d86ea7238477 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:56:31.556459 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b13e38e-6d69-49d7-bf60-d86ea7238477 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:56:31.576170 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1138/2290] 10.222.0.57 () {58 vars in 1153 bytes} [Fri Sep 16 07:56:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 07:56:31.577273 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b13e38e-6d69-49d7-bf60-d86ea7238477 admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:56:31.579380 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:56:31.593998 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-3e045a52-4407-4176-b67a-868d38e58130 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1c7a0339a9644455940a4975dce12a6a'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:56:31.595260 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b13e38e-6d69-49d7-bf60-d86ea7238477 admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:56:31.602435 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a290dff-bb33-40bd-8fe6-9f0398ca35fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:56:31.603167 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a290dff-bb33-40bd-8fe6-9f0398ca35fb admin admin] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:31.603457 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a290dff-bb33-40bd-8fe6-9f0398ca35fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:31.603836 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a290dff-bb33-40bd-8fe6-9f0398ca35fb admin admin] PATH_INFO: `/v3/projects` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:31.604481 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a290dff-bb33-40bd-8fe6-9f0398ca35fb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:56:31.607038 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a290dff-bb33-40bd-8fe6-9f0398ca35fb admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:56:31.621154 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-3e045a52-4407-4176-b67a-868d38e58130 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1c7a0339a9644455940a4975dce12a6a'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:56:31.622128 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-3e045a52-4407-4176-b67a-868d38e58130 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1c7a0339a9644455940a4975dce12a6a'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:56:31.654169 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-3e045a52-4407-4176-b67a-868d38e58130 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1c7a0339a9644455940a4975dce12a6a'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:56:31.668629 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-3e045a52-4407-4176-b67a-868d38e58130 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1c7a0339a9644455940a4975dce12a6a'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:56:31.670782 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1139/2291] 10.222.0.57 () {60 vars in 1153 bytes} [Fri Sep 16 07:56:31 2022] POST /identity/v3/projects => generated 367 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 07:56:31.673701 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a290dff-bb33-40bd-8fe6-9f0398ca35fb admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:56:31.684298 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-7a290dff-bb33-40bd-8fe6-9f0398ca35fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:56:31.685438 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1153/2292] 10.222.0.57 () {58 vars in 1224 bytes} [Fri Sep 16 07:56:31 2022] DELETE /identity/v3/users/1c7a0339a9644455940a4975dce12a6a => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 07:56:31.793477 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e045a52-4407-4176-b67a-868d38e58130 admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:56:31.795312 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-3e045a52-4407-4176-b67a-868d38e58130 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:56:31.816399 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:56:31.853607 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a290dff-bb33-40bd-8fe6-9f0398ca35fb admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:56:31.961459 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a99d53-f3f5-4ce3-8d3f-e700abaa918b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:56:31.962255 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a99d53-f3f5-4ce3-8d3f-e700abaa918b admin admin] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:31.963418 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a99d53-f3f5-4ce3-8d3f-e700abaa918b admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:31.963643 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a99d53-f3f5-4ce3-8d3f-e700abaa918b admin admin] PATH_INFO: `/v3/users` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:31.969331 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a99d53-f3f5-4ce3-8d3f-e700abaa918b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:56:31.971496 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a99d53-f3f5-4ce3-8d3f-e700abaa918b admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:56:32.010085 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1140/2293] 10.222.0.57 () {60 vars in 1144 bytes} [Fri Sep 16 07:56:31 2022] POST /identity/v3/users => generated 284 bytes in 338 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 07:56:32.014145 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a99d53-f3f5-4ce3-8d3f-e700abaa918b admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:56:32.016332 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e045a52-4407-4176-b67a-868d38e58130 admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:56:32.027933 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a99d53-f3f5-4ce3-8d3f-e700abaa918b admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:56:32.033303 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093db0f9-2cf3-47cf-a9fe-1b1c95b85d72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:56:32.033615 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd4707b-58a8-469a-9d46-1d138b895adc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:56:32.033990 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093db0f9-2cf3-47cf-a9fe-1b1c95b85d72 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:32.034265 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093db0f9-2cf3-47cf-a9fe-1b1c95b85d72 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:32.034562 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093db0f9-2cf3-47cf-a9fe-1b1c95b85d72 admin admin] PATH_INFO: `/v3/users/cc19f9a905b8499cb0c079ee9b3b1083` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:32.035048 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd4707b-58a8-469a-9d46-1d138b895adc admin admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:32.035337 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd4707b-58a8-469a-9d46-1d138b895adc admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:32.035612 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd4707b-58a8-469a-9d46-1d138b895adc admin admin] PATH_INFO: `/v3/roles` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:32.035916 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093db0f9-2cf3-47cf-a9fe-1b1c95b85d72 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cc19f9a905b8499cb0c079ee9b3b1083)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:56:32.036477 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd4707b-58a8-469a-9d46-1d138b895adc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:56:32.037866 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093db0f9-2cf3-47cf-a9fe-1b1c95b85d72 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:56:32.038103 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd4707b-58a8-469a-9d46-1d138b895adc admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:56:32.057289 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1141/2294] 10.222.0.57 () {58 vars in 1122 bytes} [Fri Sep 16 07:56:32 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 07:56:32.061192 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd4707b-58a8-469a-9d46-1d138b895adc admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:56:32.073344 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd4707b-58a8-469a-9d46-1d138b895adc admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:56:32.079442 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9904d40-3b77-408f-8f71-a9cb9ba1cc70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:56:32.080130 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9904d40-3b77-408f-8f71-a9cb9ba1cc70 admin admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:32.080412 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9904d40-3b77-408f-8f71-a9cb9ba1cc70 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:32.081543 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9904d40-3b77-408f-8f71-a9cb9ba1cc70 admin admin] PATH_INFO: `/v3/roles` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:32.082286 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9904d40-3b77-408f-8f71-a9cb9ba1cc70 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:56:32.083904 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9904d40-3b77-408f-8f71-a9cb9ba1cc70 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:56:32.107102 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1142/2295] 10.222.0.57 () {58 vars in 1122 bytes} [Fri Sep 16 07:56:32 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 07:56:32.108264 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9904d40-3b77-408f-8f71-a9cb9ba1cc70 admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:56:32.130314 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9904d40-3b77-408f-8f71-a9cb9ba1cc70 admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:56:32.136307 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-093db0f9-2cf3-47cf-a9fe-1b1c95b85d72 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cc19f9a905b8499cb0c079ee9b3b1083'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:56:32.143479 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40747de-3df2-4c98-ac72-fc27185cb0eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:56:32.145845 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40747de-3df2-4c98-ac72-fc27185cb0eb admin admin] REQUEST_METHOD: `PUT` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:32.146128 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40747de-3df2-4c98-ac72-fc27185cb0eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:32.146403 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40747de-3df2-4c98-ac72-fc27185cb0eb admin admin] PATH_INFO: `/v3/projects/f449be05beea419e9c152bb067522c7b/users/4163db8c602b4e8badf93125ad329cda/roles/4818d38cf2564825b312e66c9eb24762` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:32.166533 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-093db0f9-2cf3-47cf-a9fe-1b1c95b85d72 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cc19f9a905b8499cb0c079ee9b3b1083'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:56:32.168192 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-093db0f9-2cf3-47cf-a9fe-1b1c95b85d72 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cc19f9a905b8499cb0c079ee9b3b1083'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:56:32.172191 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40747de-3df2-4c98-ac72-fc27185cb0eb admin admin] RBAC: Authorizing `identity:create_grant(project_id=f449be05beea419e9c152bb067522c7b, user_id=4163db8c602b4e8badf93125ad329cda, role_id=4818d38cf2564825b312e66c9eb24762)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:56:32.175201 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40747de-3df2-4c98-ac72-fc27185cb0eb admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:56:32.182240 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-093db0f9-2cf3-47cf-a9fe-1b1c95b85d72 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cc19f9a905b8499cb0c079ee9b3b1083'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:56:32.194544 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-093db0f9-2cf3-47cf-a9fe-1b1c95b85d72 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cc19f9a905b8499cb0c079ee9b3b1083'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:56:32.201766 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1143/2296] 10.222.0.57 () {60 vars in 1483 bytes} [Fri Sep 16 07:56:32 2022] PUT /identity/v3/projects/f449be05beea419e9c152bb067522c7b/users/4163db8c602b4e8badf93125ad329cda/roles/4818d38cf2564825b312e66c9eb24762 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 07:56:32.201766 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40747de-3df2-4c98-ac72-fc27185cb0eb admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:56:32.209608 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-d40747de-3df2-4c98-ac72-fc27185cb0eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:56:32.227652 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1154/2297] 10.222.0.57 () {58 vars in 1224 bytes} [Fri Sep 16 07:56:31 2022] DELETE /identity/v3/users/cc19f9a905b8499cb0c079ee9b3b1083 => generated 0 bytes in 432 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 07:56:32.229003 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41262937-54c0-4b9f-9a3e-60c48c4e32a5 None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:32.229294 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41262937-54c0-4b9f-9a3e-60c48c4e32a5 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:32.229567 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41262937-54c0-4b9f-9a3e-60c48c4e32a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:32.303338 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-41262937-54c0-4b9f-9a3e-60c48c4e32a5 None None] MFA Rules not processed for user `4163db8c602b4e8badf93125ad329cda`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:56:32.304613 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-41262937-54c0-4b9f-9a3e-60c48c4e32a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:56:32.329622 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40747de-3df2-4c98-ac72-fc27185cb0eb admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:56:32.346642 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:DELETE=15,keystone:SELECT=83,keystone:INSERT=2 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:56:32.394708 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:56:32.413677 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ad01c1-6d76-4ef9-8866-5d4988b43af8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:56:32.414466 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ad01c1-6d76-4ef9-8866-5d4988b43af8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:32.414829 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ad01c1-6d76-4ef9-8866-5d4988b43af8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:32.415170 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ad01c1-6d76-4ef9-8866-5d4988b43af8 admin admin] PATH_INFO: `/v3/projects/425be61bcfa047bfb4bb7d9d9a3d88a2` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:32.416203 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1155/2298] 10.222.0.57 () {58 vars in 958 bytes} [Fri Sep 16 07:56:32 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 07:56:32.417742 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b44e5f-8e78-4ef8-9b90-24f95b9b256c None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:32.418204 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b44e5f-8e78-4ef8-9b90-24f95b9b256c None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:32.418712 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b44e5f-8e78-4ef8-9b90-24f95b9b256c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:32.423168 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ad01c1-6d76-4ef9-8866-5d4988b43af8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=425be61bcfa047bfb4bb7d9d9a3d88a2)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:56:32.425295 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ad01c1-6d76-4ef9-8866-5d4988b43af8 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:56:32.448458 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-d1b44e5f-8e78-4ef8-9b90-24f95b9b256c None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:56:32.451178 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-d1b44e5f-8e78-4ef8-9b90-24f95b9b256c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:56:32.462287 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1156/2299] 10.222.0.57 () {58 vars in 958 bytes} [Fri Sep 16 07:56:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 07:56:32.466826 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b44e5f-8e78-4ef8-9b90-24f95b9b256c None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:56:32.469544 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-d1b44e5f-8e78-4ef8-9b90-24f95b9b256c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:56:32.505338 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-45ad01c1-6d76-4ef9-8866-5d4988b43af8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '425be61bcfa047bfb4bb7d9d9a3d88a2', 'request_id': 'req-45ad01c1-6d76-4ef9-8866-5d4988b43af8'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:56:32.518984 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-45ad01c1-6d76-4ef9-8866-5d4988b43af8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '425be61bcfa047bfb4bb7d9d9a3d88a2', 'request_id': 'req-45ad01c1-6d76-4ef9-8866-5d4988b43af8'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:56:32.528898 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-45ad01c1-6d76-4ef9-8866-5d4988b43af8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '425be61bcfa047bfb4bb7d9d9a3d88a2', 'request_id': 'req-45ad01c1-6d76-4ef9-8866-5d4988b43af8'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:56:32.550704 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-45ad01c1-6d76-4ef9-8866-5d4988b43af8 admin admin] The token cache is being invalidate because project 425be61bcfa047bfb4bb7d9d9a3d88a2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81430) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 07:56:32.551199 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-45ad01c1-6d76-4ef9-8866-5d4988b43af8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:56:32.552602 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-45ad01c1-6d76-4ef9-8866-5d4988b43af8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:56:32.555074 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1144/2300] 10.222.0.57 () {58 vars in 1233 bytes} [Fri Sep 16 07:56:32 2022] DELETE /identity/v3/projects/425be61bcfa047bfb4bb7d9d9a3d88a2 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 07:56:32.555303 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ad01c1-6d76-4ef9-8866-5d4988b43af8 admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:56:32.556702 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-45ad01c1-6d76-4ef9-8866-5d4988b43af8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:56:32.563987 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b44e5f-8e78-4ef8-9b90-24f95b9b256c None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:56:32.665021 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a615179-aee7-438a-ba10-8919149e84f4 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceecb2c2fe9842e3b228848e00fd11ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4735f453c0c24cc4a1c14e9ac84a0b46', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:56:32.665654 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a615179-aee7-438a-ba10-8919149e84f4 service glance] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:32.665954 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a615179-aee7-438a-ba10-8919149e84f4 service glance] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:32.666222 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a615179-aee7-438a-ba10-8919149e84f4 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:32.677071 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-1a615179-aee7-438a-ba10-8919149e84f4 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:56:32.695590 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ad01c1-6d76-4ef9-8866-5d4988b43af8 admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:56:32.704577 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd655f9c-a740-4623-9299-91c0c228141e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1062e457207a41e4ba4f0a0c4bf36f1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4735f453c0c24cc4a1c14e9ac84a0b46', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:56:32.705166 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd655f9c-a740-4623-9299-91c0c228141e service neutron] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:32.705457 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd655f9c-a740-4623-9299-91c0c228141e service neutron] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:32.705775 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd655f9c-a740-4623-9299-91c0c228141e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:32.707969 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-dd655f9c-a740-4623-9299-91c0c228141e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:56:32.809252 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a615179-aee7-438a-ba10-8919149e84f4 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:56:32.816589 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a615179-aee7-438a-ba10-8919149e84f4 service glance] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:56:32.827737 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd655f9c-a740-4623-9299-91c0c228141e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:56:32.834848 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd655f9c-a740-4623-9299-91c0c228141e service neutron] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:56:32.843675 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1157/2301] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Sep 16 07:56:32 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 07:56:32.846562 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1145/2302] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Sep 16 07:56:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 07:56:32.852169 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a615179-aee7-438a-ba10-8919149e84f4 service glance] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:56:32.854562 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-1a615179-aee7-438a-ba10-8919149e84f4 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:56:32.882765 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a615179-aee7-438a-ba10-8919149e84f4 service glance] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:56:32.906004 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea5f572-819d-4d27-b348-5299455014b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:56:32.907052 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea5f572-819d-4d27-b348-5299455014b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:32.907372 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea5f572-819d-4d27-b348-5299455014b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:32.907655 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea5f572-819d-4d27-b348-5299455014b7 admin admin] PATH_INFO: `/v3/users/f2be0ddc02d34db0b878592f58fff8d9` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:32.911764 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea5f572-819d-4d27-b348-5299455014b7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f2be0ddc02d34db0b878592f58fff8d9)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:56:32.913981 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea5f572-819d-4d27-b348-5299455014b7 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:56:32.953881 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:56:33.026428 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-7ea5f572-819d-4d27-b348-5299455014b7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f2be0ddc02d34db0b878592f58fff8d9'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:56:33.047800 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-7ea5f572-819d-4d27-b348-5299455014b7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f2be0ddc02d34db0b878592f58fff8d9'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:56:33.048661 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-7ea5f572-819d-4d27-b348-5299455014b7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f2be0ddc02d34db0b878592f58fff8d9'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:56:33.061411 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-7ea5f572-819d-4d27-b348-5299455014b7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f2be0ddc02d34db0b878592f58fff8d9'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:56:33.093619 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-7ea5f572-819d-4d27-b348-5299455014b7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f2be0ddc02d34db0b878592f58fff8d9'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:56:33.129258 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1158/2303] 10.222.0.57 () {58 vars in 1224 bytes} [Fri Sep 16 07:56:32 2022] DELETE /identity/v3/users/f2be0ddc02d34db0b878592f58fff8d9 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 07:56:33.466277 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd655f9c-a740-4623-9299-91c0c228141e service neutron] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:56:33.468503 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-dd655f9c-a740-4623-9299-91c0c228141e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:56:33.495925 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd655f9c-a740-4623-9299-91c0c228141e service neutron] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:56:33.580016 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea5f572-819d-4d27-b348-5299455014b7 admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:56:33.586661 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-7ea5f572-819d-4d27-b348-5299455014b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:56:33.605318 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:56:33.684860 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c71220-0867-4a81-b337-0721e7e92f88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:56:33.687007 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c71220-0867-4a81-b337-0721e7e92f88 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:33.687472 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c71220-0867-4a81-b337-0721e7e92f88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:33.688356 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c71220-0867-4a81-b337-0721e7e92f88 admin admin] PATH_INFO: `/v3/projects/56fa718ff465414a84dc4d1b23e9e916` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:33.689929 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c71220-0867-4a81-b337-0721e7e92f88 admin admin] RBAC: Authorizing `identity:delete_project(project_id=56fa718ff465414a84dc4d1b23e9e916)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:56:33.693047 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c71220-0867-4a81-b337-0721e7e92f88 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:56:33.740625 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea5f572-819d-4d27-b348-5299455014b7 admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:56:33.752869 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f690ab-420b-4453-8bb6-87b1810d955e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:56:33.753642 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f690ab-420b-4453-8bb6-87b1810d955e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:33.753945 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f690ab-420b-4453-8bb6-87b1810d955e admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:33.755318 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f690ab-420b-4453-8bb6-87b1810d955e admin admin] PATH_INFO: `/v3/projects/9edac413df104f50af6e52d3cae79add` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:33.757913 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f690ab-420b-4453-8bb6-87b1810d955e admin admin] RBAC: Authorizing `identity:delete_project(project_id=9edac413df104f50af6e52d3cae79add)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:56:33.764318 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f690ab-420b-4453-8bb6-87b1810d955e admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:56:33.825228 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-37c71220-0867-4a81-b337-0721e7e92f88 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '56fa718ff465414a84dc4d1b23e9e916', 'request_id': 'req-37c71220-0867-4a81-b337-0721e7e92f88'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:56:33.844300 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-37c71220-0867-4a81-b337-0721e7e92f88 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '56fa718ff465414a84dc4d1b23e9e916', 'request_id': 'req-37c71220-0867-4a81-b337-0721e7e92f88'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:56:33.855906 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-37c71220-0867-4a81-b337-0721e7e92f88 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '56fa718ff465414a84dc4d1b23e9e916', 'request_id': 'req-37c71220-0867-4a81-b337-0721e7e92f88'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:56:33.862708 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-f4f690ab-420b-4453-8bb6-87b1810d955e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9edac413df104f50af6e52d3cae79add', 'request_id': 'req-f4f690ab-420b-4453-8bb6-87b1810d955e'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:56:33.870767 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-f4f690ab-420b-4453-8bb6-87b1810d955e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9edac413df104f50af6e52d3cae79add', 'request_id': 'req-f4f690ab-420b-4453-8bb6-87b1810d955e'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:56:33.871324 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-37c71220-0867-4a81-b337-0721e7e92f88 admin admin] The token cache is being invalidate because project 56fa718ff465414a84dc4d1b23e9e916 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81430) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 07:56:33.872512 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-37c71220-0867-4a81-b337-0721e7e92f88 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:56:33.873457 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-37c71220-0867-4a81-b337-0721e7e92f88 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:56:33.875885 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1146/2304] 10.222.0.57 () {58 vars in 1233 bytes} [Fri Sep 16 07:56:33 2022] DELETE /identity/v3/projects/56fa718ff465414a84dc4d1b23e9e916 => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 07:56:33.880697 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9891c2d-b5ac-47dc-8623-651115f6a9a8 None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:33.880980 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9891c2d-b5ac-47dc-8623-651115f6a9a8 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:33.881249 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9891c2d-b5ac-47dc-8623-651115f6a9a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:33.887330 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-f4f690ab-420b-4453-8bb6-87b1810d955e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9edac413df104f50af6e52d3cae79add', 'request_id': 'req-f4f690ab-420b-4453-8bb6-87b1810d955e'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:56:33.912347 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-f4f690ab-420b-4453-8bb6-87b1810d955e admin admin] The token cache is being invalidate because project 9edac413df104f50af6e52d3cae79add was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81431) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 07:56:33.912681 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-f4f690ab-420b-4453-8bb6-87b1810d955e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:56:33.912812 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-b9891c2d-b5ac-47dc-8623-651115f6a9a8 None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:56:33.914252 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-f4f690ab-420b-4453-8bb6-87b1810d955e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:56:33.914533 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-b9891c2d-b5ac-47dc-8623-651115f6a9a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:56:33.916132 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1159/2305] 10.222.0.57 () {58 vars in 1233 bytes} [Fri Sep 16 07:56:33 2022] DELETE /identity/v3/projects/9edac413df104f50af6e52d3cae79add => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 07:56:33.922383 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f137263c-00e2-4c9c-9924-bb9d17900ff5 None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:33.924149 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f137263c-00e2-4c9c-9924-bb9d17900ff5 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:33.924672 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f137263c-00e2-4c9c-9924-bb9d17900ff5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:33.948281 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-f137263c-00e2-4c9c-9924-bb9d17900ff5 None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:56:33.949454 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-f137263c-00e2-4c9c-9924-bb9d17900ff5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:56:33.986133 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:56:34.048025 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1147/2306] 10.222.0.57 () {58 vars in 958 bytes} [Fri Sep 16 07:56:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 07:56:34.055922 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6286b01d-b82e-47a2-8111-40ceb6060c71 None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:34.056236 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6286b01d-b82e-47a2-8111-40ceb6060c71 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:34.056515 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6286b01d-b82e-47a2-8111-40ceb6060c71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:34.066770 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1160/2307] 10.222.0.57 () {58 vars in 958 bytes} [Fri Sep 16 07:56:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 07:56:34.076345 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32cd817-c3ba-40bc-a063-faa4901b33f0 None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:34.076568 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32cd817-c3ba-40bc-a063-faa4901b33f0 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:34.076835 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32cd817-c3ba-40bc-a063-faa4901b33f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:34.101930 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-6286b01d-b82e-47a2-8111-40ceb6060c71 None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:56:34.103176 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-6286b01d-b82e-47a2-8111-40ceb6060c71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:56:34.114703 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1148/2308] 10.222.0.57 () {58 vars in 958 bytes} [Fri Sep 16 07:56:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 16 07:56:34.118829 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6286b01d-b82e-47a2-8111-40ceb6060c71 None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:56:34.121926 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-d32cd817-c3ba-40bc-a063-faa4901b33f0 None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:56:34.123174 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-d32cd817-c3ba-40bc-a063-faa4901b33f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:56:34.137534 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6286b01d-b82e-47a2-8111-40ceb6060c71 None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:56:34.139514 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1161/2309] 10.222.0.57 () {58 vars in 958 bytes} [Fri Sep 16 07:56:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 07:56:34.144822 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32cd817-c3ba-40bc-a063-faa4901b33f0 None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:56:34.145535 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f560ea85-5f12-42ea-b5bb-f06ba52393f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:56:34.145535 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f560ea85-5f12-42ea-b5bb-f06ba52393f7 admin admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:34.145535 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f560ea85-5f12-42ea-b5bb-f06ba52393f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:34.147045 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f560ea85-5f12-42ea-b5bb-f06ba52393f7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:34.147438 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f560ea85-5f12-42ea-b5bb-f06ba52393f7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:56:34.147907 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f560ea85-5f12-42ea-b5bb-f06ba52393f7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:56:34.150331 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f560ea85-5f12-42ea-b5bb-f06ba52393f7 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:56:34.172280 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1149/2310] 10.222.0.57 () {58 vars in 1153 bytes} [Fri Sep 16 07:56:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:56:34.178505 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f560ea85-5f12-42ea-b5bb-f06ba52393f7 admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:56:34.189952 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32cd817-c3ba-40bc-a063-faa4901b33f0 None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:56:34.198680 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f560ea85-5f12-42ea-b5bb-f06ba52393f7 admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:56:34.200324 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c15655-7c19-4265-933f-c8c60f27006d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:56:34.201041 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c15655-7c19-4265-933f-c8c60f27006d admin admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:34.201628 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c15655-7c19-4265-933f-c8c60f27006d admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:34.202008 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c15655-7c19-4265-933f-c8c60f27006d admin admin] PATH_INFO: `/v3/domains` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:34.203308 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c15655-7c19-4265-933f-c8c60f27006d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:56:34.203607 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c15655-7c19-4265-933f-c8c60f27006d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:56:34.204937 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345d544b-c62b-4ba0-88a3-019dc63fad27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:56:34.205558 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345d544b-c62b-4ba0-88a3-019dc63fad27 admin admin] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:34.205858 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345d544b-c62b-4ba0-88a3-019dc63fad27 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:34.206009 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c15655-7c19-4265-933f-c8c60f27006d admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:56:34.206205 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345d544b-c62b-4ba0-88a3-019dc63fad27 admin admin] PATH_INFO: `/v3/projects` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:34.206775 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345d544b-c62b-4ba0-88a3-019dc63fad27 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:56:34.208856 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345d544b-c62b-4ba0-88a3-019dc63fad27 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:56:34.247748 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1162/2311] 10.222.0.57 () {58 vars in 1153 bytes} [Fri Sep 16 07:56:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:56:34.251991 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1150/2312] 10.222.0.57 () {60 vars in 1153 bytes} [Fri Sep 16 07:56:34 2022] POST /identity/v3/projects => generated 373 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 07:56:34.256408 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c15655-7c19-4265-933f-c8c60f27006d admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:56:34.256539 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345d544b-c62b-4ba0-88a3-019dc63fad27 admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:56:34.283874 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:56:34.285666 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c15655-7c19-4265-933f-c8c60f27006d admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:56:34.363360 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345d544b-c62b-4ba0-88a3-019dc63fad27 admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:56:34.376152 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228ad32c-6b77-4e43-972f-6ff57d19b7d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:56:34.377486 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228ad32c-6b77-4e43-972f-6ff57d19b7d6 admin admin] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:34.378322 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228ad32c-6b77-4e43-972f-6ff57d19b7d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:34.378887 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228ad32c-6b77-4e43-972f-6ff57d19b7d6 admin admin] PATH_INFO: `/v3/users` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:34.382125 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228ad32c-6b77-4e43-972f-6ff57d19b7d6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:56:34.388521 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228ad32c-6b77-4e43-972f-6ff57d19b7d6 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:56:34.405784 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a432e908-cda0-41a2-9491-93ddec009e07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:56:34.406902 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a432e908-cda0-41a2-9491-93ddec009e07 admin admin] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:34.407286 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a432e908-cda0-41a2-9491-93ddec009e07 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:34.407671 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a432e908-cda0-41a2-9491-93ddec009e07 admin admin] PATH_INFO: `/v3/projects` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:34.409013 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a432e908-cda0-41a2-9491-93ddec009e07 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:56:34.411546 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a432e908-cda0-41a2-9491-93ddec009e07 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:56:34.437801 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1151/2313] 10.222.0.57 () {60 vars in 1144 bytes} [Fri Sep 16 07:56:34 2022] POST /identity/v3/users => generated 287 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 07:56:34.442298 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228ad32c-6b77-4e43-972f-6ff57d19b7d6 admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:56:34.464081 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1163/2314] 10.222.0.57 () {60 vars in 1153 bytes} [Fri Sep 16 07:56:34 2022] POST /identity/v3/projects => generated 383 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 07:56:34.466995 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a432e908-cda0-41a2-9491-93ddec009e07 admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:56:34.472222 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228ad32c-6b77-4e43-972f-6ff57d19b7d6 admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:56:34.550949 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde47fb2-7681-479a-b924-8461009a71c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:56:34.551576 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde47fb2-7681-479a-b924-8461009a71c9 admin admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:34.551865 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde47fb2-7681-479a-b924-8461009a71c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:34.552137 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde47fb2-7681-479a-b924-8461009a71c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:34.553054 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde47fb2-7681-479a-b924-8461009a71c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:56:34.555022 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde47fb2-7681-479a-b924-8461009a71c9 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:56:34.570020 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1152/2315] 10.222.0.57 () {58 vars in 1122 bytes} [Fri Sep 16 07:56:34 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 07:56:34.573952 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde47fb2-7681-479a-b924-8461009a71c9 admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:56:34.586606 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde47fb2-7681-479a-b924-8461009a71c9 admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:56:34.591571 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc38f75f-bede-4098-860c-8fb1caa4fa80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:56:34.592189 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc38f75f-bede-4098-860c-8fb1caa4fa80 admin admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:34.592468 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc38f75f-bede-4098-860c-8fb1caa4fa80 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:34.593024 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc38f75f-bede-4098-860c-8fb1caa4fa80 admin admin] PATH_INFO: `/v3/roles` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:34.593674 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc38f75f-bede-4098-860c-8fb1caa4fa80 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:56:34.595647 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc38f75f-bede-4098-860c-8fb1caa4fa80 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:56:34.596293 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a432e908-cda0-41a2-9491-93ddec009e07 admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:56:34.617262 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c2f307-a3fb-4954-bf19-04b038dfc507 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:56:34.617921 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c2f307-a3fb-4954-bf19-04b038dfc507 admin admin] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:34.618197 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c2f307-a3fb-4954-bf19-04b038dfc507 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:34.618464 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c2f307-a3fb-4954-bf19-04b038dfc507 admin admin] PATH_INFO: `/v3/users` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:34.619097 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c2f307-a3fb-4954-bf19-04b038dfc507 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:56:34.621012 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c2f307-a3fb-4954-bf19-04b038dfc507 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:56:34.629397 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1153/2316] 10.222.0.57 () {58 vars in 1122 bytes} [Fri Sep 16 07:56:34 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 07:56:34.632290 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc38f75f-bede-4098-860c-8fb1caa4fa80 admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:56:34.649353 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc38f75f-bede-4098-860c-8fb1caa4fa80 admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:56:34.655616 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b06e1e-6985-4afc-94b2-925a0cddf0c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:56:34.658041 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b06e1e-6985-4afc-94b2-925a0cddf0c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:34.658041 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b06e1e-6985-4afc-94b2-925a0cddf0c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:34.658041 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b06e1e-6985-4afc-94b2-925a0cddf0c3 admin admin] PATH_INFO: `/v3/projects/6577356be7724fe49654cfa4683caee6/users/4b8eb513adf64d9fb38cf016ec8e3f87/roles/4818d38cf2564825b312e66c9eb24762` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:34.679360 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b06e1e-6985-4afc-94b2-925a0cddf0c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6577356be7724fe49654cfa4683caee6, user_id=4b8eb513adf64d9fb38cf016ec8e3f87, role_id=4818d38cf2564825b312e66c9eb24762)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:56:34.683926 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b06e1e-6985-4afc-94b2-925a0cddf0c3 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:56:34.684160 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1164/2317] 10.222.0.57 () {60 vars in 1144 bytes} [Fri Sep 16 07:56:34 2022] POST /identity/v3/users => generated 292 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 07:56:34.686231 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c2f307-a3fb-4954-bf19-04b038dfc507 admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:56:34.709919 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c2f307-a3fb-4954-bf19-04b038dfc507 admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:56:34.710328 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1154/2318] 10.222.0.57 () {60 vars in 1483 bytes} [Fri Sep 16 07:56:34 2022] PUT /identity/v3/projects/6577356be7724fe49654cfa4683caee6/users/4b8eb513adf64d9fb38cf016ec8e3f87/roles/4818d38cf2564825b312e66c9eb24762 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 07:56:34.724889 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06293796-4f64-422e-a2ce-230c8a003568 None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:34.725276 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06293796-4f64-422e-a2ce-230c8a003568 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:34.725829 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06293796-4f64-422e-a2ce-230c8a003568 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:34.789975 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-06293796-4f64-422e-a2ce-230c8a003568 None None] MFA Rules not processed for user `4b8eb513adf64d9fb38cf016ec8e3f87`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:56:34.791297 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-06293796-4f64-422e-a2ce-230c8a003568 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:56:34.797497 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:56:34.844006 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9778d871-bf39-4294-9e66-258468d51ffc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:56:34.844697 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9778d871-bf39-4294-9e66-258468d51ffc admin admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:34.845100 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9778d871-bf39-4294-9e66-258468d51ffc admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:34.845379 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9778d871-bf39-4294-9e66-258468d51ffc admin admin] PATH_INFO: `/v3/roles` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:34.846162 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9778d871-bf39-4294-9e66-258468d51ffc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:56:34.847794 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9778d871-bf39-4294-9e66-258468d51ffc admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:56:34.864463 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1165/2319] 10.222.0.57 () {58 vars in 1122 bytes} [Fri Sep 16 07:56:34 2022] GET /identity/v3/roles => generated 1420 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 07:56:34.865536 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9778d871-bf39-4294-9e66-258468d51ffc admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:56:34.879395 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9778d871-bf39-4294-9e66-258468d51ffc admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:56:34.884719 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb6927f-d555-4ae6-a6dd-eac43483adab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:56:34.885339 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb6927f-d555-4ae6-a6dd-eac43483adab admin admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:34.885618 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb6927f-d555-4ae6-a6dd-eac43483adab admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:34.885980 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb6927f-d555-4ae6-a6dd-eac43483adab admin admin] PATH_INFO: `/v3/roles` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:34.886659 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb6927f-d555-4ae6-a6dd-eac43483adab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:56:34.888584 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb6927f-d555-4ae6-a6dd-eac43483adab admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:56:34.908974 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1166/2320] 10.222.0.57 () {58 vars in 1122 bytes} [Fri Sep 16 07:56:34 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 07:56:34.910076 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb6927f-d555-4ae6-a6dd-eac43483adab admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:56:34.925030 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb6927f-d555-4ae6-a6dd-eac43483adab admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:56:34.930621 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be91c16d-2561-4de3-822d-53c7729cb06e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:56:34.932032 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be91c16d-2561-4de3-822d-53c7729cb06e admin admin] REQUEST_METHOD: `PUT` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:34.932203 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be91c16d-2561-4de3-822d-53c7729cb06e admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:34.932474 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be91c16d-2561-4de3-822d-53c7729cb06e admin admin] PATH_INFO: `/v3/projects/f541f8d2bba5497d830abb3eff2c53f4/users/62607591bc8748b29fbb1246d90d874c/roles/4818d38cf2564825b312e66c9eb24762` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:34.957999 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be91c16d-2561-4de3-822d-53c7729cb06e admin admin] RBAC: Authorizing `identity:create_grant(project_id=f541f8d2bba5497d830abb3eff2c53f4, user_id=62607591bc8748b29fbb1246d90d874c, role_id=4818d38cf2564825b312e66c9eb24762)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:56:34.962618 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be91c16d-2561-4de3-822d-53c7729cb06e admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:56:34.994119 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1167/2321] 10.222.0.57 () {60 vars in 1483 bytes} [Fri Sep 16 07:56:34 2022] PUT /identity/v3/projects/f541f8d2bba5497d830abb3eff2c53f4/users/62607591bc8748b29fbb1246d90d874c/roles/4818d38cf2564825b312e66c9eb24762 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 07:56:34.997607 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb28c932-5f57-479a-8abb-daac430ca650 None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:34.998093 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb28c932-5f57-479a-8abb-daac430ca650 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:34.998605 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb28c932-5f57-479a-8abb-daac430ca650 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:35.010261 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:56:35.020882 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1155/2322] 10.222.0.57 () {58 vars in 958 bytes} [Fri Sep 16 07:56:34 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 297 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 16 07:56:35.031703 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06293796-4f64-422e-a2ce-230c8a003568 None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:56:35.035369 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-06293796-4f64-422e-a2ce-230c8a003568 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:56:35.049943 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-bb28c932-5f57-479a-8abb-daac430ca650 None None] MFA Rules not processed for user `62607591bc8748b29fbb1246d90d874c`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:56:35.051654 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-bb28c932-5f57-479a-8abb-daac430ca650 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:56:35.208686 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06293796-4f64-422e-a2ce-230c8a003568 None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:56:35.272940 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1168/2323] 10.222.0.57 () {58 vars in 958 bytes} [Fri Sep 16 07:56:34 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 07:56:35.277089 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb28c932-5f57-479a-8abb-daac430ca650 None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:56:35.288117 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d820f46e-1937-449a-abfc-6560b3bfe9fe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544bf6be4c24454a013ca110c43cef2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4735f453c0c24cc4a1c14e9ac84a0b46', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:56:35.289149 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d820f46e-1937-449a-abfc-6560b3bfe9fe service cinder] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:35.289619 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d820f46e-1937-449a-abfc-6560b3bfe9fe service cinder] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:35.290112 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d820f46e-1937-449a-abfc-6560b3bfe9fe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:35.378976 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d820f46e-1937-449a-abfc-6560b3bfe9fe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:56:35.380818 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d820f46e-1937-449a-abfc-6560b3bfe9fe service cinder] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:56:35.401151 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1156/2324] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Sep 16 07:56:35 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 16 07:56:35.455014 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb28c932-5f57-479a-8abb-daac430ca650 None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:56:35.461241 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56107f6-85b9-44ef-9233-dc1114bf97a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:56:35.462503 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56107f6-85b9-44ef-9233-dc1114bf97a1 admin admin] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:35.463026 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56107f6-85b9-44ef-9233-dc1114bf97a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:35.463463 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56107f6-85b9-44ef-9233-dc1114bf97a1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:35.464226 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56107f6-85b9-44ef-9233-dc1114bf97a1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:56:35.468938 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56107f6-85b9-44ef-9233-dc1114bf97a1 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:56:35.530296 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d820f46e-1937-449a-abfc-6560b3bfe9fe service cinder] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:56:35.535665 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1169/2325] 10.222.0.57 () {60 vars in 1153 bytes} [Fri Sep 16 07:56:35 2022] POST /identity/v3/projects => generated 383 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 16 07:56:35.548500 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d820f46e-1937-449a-abfc-6560b3bfe9fe service cinder] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:56:35.687192 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3155a624-8c16-4f02-800e-02116e9a5f4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:56:35.688175 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3155a624-8c16-4f02-800e-02116e9a5f4b admin admin] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:35.688656 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3155a624-8c16-4f02-800e-02116e9a5f4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:35.689083 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3155a624-8c16-4f02-800e-02116e9a5f4b admin admin] PATH_INFO: `/v3/users` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:35.690047 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3155a624-8c16-4f02-800e-02116e9a5f4b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:56:35.692141 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3155a624-8c16-4f02-800e-02116e9a5f4b admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:56:35.735662 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:56:35.741769 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1157/2326] 10.222.0.57 () {60 vars in 1144 bytes} [Fri Sep 16 07:56:35 2022] POST /identity/v3/users => generated 298 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 16 07:56:35.745649 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56107f6-85b9-44ef-9233-dc1114bf97a1 admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:56:35.753453 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:56:35.764419 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56107f6-85b9-44ef-9233-dc1114bf97a1 admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:56:35.784667 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64c14ed-238c-4efd-b90b-a2118d5c495f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:56:35.786200 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64c14ed-238c-4efd-b90b-a2118d5c495f admin admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:35.787888 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64c14ed-238c-4efd-b90b-a2118d5c495f admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:35.788315 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64c14ed-238c-4efd-b90b-a2118d5c495f admin admin] PATH_INFO: `/v3/roles` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:35.791692 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64c14ed-238c-4efd-b90b-a2118d5c495f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:56:35.797239 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64c14ed-238c-4efd-b90b-a2118d5c495f admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:56:35.820241 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1170/2327] 10.222.0.57 () {58 vars in 1122 bytes} [Fri Sep 16 07:56:35 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 07:56:35.821770 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3155a624-8c16-4f02-800e-02116e9a5f4b admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:56:35.841586 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3155a624-8c16-4f02-800e-02116e9a5f4b admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:56:35.859586 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f994d2d-517d-4750-9b3d-68ef18314fe2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:56:35.860555 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f994d2d-517d-4750-9b3d-68ef18314fe2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:35.861062 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f994d2d-517d-4750-9b3d-68ef18314fe2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:35.861432 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f994d2d-517d-4750-9b3d-68ef18314fe2 admin admin] PATH_INFO: `/v3/projects/d80285f6838748859f17d9f353ec3680/users/cf2e0c4518d34fc78a16961fbcdf414f/roles/567db03c91854ad9af1e9a87ec1bd275` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:35.887188 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f994d2d-517d-4750-9b3d-68ef18314fe2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d80285f6838748859f17d9f353ec3680, user_id=cf2e0c4518d34fc78a16961fbcdf414f, role_id=567db03c91854ad9af1e9a87ec1bd275)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:56:35.890299 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f994d2d-517d-4750-9b3d-68ef18314fe2 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:56:35.917174 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1158/2328] 10.222.0.57 () {60 vars in 1483 bytes} [Fri Sep 16 07:56:35 2022] PUT /identity/v3/projects/d80285f6838748859f17d9f353ec3680/users/cf2e0c4518d34fc78a16961fbcdf414f/roles/567db03c91854ad9af1e9a87ec1bd275 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 07:56:35.922298 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64c14ed-238c-4efd-b90b-a2118d5c495f admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:56:35.935579 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64c14ed-238c-4efd-b90b-a2118d5c495f admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:56:36.110111 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abc22ab-7b47-42b7-ac72-7bf8879082dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:56:36.110111 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abc22ab-7b47-42b7-ac72-7bf8879082dd admin admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:36.110111 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abc22ab-7b47-42b7-ac72-7bf8879082dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:36.110111 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abc22ab-7b47-42b7-ac72-7bf8879082dd admin admin] PATH_INFO: `/v3/roles` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:36.110433 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abc22ab-7b47-42b7-ac72-7bf8879082dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:56:36.111953 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abc22ab-7b47-42b7-ac72-7bf8879082dd admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:56:36.138792 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1171/2329] 10.222.0.57 () {58 vars in 1122 bytes} [Fri Sep 16 07:56:35 2022] GET /identity/v3/roles => generated 1420 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 07:56:36.143612 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f994d2d-517d-4750-9b3d-68ef18314fe2 admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:56:36.164553 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f994d2d-517d-4750-9b3d-68ef18314fe2 admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:56:36.178562 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529fca0b-3939-483c-9d26-7d05b67ae436 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:56:36.182170 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529fca0b-3939-483c-9d26-7d05b67ae436 admin admin] REQUEST_METHOD: `PUT` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:36.182849 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529fca0b-3939-483c-9d26-7d05b67ae436 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:36.183359 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529fca0b-3939-483c-9d26-7d05b67ae436 admin admin] PATH_INFO: `/v3/projects/d80285f6838748859f17d9f353ec3680/users/cf2e0c4518d34fc78a16961fbcdf414f/roles/567db03c91854ad9af1e9a87ec1bd275` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:36.187806 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529fca0b-3939-483c-9d26-7d05b67ae436 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d80285f6838748859f17d9f353ec3680, user_id=cf2e0c4518d34fc78a16961fbcdf414f, role_id=567db03c91854ad9af1e9a87ec1bd275)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:56:36.191045 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529fca0b-3939-483c-9d26-7d05b67ae436 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:56:36.212122 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1159/2330] 10.222.0.57 () {60 vars in 1483 bytes} [Fri Sep 16 07:56:36 2022] PUT /identity/v3/projects/d80285f6838748859f17d9f353ec3680/users/cf2e0c4518d34fc78a16961fbcdf414f/roles/567db03c91854ad9af1e9a87ec1bd275 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 07:56:36.223452 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8000c950-bb25-4f1e-b0ce-28865ca317a0 None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:36.223780 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8000c950-bb25-4f1e-b0ce-28865ca317a0 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:36.223999 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8000c950-bb25-4f1e-b0ce-28865ca317a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:36.260099 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-8000c950-bb25-4f1e-b0ce-28865ca317a0 None None] MFA Rules not processed for user `cf2e0c4518d34fc78a16961fbcdf414f`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:56:36.262626 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-8000c950-bb25-4f1e-b0ce-28865ca317a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:56:36.374316 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1172/2331] 10.222.0.57 () {58 vars in 958 bytes} [Fri Sep 16 07:56:36 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 07:56:36.376278 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529fca0b-3939-483c-9d26-7d05b67ae436 admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:56:36.378396 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-529fca0b-3939-483c-9d26-7d05b67ae436 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:56:36.466617 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529fca0b-3939-483c-9d26-7d05b67ae436 admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:56:36.470587 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf8b3c4-d053-4f18-a1db-aa3bc7388e79 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544bf6be4c24454a013ca110c43cef2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4735f453c0c24cc4a1c14e9ac84a0b46', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:56:36.471207 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf8b3c4-d053-4f18-a1db-aa3bc7388e79 service cinder] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:36.471483 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf8b3c4-d053-4f18-a1db-aa3bc7388e79 service cinder] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:36.471844 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf8b3c4-d053-4f18-a1db-aa3bc7388e79 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:36.548530 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf8b3c4-d053-4f18-a1db-aa3bc7388e79 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:56:36.550407 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf8b3c4-d053-4f18-a1db-aa3bc7388e79 service cinder] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:56:36.567044 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1160/2332] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Sep 16 07:56:36 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 07:56:37.224088 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5235b46c-7e80-448d-a537-3aa8bee5545d None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:37.224919 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5235b46c-7e80-448d-a537-3aa8bee5545d None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:37.227803 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5235b46c-7e80-448d-a537-3aa8bee5545d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:37.302374 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-5235b46c-7e80-448d-a537-3aa8bee5545d None None] MFA Rules not processed for user `ed7a1886d2184619bb493de128365fa2`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:56:37.306434 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-5235b46c-7e80-448d-a537-3aa8bee5545d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:56:37.490724 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1173/2333] 10.222.0.57 () {58 vars in 958 bytes} [Fri Sep 16 07:56:37 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 07:56:37.494023 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf8b3c4-d053-4f18-a1db-aa3bc7388e79 service cinder] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:56:37.497250 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-caf8b3c4-d053-4f18-a1db-aa3bc7388e79 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:56:37.639482 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf8b3c4-d053-4f18-a1db-aa3bc7388e79 service cinder] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:56:37.655481 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dede55c1-67c1-4a98-80cf-f2b6a4067350 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:56:37.656751 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dede55c1-67c1-4a98-80cf-f2b6a4067350 admin admin] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:37.658801 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dede55c1-67c1-4a98-80cf-f2b6a4067350 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:37.661880 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dede55c1-67c1-4a98-80cf-f2b6a4067350 admin admin] PATH_INFO: `/v3/projects` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:37.664031 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dede55c1-67c1-4a98-80cf-f2b6a4067350 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:56:37.678519 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dede55c1-67c1-4a98-80cf-f2b6a4067350 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:56:37.772167 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1161/2334] 10.222.0.57 () {60 vars in 1153 bytes} [Fri Sep 16 07:56:37 2022] POST /identity/v3/projects => generated 373 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 07:56:37.782786 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5235b46c-7e80-448d-a537-3aa8bee5545d None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:56:37.802657 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:56:37.810468 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5235b46c-7e80-448d-a537-3aa8bee5545d None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:56:37.925821 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7792687c-78cd-4d68-bf36-934d9698d4b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:56:37.926578 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7792687c-78cd-4d68-bf36-934d9698d4b7 admin admin] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:37.926772 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7792687c-78cd-4d68-bf36-934d9698d4b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:37.926989 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7792687c-78cd-4d68-bf36-934d9698d4b7 admin admin] PATH_INFO: `/v3/users` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:37.927692 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7792687c-78cd-4d68-bf36-934d9698d4b7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:56:37.929758 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7792687c-78cd-4d68-bf36-934d9698d4b7 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:56:37.956924 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1174/2335] 10.222.0.57 () {60 vars in 1144 bytes} [Fri Sep 16 07:56:37 2022] POST /identity/v3/users => generated 293 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 07:56:37.961597 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dede55c1-67c1-4a98-80cf-f2b6a4067350 admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:56:37.969380 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:56:37.978552 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dede55c1-67c1-4a98-80cf-f2b6a4067350 admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:56:37.985806 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d93163-75e2-4874-a428-c186ed1cca21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:56:37.987414 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d93163-75e2-4874-a428-c186ed1cca21 admin admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:37.987912 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d93163-75e2-4874-a428-c186ed1cca21 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:37.988243 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d93163-75e2-4874-a428-c186ed1cca21 admin admin] PATH_INFO: `/v3/roles` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:37.989083 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d93163-75e2-4874-a428-c186ed1cca21 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:56:37.990894 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d93163-75e2-4874-a428-c186ed1cca21 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:56:38.002728 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1162/2336] 10.222.0.57 () {58 vars in 1122 bytes} [Fri Sep 16 07:56:37 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 07:56:38.006996 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7792687c-78cd-4d68-bf36-934d9698d4b7 admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:56:38.017623 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7792687c-78cd-4d68-bf36-934d9698d4b7 admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:56:38.022288 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc5dbd9-7363-423c-a3f8-4df636b01271 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:56:38.022996 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc5dbd9-7363-423c-a3f8-4df636b01271 admin admin] REQUEST_METHOD: `PUT` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:38.023288 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc5dbd9-7363-423c-a3f8-4df636b01271 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:38.023560 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc5dbd9-7363-423c-a3f8-4df636b01271 admin admin] PATH_INFO: `/v3/projects/cdfbeab307284394abaaf2efef91f362/users/34f9d38540fd43f4a10e319931f69059/roles/567db03c91854ad9af1e9a87ec1bd275` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:38.039750 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc5dbd9-7363-423c-a3f8-4df636b01271 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cdfbeab307284394abaaf2efef91f362, user_id=34f9d38540fd43f4a10e319931f69059, role_id=567db03c91854ad9af1e9a87ec1bd275)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:56:38.042628 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc5dbd9-7363-423c-a3f8-4df636b01271 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:56:38.061173 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1175/2337] 10.222.0.57 () {60 vars in 1483 bytes} [Fri Sep 16 07:56:38 2022] PUT /identity/v3/projects/cdfbeab307284394abaaf2efef91f362/users/34f9d38540fd43f4a10e319931f69059/roles/567db03c91854ad9af1e9a87ec1bd275 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 07:56:38.065517 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d93163-75e2-4874-a428-c186ed1cca21 admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:56:38.078465 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d93163-75e2-4874-a428-c186ed1cca21 admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:56:38.140215 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe1cc1d-d032-41cb-bc1c-eaf294e5822d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:56:38.140856 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe1cc1d-d032-41cb-bc1c-eaf294e5822d admin admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:38.141112 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe1cc1d-d032-41cb-bc1c-eaf294e5822d admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:38.141433 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe1cc1d-d032-41cb-bc1c-eaf294e5822d admin admin] PATH_INFO: `/v3/roles` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:38.142053 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe1cc1d-d032-41cb-bc1c-eaf294e5822d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:56:38.143651 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe1cc1d-d032-41cb-bc1c-eaf294e5822d admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:56:38.153350 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1163/2338] 10.222.0.57 () {58 vars in 1122 bytes} [Fri Sep 16 07:56:38 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 07:56:38.158449 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc5dbd9-7363-423c-a3f8-4df636b01271 admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:56:38.169681 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc5dbd9-7363-423c-a3f8-4df636b01271 admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:56:38.174832 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613aa639-f2b6-4f8b-a610-8ba5dc226307 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:56:38.175491 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613aa639-f2b6-4f8b-a610-8ba5dc226307 admin admin] REQUEST_METHOD: `PUT` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:38.175761 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613aa639-f2b6-4f8b-a610-8ba5dc226307 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:38.176023 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613aa639-f2b6-4f8b-a610-8ba5dc226307 admin admin] PATH_INFO: `/v3/projects/cdfbeab307284394abaaf2efef91f362/users/34f9d38540fd43f4a10e319931f69059/roles/567db03c91854ad9af1e9a87ec1bd275` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:38.177932 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613aa639-f2b6-4f8b-a610-8ba5dc226307 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cdfbeab307284394abaaf2efef91f362, user_id=34f9d38540fd43f4a10e319931f69059, role_id=567db03c91854ad9af1e9a87ec1bd275)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:56:38.180636 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613aa639-f2b6-4f8b-a610-8ba5dc226307 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:56:38.193706 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1176/2339] 10.222.0.57 () {60 vars in 1483 bytes} [Fri Sep 16 07:56:38 2022] PUT /identity/v3/projects/cdfbeab307284394abaaf2efef91f362/users/34f9d38540fd43f4a10e319931f69059/roles/567db03c91854ad9af1e9a87ec1bd275 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 07:56:42.188514 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe1cc1d-d032-41cb-bc1c-eaf294e5822d admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:56:42.324975 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe1cc1d-d032-41cb-bc1c-eaf294e5822d admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:56:42.448582 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3256d92-c87f-4b74-b932-b7ccfda742c7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544bf6be4c24454a013ca110c43cef2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4735f453c0c24cc4a1c14e9ac84a0b46', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:56:42.449202 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3256d92-c87f-4b74-b932-b7ccfda742c7 service cinder] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:42.449824 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3256d92-c87f-4b74-b932-b7ccfda742c7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:42.449824 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3256d92-c87f-4b74-b932-b7ccfda742c7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:42.595130 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:56:42.600567 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3256d92-c87f-4b74-b932-b7ccfda742c7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:56:42.602201 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3256d92-c87f-4b74-b932-b7ccfda742c7 service cinder] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:56:42.620831 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1164/2340] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Sep 16 07:56:42 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 433 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 07:56:46.278633 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29cdd44-614d-4edf-a94f-c0127d7505c1 None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:46.279165 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29cdd44-614d-4edf-a94f-c0127d7505c1 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:46.279165 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29cdd44-614d-4edf-a94f-c0127d7505c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:46.334008 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-d29cdd44-614d-4edf-a94f-c0127d7505c1 None None] MFA Rules not processed for user `34f9d38540fd43f4a10e319931f69059`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:56:46.335243 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-d29cdd44-614d-4edf-a94f-c0127d7505c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:56:46.421578 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1177/2341] 10.222.0.57 () {58 vars in 958 bytes} [Fri Sep 16 07:56:46 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 07:56:46.435321 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3256d92-c87f-4b74-b932-b7ccfda742c7 service cinder] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:56:46.438573 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-e3256d92-c87f-4b74-b932-b7ccfda742c7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:56:46.538555 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3256d92-c87f-4b74-b932-b7ccfda742c7 service cinder] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:56:46.546632 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b0c3e3-942c-47f4-a4cc-4361f8a11c47 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bec4d9b08514461a1bf63c6b88f53b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4735f453c0c24cc4a1c14e9ac84a0b46', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:56:46.547669 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b0c3e3-942c-47f4-a4cc-4361f8a11c47 service nova] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:46.548149 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b0c3e3-942c-47f4-a4cc-4361f8a11c47 service nova] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:46.548484 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b0c3e3-942c-47f4-a4cc-4361f8a11c47 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:46.688494 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b0c3e3-942c-47f4-a4cc-4361f8a11c47 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:56:46.704232 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b0c3e3-942c-47f4-a4cc-4361f8a11c47 service nova] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:56:46.760524 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1165/2342] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Sep 16 07:56:46 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 07:56:48.074591 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be76dff-f593-414c-9d6f-54f72ab280e8 None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:48.075096 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be76dff-f593-414c-9d6f-54f72ab280e8 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:48.075210 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be76dff-f593-414c-9d6f-54f72ab280e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:48.105827 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-6be76dff-f593-414c-9d6f-54f72ab280e8 None None] MFA Rules not processed for user `ed7a1886d2184619bb493de128365fa2`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:56:48.107031 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-6be76dff-f593-414c-9d6f-54f72ab280e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:56:48.114782 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1178/2343] 10.222.0.57 () {58 vars in 958 bytes} [Fri Sep 16 07:56:48 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 16 07:56:48.676764 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b0c3e3-942c-47f4-a4cc-4361f8a11c47 service nova] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:56:48.862016 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b0c3e3-942c-47f4-a4cc-4361f8a11c47 service nova] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:56:48.868636 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0c950b-edcd-464a-8f28-8697a45dc29d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:56:48.870179 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0c950b-edcd-464a-8f28-8697a45dc29d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:48.872378 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0c950b-edcd-464a-8f28-8697a45dc29d admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:48.873069 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0c950b-edcd-464a-8f28-8697a45dc29d admin admin] PATH_INFO: `/v3/users/62607591bc8748b29fbb1246d90d874c` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:48.876186 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0c950b-edcd-464a-8f28-8697a45dc29d admin admin] RBAC: Authorizing `identity:delete_user(user_id=62607591bc8748b29fbb1246d90d874c)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:56:48.881143 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0c950b-edcd-464a-8f28-8697a45dc29d admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:56:48.925392 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:56:48.945212 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-5a0c950b-edcd-464a-8f28-8697a45dc29d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '62607591bc8748b29fbb1246d90d874c'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:56:48.946267 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-5a0c950b-edcd-464a-8f28-8697a45dc29d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '62607591bc8748b29fbb1246d90d874c'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:56:48.958189 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-5a0c950b-edcd-464a-8f28-8697a45dc29d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '62607591bc8748b29fbb1246d90d874c'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:56:48.974764 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-5a0c950b-edcd-464a-8f28-8697a45dc29d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '62607591bc8748b29fbb1246d90d874c'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:56:48.974956 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be76dff-f593-414c-9d6f-54f72ab280e8 None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:56:48.976581 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-6be76dff-f593-414c-9d6f-54f72ab280e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:56:48.984178 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-5a0c950b-edcd-464a-8f28-8697a45dc29d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '62607591bc8748b29fbb1246d90d874c'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:56:48.995402 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be76dff-f593-414c-9d6f-54f72ab280e8 None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:56:49.002649 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1166/2344] 10.222.0.57 () {58 vars in 1224 bytes} [Fri Sep 16 07:56:48 2022] DELETE /identity/v3/users/62607591bc8748b29fbb1246d90d874c => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 07:56:49.007502 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d786af-77aa-4e5b-873f-6e90af39bb3e None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:49.008351 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d786af-77aa-4e5b-873f-6e90af39bb3e None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:49.008819 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d786af-77aa-4e5b-873f-6e90af39bb3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:49.035415 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-b2d786af-77aa-4e5b-873f-6e90af39bb3e None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:56:49.036649 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-b2d786af-77aa-4e5b-873f-6e90af39bb3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:56:49.041303 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:56:49.086213 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b073f0b3-38c9-4a0d-961a-08957319c312 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:56:49.087974 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b073f0b3-38c9-4a0d-961a-08957319c312 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:49.088566 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b073f0b3-38c9-4a0d-961a-08957319c312 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:49.088965 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b073f0b3-38c9-4a0d-961a-08957319c312 admin admin] PATH_INFO: `/v3/users/ad110f845b8b4e549bf9a4ec9e39204f` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:49.090503 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b073f0b3-38c9-4a0d-961a-08957319c312 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ad110f845b8b4e549bf9a4ec9e39204f)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:56:49.093756 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b073f0b3-38c9-4a0d-961a-08957319c312 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:56:49.133214 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1167/2345] 10.222.0.57 () {58 vars in 958 bytes} [Fri Sep 16 07:56:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 07:56:49.146052 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d786af-77aa-4e5b-873f-6e90af39bb3e None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:56:49.153778 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-b2d786af-77aa-4e5b-873f-6e90af39bb3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:56:49.167110 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-b073f0b3-38c9-4a0d-961a-08957319c312 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ad110f845b8b4e549bf9a4ec9e39204f'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:56:49.181977 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-b073f0b3-38c9-4a0d-961a-08957319c312 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ad110f845b8b4e549bf9a4ec9e39204f'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:56:49.182774 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-b073f0b3-38c9-4a0d-961a-08957319c312 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ad110f845b8b4e549bf9a4ec9e39204f'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:56:49.194214 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-b073f0b3-38c9-4a0d-961a-08957319c312 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ad110f845b8b4e549bf9a4ec9e39204f'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:56:49.205674 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-b073f0b3-38c9-4a0d-961a-08957319c312 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ad110f845b8b4e549bf9a4ec9e39204f'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:56:49.211976 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1179/2346] 10.222.0.57 () {58 vars in 1224 bytes} [Fri Sep 16 07:56:48 2022] DELETE /identity/v3/users/ad110f845b8b4e549bf9a4ec9e39204f => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 16 07:56:49.216542 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b42f049-3855-4b05-bfa7-12aff1d82682 None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:49.216768 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b42f049-3855-4b05-bfa7-12aff1d82682 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:49.217675 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b42f049-3855-4b05-bfa7-12aff1d82682 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:49.237888 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d786af-77aa-4e5b-873f-6e90af39bb3e None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:56:49.245890 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-9b42f049-3855-4b05-bfa7-12aff1d82682 None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:56:49.247305 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-9b42f049-3855-4b05-bfa7-12aff1d82682 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:56:49.312603 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7dd659-45a3-4991-a9db-3b6a3dc55fb0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1062e457207a41e4ba4f0a0c4bf36f1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4735f453c0c24cc4a1c14e9ac84a0b46', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:56:49.313599 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7dd659-45a3-4991-a9db-3b6a3dc55fb0 service neutron] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:49.315757 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7dd659-45a3-4991-a9db-3b6a3dc55fb0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:49.316165 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7dd659-45a3-4991-a9db-3b6a3dc55fb0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:49.318855 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-9d7dd659-45a3-4991-a9db-3b6a3dc55fb0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:56:49.333711 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1180/2347] 10.222.0.57 () {58 vars in 958 bytes} [Fri Sep 16 07:56:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 07:56:49.345488 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b42f049-3855-4b05-bfa7-12aff1d82682 None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:56:49.347223 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-9b42f049-3855-4b05-bfa7-12aff1d82682 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:56:49.353870 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:56:49.370978 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b42f049-3855-4b05-bfa7-12aff1d82682 None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:56:49.381760 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47982a3d-1d58-4c66-acea-085feeb0aa17 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1062e457207a41e4ba4f0a0c4bf36f1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4735f453c0c24cc4a1c14e9ac84a0b46', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:56:49.382513 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47982a3d-1d58-4c66-acea-085feeb0aa17 service neutron] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:49.383305 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47982a3d-1d58-4c66-acea-085feeb0aa17 service neutron] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:49.383305 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47982a3d-1d58-4c66-acea-085feeb0aa17 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:49.407850 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47982a3d-1d58-4c66-acea-085feeb0aa17 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:56:49.410627 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47982a3d-1d58-4c66-acea-085feeb0aa17 service neutron] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:56:49.429492 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7dd659-45a3-4991-a9db-3b6a3dc55fb0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:56:49.430953 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1181/2348] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Sep 16 07:56:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 16 07:56:49.431078 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7dd659-45a3-4991-a9db-3b6a3dc55fb0 service neutron] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:56:49.442986 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1168/2349] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Sep 16 07:56:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 16 07:56:49.970177 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47982a3d-1d58-4c66-acea-085feeb0aa17 service neutron] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:56:49.973747 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-47982a3d-1d58-4c66-acea-085feeb0aa17 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:56:50.007657 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47982a3d-1d58-4c66-acea-085feeb0aa17 service neutron] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:56:50.009878 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7dd659-45a3-4991-a9db-3b6a3dc55fb0 service neutron] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:56:50.011630 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-9d7dd659-45a3-4991-a9db-3b6a3dc55fb0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:56:50.016533 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ef5227-19a7-4454-84e2-7963adedac56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:56:50.018015 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ef5227-19a7-4454-84e2-7963adedac56 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:50.018306 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ef5227-19a7-4454-84e2-7963adedac56 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:50.018582 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ef5227-19a7-4454-84e2-7963adedac56 admin admin] PATH_INFO: `/v3/users/4b8eb513adf64d9fb38cf016ec8e3f87` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:50.019742 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ef5227-19a7-4454-84e2-7963adedac56 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4b8eb513adf64d9fb38cf016ec8e3f87)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:56:50.021776 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ef5227-19a7-4454-84e2-7963adedac56 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:56:50.035512 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7dd659-45a3-4991-a9db-3b6a3dc55fb0 service neutron] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:56:50.050875 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e9d4fc-7ec9-40db-9bcd-8f7a47416f39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:56:50.051733 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e9d4fc-7ec9-40db-9bcd-8f7a47416f39 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:50.052258 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e9d4fc-7ec9-40db-9bcd-8f7a47416f39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:50.052595 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e9d4fc-7ec9-40db-9bcd-8f7a47416f39 admin admin] PATH_INFO: `/v3/projects/f541f8d2bba5497d830abb3eff2c53f4` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:50.055910 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e9d4fc-7ec9-40db-9bcd-8f7a47416f39 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f541f8d2bba5497d830abb3eff2c53f4)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:56:50.060546 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e9d4fc-7ec9-40db-9bcd-8f7a47416f39 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:56:50.130976 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:56:50.144924 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-58e9d4fc-7ec9-40db-9bcd-8f7a47416f39 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f541f8d2bba5497d830abb3eff2c53f4', 'request_id': 'req-58e9d4fc-7ec9-40db-9bcd-8f7a47416f39'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:56:50.151980 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-c6ef5227-19a7-4454-84e2-7963adedac56 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4b8eb513adf64d9fb38cf016ec8e3f87'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:56:50.155328 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-58e9d4fc-7ec9-40db-9bcd-8f7a47416f39 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f541f8d2bba5497d830abb3eff2c53f4', 'request_id': 'req-58e9d4fc-7ec9-40db-9bcd-8f7a47416f39'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:56:50.163400 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-58e9d4fc-7ec9-40db-9bcd-8f7a47416f39 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f541f8d2bba5497d830abb3eff2c53f4', 'request_id': 'req-58e9d4fc-7ec9-40db-9bcd-8f7a47416f39'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:56:50.174884 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-c6ef5227-19a7-4454-84e2-7963adedac56 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4b8eb513adf64d9fb38cf016ec8e3f87'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:56:50.177293 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-c6ef5227-19a7-4454-84e2-7963adedac56 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4b8eb513adf64d9fb38cf016ec8e3f87'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:56:50.180082 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-58e9d4fc-7ec9-40db-9bcd-8f7a47416f39 admin admin] The token cache is being invalidate because project f541f8d2bba5497d830abb3eff2c53f4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81430) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 07:56:50.180369 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-58e9d4fc-7ec9-40db-9bcd-8f7a47416f39 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:56:50.181532 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-58e9d4fc-7ec9-40db-9bcd-8f7a47416f39 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:56:50.186651 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1169/2350] 10.222.0.57 () {58 vars in 1233 bytes} [Fri Sep 16 07:56:50 2022] DELETE /identity/v3/projects/f541f8d2bba5497d830abb3eff2c53f4 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 07:56:50.186651 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e9d4fc-7ec9-40db-9bcd-8f7a47416f39 admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:56:50.186651 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-58e9d4fc-7ec9-40db-9bcd-8f7a47416f39 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:56:50.194363 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-c6ef5227-19a7-4454-84e2-7963adedac56 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4b8eb513adf64d9fb38cf016ec8e3f87'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:56:50.205569 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-c6ef5227-19a7-4454-84e2-7963adedac56 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4b8eb513adf64d9fb38cf016ec8e3f87'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:56:50.218238 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1182/2351] 10.222.0.57 () {58 vars in 1224 bytes} [Fri Sep 16 07:56:49 2022] DELETE /identity/v3/users/4b8eb513adf64d9fb38cf016ec8e3f87 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 07:56:50.219946 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ef5227-19a7-4454-84e2-7963adedac56 admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:56:50.221830 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-c6ef5227-19a7-4454-84e2-7963adedac56 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:56:50.287029 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e9d4fc-7ec9-40db-9bcd-8f7a47416f39 admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:56:50.298536 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ef5227-19a7-4454-84e2-7963adedac56 admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:56:50.300112 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1883da67-4c70-4705-86d7-011bcdbc45d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:56:50.300750 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1883da67-4c70-4705-86d7-011bcdbc45d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:50.301098 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1883da67-4c70-4705-86d7-011bcdbc45d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:50.301380 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1883da67-4c70-4705-86d7-011bcdbc45d4 admin admin] PATH_INFO: `/v3/projects/e3b3c08ee6474ce6915a743e05f0afa4` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:50.302612 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1883da67-4c70-4705-86d7-011bcdbc45d4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e3b3c08ee6474ce6915a743e05f0afa4)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:56:50.303869 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafe537e-8422-4b65-9678-1f79b851cbef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:56:50.304606 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafe537e-8422-4b65-9678-1f79b851cbef admin admin] REQUEST_METHOD: `DELETE` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:50.304991 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafe537e-8422-4b65-9678-1f79b851cbef admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:50.305355 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafe537e-8422-4b65-9678-1f79b851cbef admin admin] PATH_INFO: `/v3/users/cf2e0c4518d34fc78a16961fbcdf414f` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:50.305510 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1883da67-4c70-4705-86d7-011bcdbc45d4 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:56:50.306703 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cafe537e-8422-4b65-9678-1f79b851cbef admin admin] RBAC: Authorizing `identity:delete_user(user_id=cf2e0c4518d34fc78a16961fbcdf414f)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:56:50.308707 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cafe537e-8422-4b65-9678-1f79b851cbef admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:56:50.414449 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-cafe537e-8422-4b65-9678-1f79b851cbef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cf2e0c4518d34fc78a16961fbcdf414f'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:56:50.431477 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:56:50.448506 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-1883da67-4c70-4705-86d7-011bcdbc45d4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e3b3c08ee6474ce6915a743e05f0afa4', 'request_id': 'req-1883da67-4c70-4705-86d7-011bcdbc45d4'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:56:50.451589 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-cafe537e-8422-4b65-9678-1f79b851cbef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cf2e0c4518d34fc78a16961fbcdf414f'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:56:50.452388 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-cafe537e-8422-4b65-9678-1f79b851cbef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cf2e0c4518d34fc78a16961fbcdf414f'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:56:50.461223 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-cafe537e-8422-4b65-9678-1f79b851cbef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cf2e0c4518d34fc78a16961fbcdf414f'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:56:50.464410 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-1883da67-4c70-4705-86d7-011bcdbc45d4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e3b3c08ee6474ce6915a743e05f0afa4', 'request_id': 'req-1883da67-4c70-4705-86d7-011bcdbc45d4'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:56:50.470006 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-cafe537e-8422-4b65-9678-1f79b851cbef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cf2e0c4518d34fc78a16961fbcdf414f'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:56:50.475779 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-1883da67-4c70-4705-86d7-011bcdbc45d4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e3b3c08ee6474ce6915a743e05f0afa4', 'request_id': 'req-1883da67-4c70-4705-86d7-011bcdbc45d4'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:56:50.476843 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1183/2352] 10.222.0.57 () {58 vars in 1224 bytes} [Fri Sep 16 07:56:50 2022] DELETE /identity/v3/users/cf2e0c4518d34fc78a16961fbcdf414f => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 07:56:50.478277 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff74447-9986-4590-8d08-bfb9d5b9b23f None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:50.478570 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff74447-9986-4590-8d08-bfb9d5b9b23f None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:50.478845 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff74447-9986-4590-8d08-bfb9d5b9b23f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:50.502558 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-1883da67-4c70-4705-86d7-011bcdbc45d4 admin admin] The token cache is being invalidate because project e3b3c08ee6474ce6915a743e05f0afa4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81430) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 07:56:50.502892 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-1883da67-4c70-4705-86d7-011bcdbc45d4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:56:50.505356 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-1883da67-4c70-4705-86d7-011bcdbc45d4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:56:50.511290 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1170/2353] 10.222.0.57 () {58 vars in 1233 bytes} [Fri Sep 16 07:56:50 2022] DELETE /identity/v3/projects/e3b3c08ee6474ce6915a743e05f0afa4 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 07:56:50.519397 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd94ebe-835c-4418-94d8-fc5e6970c8da None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:50.519685 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd94ebe-835c-4418-94d8-fc5e6970c8da None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:50.519974 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd94ebe-835c-4418-94d8-fc5e6970c8da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:50.521765 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-9ff74447-9986-4590-8d08-bfb9d5b9b23f None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:56:50.522955 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-9ff74447-9986-4590-8d08-bfb9d5b9b23f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:56:50.548478 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-dcd94ebe-835c-4418-94d8-fc5e6970c8da None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:56:50.549541 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-dcd94ebe-835c-4418-94d8-fc5e6970c8da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:56:50.578238 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:56:50.658627 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1171/2354] 10.222.0.57 () {58 vars in 958 bytes} [Fri Sep 16 07:56:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 07:56:50.662241 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1184/2355] 10.222.0.57 () {58 vars in 958 bytes} [Fri Sep 16 07:56:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 07:56:50.666355 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51ad3c0-6051-4755-b2b3-344c5318f4bb None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:50.666737 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51ad3c0-6051-4755-b2b3-344c5318f4bb None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:50.668655 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51ad3c0-6051-4755-b2b3-344c5318f4bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:50.674877 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff74447-9986-4590-8d08-bfb9d5b9b23f None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:56:50.676459 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-9ff74447-9986-4590-8d08-bfb9d5b9b23f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:56:50.700797 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-f51ad3c0-6051-4755-b2b3-344c5318f4bb None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:56:50.702511 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-f51ad3c0-6051-4755-b2b3-344c5318f4bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:56:50.717604 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1172/2356] 10.222.0.57 () {58 vars in 958 bytes} [Fri Sep 16 07:56:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 07:56:50.730240 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51ad3c0-6051-4755-b2b3-344c5318f4bb None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:56:50.764787 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51ad3c0-6051-4755-b2b3-344c5318f4bb None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:56:50.779776 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f12b62-cbef-499d-9e14-f124304c4eca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:56:50.780415 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f12b62-cbef-499d-9e14-f124304c4eca admin admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:50.788523 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f12b62-cbef-499d-9e14-f124304c4eca admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:50.789070 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f12b62-cbef-499d-9e14-f124304c4eca admin admin] PATH_INFO: `/v3/domains` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:50.789923 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f12b62-cbef-499d-9e14-f124304c4eca admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:56:50.790342 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f12b62-cbef-499d-9e14-f124304c4eca admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:56:50.792040 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f12b62-cbef-499d-9e14-f124304c4eca admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:56:50.794879 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff74447-9986-4590-8d08-bfb9d5b9b23f None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:56:50.817709 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ccf7a0-f740-4262-9bc5-c3bbe7234643 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1062e457207a41e4ba4f0a0c4bf36f1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4735f453c0c24cc4a1c14e9ac84a0b46', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:56:50.818349 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ccf7a0-f740-4262-9bc5-c3bbe7234643 service neutron] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:50.818782 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1173/2357] 10.222.0.57 () {58 vars in 1153 bytes} [Fri Sep 16 07:56:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:56:50.822938 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f12b62-cbef-499d-9e14-f124304c4eca admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:56:50.823765 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ccf7a0-f740-4262-9bc5-c3bbe7234643 service neutron] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:50.824071 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ccf7a0-f740-4262-9bc5-c3bbe7234643 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:50.835253 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f12b62-cbef-499d-9e14-f124304c4eca admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:56:50.840934 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c49a9e-3d34-4741-b865-ea86f3ac0a62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:56:50.841534 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c49a9e-3d34-4741-b865-ea86f3ac0a62 admin admin] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:50.841914 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c49a9e-3d34-4741-b865-ea86f3ac0a62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:50.842190 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c49a9e-3d34-4741-b865-ea86f3ac0a62 admin admin] PATH_INFO: `/v3/projects` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:50.842924 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c49a9e-3d34-4741-b865-ea86f3ac0a62 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:56:50.844841 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c49a9e-3d34-4741-b865-ea86f3ac0a62 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:56:50.867115 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ccf7a0-f740-4262-9bc5-c3bbe7234643 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:56:50.869544 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ccf7a0-f740-4262-9bc5-c3bbe7234643 service neutron] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:56:50.885532 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1174/2358] 10.222.0.57 () {60 vars in 1153 bytes} [Fri Sep 16 07:56:50 2022] POST /identity/v3/projects => generated 399 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 16 07:56:50.887098 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c49a9e-3d34-4741-b865-ea86f3ac0a62 admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:56:50.898075 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1185/2359] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Sep 16 07:56:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 07:56:51.039186 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c49a9e-3d34-4741-b865-ea86f3ac0a62 admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:56:51.059727 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cad2c1-a3f0-4b7e-94fe-e63f3fac91c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:56:51.062631 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cad2c1-a3f0-4b7e-94fe-e63f3fac91c2 admin admin] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:51.062931 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cad2c1-a3f0-4b7e-94fe-e63f3fac91c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:51.063218 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cad2c1-a3f0-4b7e-94fe-e63f3fac91c2 admin admin] PATH_INFO: `/v3/users` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:51.063876 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04cad2c1-a3f0-4b7e-94fe-e63f3fac91c2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:56:51.065838 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04cad2c1-a3f0-4b7e-94fe-e63f3fac91c2 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:56:51.109928 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ccf7a0-f740-4262-9bc5-c3bbe7234643 service neutron] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:56:51.116347 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-00ccf7a0-f740-4262-9bc5-c3bbe7234643 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:56:51.140780 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1175/2360] 10.222.0.57 () {60 vars in 1144 bytes} [Fri Sep 16 07:56:50 2022] POST /identity/v3/users => generated 300 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 07:56:51.147741 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cad2c1-a3f0-4b7e-94fe-e63f3fac91c2 admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:56:51.161948 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ccf7a0-f740-4262-9bc5-c3bbe7234643 service neutron] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:56:51.185297 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cad2c1-a3f0-4b7e-94fe-e63f3fac91c2 admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:56:51.193758 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644b73b7-a60a-4a2d-a4ca-8fcb9c87621a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:56:51.193758 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644b73b7-a60a-4a2d-a4ca-8fcb9c87621a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:51.193758 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644b73b7-a60a-4a2d-a4ca-8fcb9c87621a admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:51.194116 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644b73b7-a60a-4a2d-a4ca-8fcb9c87621a admin admin] PATH_INFO: `/v3/projects/d80285f6838748859f17d9f353ec3680` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:51.205578 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644b73b7-a60a-4a2d-a4ca-8fcb9c87621a admin admin] RBAC: Authorizing `identity:delete_project(project_id=d80285f6838748859f17d9f353ec3680)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:56:51.207734 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644b73b7-a60a-4a2d-a4ca-8fcb9c87621a admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:56:51.232862 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf46698-f7f8-4220-a984-7f9afbc86abf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:56:51.237852 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf46698-f7f8-4220-a984-7f9afbc86abf admin admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:51.238182 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf46698-f7f8-4220-a984-7f9afbc86abf admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:51.238429 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf46698-f7f8-4220-a984-7f9afbc86abf admin admin] PATH_INFO: `/v3/roles` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:51.239269 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf46698-f7f8-4220-a984-7f9afbc86abf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:56:51.240720 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf46698-f7f8-4220-a984-7f9afbc86abf admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:56:51.281911 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1176/2361] 10.222.0.57 () {58 vars in 1122 bytes} [Fri Sep 16 07:56:51 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 07:56:51.285992 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf46698-f7f8-4220-a984-7f9afbc86abf admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:56:51.310752 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf46698-f7f8-4220-a984-7f9afbc86abf admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:56:51.321949 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=91,keystone:DELETE=4,keystone:INSERT=5 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:56:51.334796 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-644b73b7-a60a-4a2d-a4ca-8fcb9c87621a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd80285f6838748859f17d9f353ec3680', 'request_id': 'req-644b73b7-a60a-4a2d-a4ca-8fcb9c87621a'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:56:51.355648 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-644b73b7-a60a-4a2d-a4ca-8fcb9c87621a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd80285f6838748859f17d9f353ec3680', 'request_id': 'req-644b73b7-a60a-4a2d-a4ca-8fcb9c87621a'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:56:51.367844 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-644b73b7-a60a-4a2d-a4ca-8fcb9c87621a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd80285f6838748859f17d9f353ec3680', 'request_id': 'req-644b73b7-a60a-4a2d-a4ca-8fcb9c87621a'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:56:51.391234 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-644b73b7-a60a-4a2d-a4ca-8fcb9c87621a admin admin] The token cache is being invalidate because project d80285f6838748859f17d9f353ec3680 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81431) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 07:56:51.391607 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-644b73b7-a60a-4a2d-a4ca-8fcb9c87621a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:56:51.393441 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-644b73b7-a60a-4a2d-a4ca-8fcb9c87621a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:56:51.398254 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1186/2362] 10.222.0.57 () {58 vars in 1233 bytes} [Fri Sep 16 07:56:51 2022] DELETE /identity/v3/projects/d80285f6838748859f17d9f353ec3680 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 07:56:51.402338 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34405abb-c8d2-43e9-bf17-a9bf85bb7058 None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:51.402778 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34405abb-c8d2-43e9-bf17-a9bf85bb7058 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:51.403114 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34405abb-c8d2-43e9-bf17-a9bf85bb7058 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:51.437026 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-34405abb-c8d2-43e9-bf17-a9bf85bb7058 None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:56:51.438357 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90daa7a8-e8d9-4d6e-b623-0060f396fdd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:56:51.438515 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-34405abb-c8d2-43e9-bf17-a9bf85bb7058 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:56:51.438975 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90daa7a8-e8d9-4d6e-b623-0060f396fdd9 admin admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:51.439257 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90daa7a8-e8d9-4d6e-b623-0060f396fdd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:51.439601 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90daa7a8-e8d9-4d6e-b623-0060f396fdd9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:51.440678 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90daa7a8-e8d9-4d6e-b623-0060f396fdd9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:56:51.443311 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90daa7a8-e8d9-4d6e-b623-0060f396fdd9 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:56:51.449782 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1187/2363] 10.222.0.57 () {58 vars in 958 bytes} [Fri Sep 16 07:56:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 07:56:51.456947 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1177/2364] 10.222.0.57 () {58 vars in 1122 bytes} [Fri Sep 16 07:56:51 2022] GET /identity/v3/roles => generated 1420 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 16 07:56:51.457947 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f9198a-58b0-46d0-96bd-b99f44688002 None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:51.458395 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f9198a-58b0-46d0-96bd-b99f44688002 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:51.458822 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f9198a-58b0-46d0-96bd-b99f44688002 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:51.460754 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90daa7a8-e8d9-4d6e-b623-0060f396fdd9 admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:56:51.466566 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-90daa7a8-e8d9-4d6e-b623-0060f396fdd9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:56:51.481835 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-f9f9198a-58b0-46d0-96bd-b99f44688002 None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:56:51.484115 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-f9f9198a-58b0-46d0-96bd-b99f44688002 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:56:51.485673 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90daa7a8-e8d9-4d6e-b623-0060f396fdd9 admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:56:51.494093 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1188/2365] 10.222.0.57 () {58 vars in 958 bytes} [Fri Sep 16 07:56:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 16 07:56:51.494588 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824cf106-fc56-4f25-a745-3d17e459e2dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:56:51.495276 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824cf106-fc56-4f25-a745-3d17e459e2dd admin admin] REQUEST_METHOD: `PUT` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:51.495584 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824cf106-fc56-4f25-a745-3d17e459e2dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:51.495862 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824cf106-fc56-4f25-a745-3d17e459e2dd admin admin] PATH_INFO: `/v3/projects/d6644cf5c1db4471bb9d2c76f1d7f0fc/users/3925551645284171ad59c06075159be8/roles/4818d38cf2564825b312e66c9eb24762` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:51.500888 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f9198a-58b0-46d0-96bd-b99f44688002 None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:56:51.512050 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f9198a-58b0-46d0-96bd-b99f44688002 None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:56:51.521808 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824cf106-fc56-4f25-a745-3d17e459e2dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=d6644cf5c1db4471bb9d2c76f1d7f0fc, user_id=3925551645284171ad59c06075159be8, role_id=4818d38cf2564825b312e66c9eb24762)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:56:51.525444 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824cf106-fc56-4f25-a745-3d17e459e2dd admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:56:51.528985 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9f33b9-dd8f-4304-b8ca-3b7a7393075d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:56:51.530168 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9f33b9-dd8f-4304-b8ca-3b7a7393075d admin admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:51.530596 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9f33b9-dd8f-4304-b8ca-3b7a7393075d admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:51.531124 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9f33b9-dd8f-4304-b8ca-3b7a7393075d admin admin] PATH_INFO: `/v3/domains` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:51.531837 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9f33b9-dd8f-4304-b8ca-3b7a7393075d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:56:51.532198 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9f33b9-dd8f-4304-b8ca-3b7a7393075d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:56:51.533792 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9f33b9-dd8f-4304-b8ca-3b7a7393075d admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:56:51.545269 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1178/2366] 10.222.0.57 () {60 vars in 1483 bytes} [Fri Sep 16 07:56:51 2022] PUT /identity/v3/projects/d6644cf5c1db4471bb9d2c76f1d7f0fc/users/3925551645284171ad59c06075159be8/roles/4818d38cf2564825b312e66c9eb24762 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 07:56:51.557763 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824cf106-fc56-4f25-a745-3d17e459e2dd admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:56:51.559926 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-824cf106-fc56-4f25-a745-3d17e459e2dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:56:51.579342 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1189/2367] 10.222.0.57 () {58 vars in 1153 bytes} [Fri Sep 16 07:56:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:56:51.583072 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f411b234-d75a-4b18-9347-196a5a839c4a None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:51.583072 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f411b234-d75a-4b18-9347-196a5a839c4a None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:51.583072 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f411b234-d75a-4b18-9347-196a5a839c4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:51.615326 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-f411b234-d75a-4b18-9347-196a5a839c4a None None] MFA Rules not processed for user `3925551645284171ad59c06075159be8`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:56:51.617215 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-f411b234-d75a-4b18-9347-196a5a839c4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:56:51.659008 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:56:51.674700 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824cf106-fc56-4f25-a745-3d17e459e2dd admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:56:51.680583 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63ea532-832c-4667-86fe-aa01baba953d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:56:51.681341 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63ea532-832c-4667-86fe-aa01baba953d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:51.681848 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63ea532-832c-4667-86fe-aa01baba953d admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:51.682204 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63ea532-832c-4667-86fe-aa01baba953d admin admin] PATH_INFO: `/v3/projects/6577356be7724fe49654cfa4683caee6` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:51.683554 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63ea532-832c-4667-86fe-aa01baba953d admin admin] RBAC: Authorizing `identity:delete_project(project_id=6577356be7724fe49654cfa4683caee6)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:56:51.686183 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63ea532-832c-4667-86fe-aa01baba953d admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:56:51.717217 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1190/2368] 10.222.0.57 () {58 vars in 958 bytes} [Fri Sep 16 07:56:51 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 07:56:51.718491 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f411b234-d75a-4b18-9347-196a5a839c4a None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:56:51.731775 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f411b234-d75a-4b18-9347-196a5a839c4a None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:56:51.738193 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251582d7-5876-448d-bcb8-ec6c3a69e15c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:56:51.739664 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251582d7-5876-448d-bcb8-ec6c3a69e15c admin admin] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:51.739996 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251582d7-5876-448d-bcb8-ec6c3a69e15c admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:51.740276 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251582d7-5876-448d-bcb8-ec6c3a69e15c admin admin] PATH_INFO: `/v3/projects` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:51.741122 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251582d7-5876-448d-bcb8-ec6c3a69e15c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:56:51.743862 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251582d7-5876-448d-bcb8-ec6c3a69e15c admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:56:51.772047 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-a63ea532-832c-4667-86fe-aa01baba953d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6577356be7724fe49654cfa4683caee6', 'request_id': 'req-a63ea532-832c-4667-86fe-aa01baba953d'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:56:51.785253 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-a63ea532-832c-4667-86fe-aa01baba953d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6577356be7724fe49654cfa4683caee6', 'request_id': 'req-a63ea532-832c-4667-86fe-aa01baba953d'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:56:51.794709 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1191/2369] 10.222.0.57 () {60 vars in 1153 bytes} [Fri Sep 16 07:56:51 2022] POST /identity/v3/projects => generated 385 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 07:56:51.796275 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251582d7-5876-448d-bcb8-ec6c3a69e15c admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:56:51.798778 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-251582d7-5876-448d-bcb8-ec6c3a69e15c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:56:51.799662 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-a63ea532-832c-4667-86fe-aa01baba953d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6577356be7724fe49654cfa4683caee6', 'request_id': 'req-a63ea532-832c-4667-86fe-aa01baba953d'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:56:51.817388 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-a63ea532-832c-4667-86fe-aa01baba953d admin admin] The token cache is being invalidate because project 6577356be7724fe49654cfa4683caee6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81430) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 07:56:51.817697 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-a63ea532-832c-4667-86fe-aa01baba953d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:56:51.818555 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-a63ea532-832c-4667-86fe-aa01baba953d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:56:51.820450 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1179/2370] 10.222.0.57 () {58 vars in 1233 bytes} [Fri Sep 16 07:56:51 2022] DELETE /identity/v3/projects/6577356be7724fe49654cfa4683caee6 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 07:56:51.821388 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63ea532-832c-4667-86fe-aa01baba953d admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:56:51.825046 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-a63ea532-832c-4667-86fe-aa01baba953d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:56:51.843445 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:56:51.870896 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251582d7-5876-448d-bcb8-ec6c3a69e15c admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:56:51.875163 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82035751-07fd-479a-815e-e89a216c7d24 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544bf6be4c24454a013ca110c43cef2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4735f453c0c24cc4a1c14e9ac84a0b46', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:56:51.875763 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82035751-07fd-479a-815e-e89a216c7d24 service cinder] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:51.876036 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82035751-07fd-479a-815e-e89a216c7d24 service cinder] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:51.876306 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82035751-07fd-479a-815e-e89a216c7d24 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:51.878085 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-82035751-07fd-479a-815e-e89a216c7d24 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:56:51.914391 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63ea532-832c-4667-86fe-aa01baba953d admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:56:51.938019 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82035751-07fd-479a-815e-e89a216c7d24 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:56:51.939452 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82035751-07fd-479a-815e-e89a216c7d24 service cinder] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:56:51.948644 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1192/2371] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Sep 16 07:56:51 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 07:56:51.952066 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b2ce57-8871-4973-8b8b-d0daf15eab8b None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:51.952584 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b2ce57-8871-4973-8b8b-d0daf15eab8b None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:51.952897 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b2ce57-8871-4973-8b8b-d0daf15eab8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:51.975546 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fdd976-8fdd-4e02-b9c5-4408cc4c0e13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:56:51.976163 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fdd976-8fdd-4e02-b9c5-4408cc4c0e13 admin admin] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:51.976443 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fdd976-8fdd-4e02-b9c5-4408cc4c0e13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:51.976714 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fdd976-8fdd-4e02-b9c5-4408cc4c0e13 admin admin] PATH_INFO: `/v3/users` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:51.977351 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2fdd976-8fdd-4e02-b9c5-4408cc4c0e13 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:56:51.979388 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2fdd976-8fdd-4e02-b9c5-4408cc4c0e13 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:56:51.981821 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-50b2ce57-8871-4973-8b8b-d0daf15eab8b None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:56:51.983964 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-50b2ce57-8871-4973-8b8b-d0daf15eab8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:56:52.008685 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1193/2372] 10.222.0.57 () {58 vars in 958 bytes} [Fri Sep 16 07:56:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 07:56:52.008892 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1180/2373] 10.222.0.57 () {60 vars in 1144 bytes} [Fri Sep 16 07:56:51 2022] POST /identity/v3/users => generated 293 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 07:56:52.010162 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fdd976-8fdd-4e02-b9c5-4408cc4c0e13 admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:56:52.011787 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccea479-b9af-4289-ac7c-208dc8e7052c None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:52.012459 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccea479-b9af-4289-ac7c-208dc8e7052c None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:52.012810 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccea479-b9af-4289-ac7c-208dc8e7052c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:52.024170 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fdd976-8fdd-4e02-b9c5-4408cc4c0e13 admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:56:52.028915 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adf0814-31d8-4495-b77d-c8b03a50e03a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:56:52.030130 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adf0814-31d8-4495-b77d-c8b03a50e03a admin admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:52.030398 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adf0814-31d8-4495-b77d-c8b03a50e03a admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:52.030801 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adf0814-31d8-4495-b77d-c8b03a50e03a admin admin] PATH_INFO: `/v3/roles` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:52.031442 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9adf0814-31d8-4495-b77d-c8b03a50e03a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:56:52.033009 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9adf0814-31d8-4495-b77d-c8b03a50e03a admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:56:52.035840 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-fccea479-b9af-4289-ac7c-208dc8e7052c None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:56:52.037185 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-fccea479-b9af-4289-ac7c-208dc8e7052c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:56:52.044197 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1181/2374] 10.222.0.57 () {58 vars in 1122 bytes} [Fri Sep 16 07:56:52 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 07:56:52.047251 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adf0814-31d8-4495-b77d-c8b03a50e03a admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:56:52.051238 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1194/2375] 10.222.0.57 () {58 vars in 958 bytes} [Fri Sep 16 07:56:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 07:56:52.052123 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccea479-b9af-4289-ac7c-208dc8e7052c None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:56:52.057899 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adf0814-31d8-4495-b77d-c8b03a50e03a admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:56:52.061444 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccea479-b9af-4289-ac7c-208dc8e7052c None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:56:52.067178 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6a5f91-0f6a-4261-b98d-8c6bd21fcb74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:56:52.067178 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6a5f91-0f6a-4261-b98d-8c6bd21fcb74 admin admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:52.067178 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6a5f91-0f6a-4261-b98d-8c6bd21fcb74 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:52.067178 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6a5f91-0f6a-4261-b98d-8c6bd21fcb74 admin admin] PATH_INFO: `/v3/roles` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:52.067514 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6a5f91-0f6a-4261-b98d-8c6bd21fcb74 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:56:52.067514 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6a5f91-0f6a-4261-b98d-8c6bd21fcb74 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:56:52.071041 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a76a785-876c-43bd-a8b8-03982460faef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:56:52.071654 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a76a785-876c-43bd-a8b8-03982460faef admin admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:52.071935 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a76a785-876c-43bd-a8b8-03982460faef admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:52.072211 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a76a785-876c-43bd-a8b8-03982460faef admin admin] PATH_INFO: `/v3/domains` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:52.072855 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a76a785-876c-43bd-a8b8-03982460faef admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:56:52.073160 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a76a785-876c-43bd-a8b8-03982460faef admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:56:52.074776 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a76a785-876c-43bd-a8b8-03982460faef admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:56:52.092598 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1195/2376] 10.222.0.57 () {58 vars in 1153 bytes} [Fri Sep 16 07:56:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 07:56:52.093923 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a76a785-876c-43bd-a8b8-03982460faef admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:56:52.100757 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1182/2377] 10.222.0.57 () {58 vars in 1122 bytes} [Fri Sep 16 07:56:52 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 16 07:56:52.110270 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6a5f91-0f6a-4261-b98d-8c6bd21fcb74 admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:56:52.119364 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a76a785-876c-43bd-a8b8-03982460faef admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:56:52.121155 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6a5f91-0f6a-4261-b98d-8c6bd21fcb74 admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:56:52.127742 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e7b32f-f142-40f7-aaaf-3e58c4131374 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:56:52.128052 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e7b32f-f142-40f7-aaaf-3e58c4131374 admin admin] REQUEST_METHOD: `PUT` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:52.128358 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e7b32f-f142-40f7-aaaf-3e58c4131374 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:52.128705 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e7b32f-f142-40f7-aaaf-3e58c4131374 admin admin] PATH_INFO: `/v3/projects/54788e36eb48475f9795d171493dd21e/users/290e2bfce15b45919748b7ab7c07168d/roles/4818d38cf2564825b312e66c9eb24762` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:52.130717 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf442af-a1ce-4cc1-bf17-3ddc82eddc04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:56:52.131447 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf442af-a1ce-4cc1-bf17-3ddc82eddc04 admin admin] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:52.131780 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf442af-a1ce-4cc1-bf17-3ddc82eddc04 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:52.132057 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf442af-a1ce-4cc1-bf17-3ddc82eddc04 admin admin] PATH_INFO: `/v3/projects` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:52.132839 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf442af-a1ce-4cc1-bf17-3ddc82eddc04 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:56:52.134851 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf442af-a1ce-4cc1-bf17-3ddc82eddc04 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:56:52.149101 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e7b32f-f142-40f7-aaaf-3e58c4131374 admin admin] RBAC: Authorizing `identity:create_grant(project_id=54788e36eb48475f9795d171493dd21e, user_id=290e2bfce15b45919748b7ab7c07168d, role_id=4818d38cf2564825b312e66c9eb24762)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:56:52.152086 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e7b32f-f142-40f7-aaaf-3e58c4131374 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:56:52.175732 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1196/2378] 10.222.0.57 () {60 vars in 1153 bytes} [Fri Sep 16 07:56:52 2022] POST /identity/v3/projects => generated 391 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 16 07:56:52.175732 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf442af-a1ce-4cc1-bf17-3ddc82eddc04 admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:56:52.181790 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:56:52.196903 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1183/2379] 10.222.0.57 () {60 vars in 1483 bytes} [Fri Sep 16 07:56:52 2022] PUT /identity/v3/projects/54788e36eb48475f9795d171493dd21e/users/290e2bfce15b45919748b7ab7c07168d/roles/4818d38cf2564825b312e66c9eb24762 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 07:56:52.208642 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658dd0d5-b027-40f3-ac41-e001d0697946 None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:52.208933 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658dd0d5-b027-40f3-ac41-e001d0697946 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:52.209222 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658dd0d5-b027-40f3-ac41-e001d0697946 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:52.239080 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-658dd0d5-b027-40f3-ac41-e001d0697946 None None] MFA Rules not processed for user `290e2bfce15b45919748b7ab7c07168d`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:56:52.240334 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-658dd0d5-b027-40f3-ac41-e001d0697946 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:56:52.259329 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf442af-a1ce-4cc1-bf17-3ddc82eddc04 admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:56:52.267306 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc0b6c3-55cc-422d-bacd-298be45e36f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:56:52.268796 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc0b6c3-55cc-422d-bacd-298be45e36f2 admin admin] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:52.269090 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc0b6c3-55cc-422d-bacd-298be45e36f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:52.269365 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc0b6c3-55cc-422d-bacd-298be45e36f2 admin admin] PATH_INFO: `/v3/users` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:52.270040 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc0b6c3-55cc-422d-bacd-298be45e36f2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:56:52.273322 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc0b6c3-55cc-422d-bacd-298be45e36f2 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:56:52.299745 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1197/2380] 10.222.0.57 () {60 vars in 1144 bytes} [Fri Sep 16 07:56:52 2022] POST /identity/v3/users => generated 296 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 16 07:56:52.304295 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc0b6c3-55cc-422d-bacd-298be45e36f2 admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:56:52.313274 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:56:52.318522 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc0b6c3-55cc-422d-bacd-298be45e36f2 admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:56:52.323739 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2b8161-6e59-4240-b40d-662420e19644 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:56:52.324473 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2b8161-6e59-4240-b40d-662420e19644 admin admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:52.324901 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2b8161-6e59-4240-b40d-662420e19644 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:52.325214 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2b8161-6e59-4240-b40d-662420e19644 admin admin] PATH_INFO: `/v3/roles` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:52.326729 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2b8161-6e59-4240-b40d-662420e19644 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:56:52.328626 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2b8161-6e59-4240-b40d-662420e19644 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:56:52.339611 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1198/2381] 10.222.0.57 () {58 vars in 1122 bytes} [Fri Sep 16 07:56:52 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 16 07:56:52.343842 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2b8161-6e59-4240-b40d-662420e19644 admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:56:52.348795 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1184/2382] 10.222.0.57 () {58 vars in 958 bytes} [Fri Sep 16 07:56:52 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 16 07:56:52.358138 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658dd0d5-b027-40f3-ac41-e001d0697946 None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:56:52.360414 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-658dd0d5-b027-40f3-ac41-e001d0697946 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:56:52.366289 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2b8161-6e59-4240-b40d-662420e19644 admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:56:52.371988 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3386929f-7f0a-4600-a753-c8941da7a138 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:56:52.373454 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3386929f-7f0a-4600-a753-c8941da7a138 admin admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:52.374194 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3386929f-7f0a-4600-a753-c8941da7a138 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:52.374194 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3386929f-7f0a-4600-a753-c8941da7a138 admin admin] PATH_INFO: `/v3/roles` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:52.374799 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3386929f-7f0a-4600-a753-c8941da7a138 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:56:52.376567 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3386929f-7f0a-4600-a753-c8941da7a138 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:56:52.389773 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1199/2383] 10.222.0.57 () {58 vars in 1122 bytes} [Fri Sep 16 07:56:52 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 07:56:52.394309 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3386929f-7f0a-4600-a753-c8941da7a138 admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:56:52.409975 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3386929f-7f0a-4600-a753-c8941da7a138 admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:56:52.428316 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17951c42-b045-497b-b700-6107c45845be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:56:52.428995 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17951c42-b045-497b-b700-6107c45845be admin admin] REQUEST_METHOD: `PUT` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:52.429281 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17951c42-b045-497b-b700-6107c45845be admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:52.429556 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17951c42-b045-497b-b700-6107c45845be admin admin] PATH_INFO: `/v3/projects/d10eb429f76b4257a72cbec75dff706a/users/0a40e8318e784571a7f1f0c0fb465ca5/roles/4818d38cf2564825b312e66c9eb24762` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:52.448299 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658dd0d5-b027-40f3-ac41-e001d0697946 None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:56:52.454546 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3ea287-80bb-4568-a759-d9e93852d4d4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544bf6be4c24454a013ca110c43cef2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4735f453c0c24cc4a1c14e9ac84a0b46', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:56:52.456044 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3ea287-80bb-4568-a759-d9e93852d4d4 service cinder] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:52.456638 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3ea287-80bb-4568-a759-d9e93852d4d4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:52.457038 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3ea287-80bb-4568-a759-d9e93852d4d4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:52.459529 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17951c42-b045-497b-b700-6107c45845be admin admin] RBAC: Authorizing `identity:create_grant(project_id=d10eb429f76b4257a72cbec75dff706a, user_id=0a40e8318e784571a7f1f0c0fb465ca5, role_id=4818d38cf2564825b312e66c9eb24762)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:56:52.463114 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17951c42-b045-497b-b700-6107c45845be admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:56:52.468302 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3ea287-80bb-4568-a759-d9e93852d4d4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:56:52.470296 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3ea287-80bb-4568-a759-d9e93852d4d4 service cinder] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:56:52.481640 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1185/2384] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Sep 16 07:56:52 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 07:56:52.531057 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3ea287-80bb-4568-a759-d9e93852d4d4 service cinder] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:56:52.532805 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1200/2385] 10.222.0.57 () {60 vars in 1483 bytes} [Fri Sep 16 07:56:52 2022] PUT /identity/v3/projects/d10eb429f76b4257a72cbec75dff706a/users/0a40e8318e784571a7f1f0c0fb465ca5/roles/4818d38cf2564825b312e66c9eb24762 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 07:56:52.537598 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad77170c-7421-4206-95ee-39f2b6a0444f None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:52.538193 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad77170c-7421-4206-95ee-39f2b6a0444f None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:52.538193 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad77170c-7421-4206-95ee-39f2b6a0444f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:52.548458 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3ea287-80bb-4568-a759-d9e93852d4d4 service cinder] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:56:52.619444 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-ad77170c-7421-4206-95ee-39f2b6a0444f None None] MFA Rules not processed for user `0a40e8318e784571a7f1f0c0fb465ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:56:52.620678 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-ad77170c-7421-4206-95ee-39f2b6a0444f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:56:52.709951 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a14004-560e-4e5c-a1e0-ea882dd5a814 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:56:52.710966 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a14004-560e-4e5c-a1e0-ea882dd5a814 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:52.712274 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a14004-560e-4e5c-a1e0-ea882dd5a814 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:52.712665 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a14004-560e-4e5c-a1e0-ea882dd5a814 admin admin] PATH_INFO: `/v3/users/290e2bfce15b45919748b7ab7c07168d` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:52.714050 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a14004-560e-4e5c-a1e0-ea882dd5a814 admin admin] RBAC: Authorizing `identity:delete_user(user_id=290e2bfce15b45919748b7ab7c07168d)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:56:52.716661 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a14004-560e-4e5c-a1e0-ea882dd5a814 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:56:52.749298 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1201/2386] 10.222.0.57 () {58 vars in 958 bytes} [Fri Sep 16 07:56:52 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 07:56:52.760138 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad77170c-7421-4206-95ee-39f2b6a0444f None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:56:52.761474 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-ad77170c-7421-4206-95ee-39f2b6a0444f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:56:52.772051 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-69a14004-560e-4e5c-a1e0-ea882dd5a814 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '290e2bfce15b45919748b7ab7c07168d'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:56:52.772805 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-69a14004-560e-4e5c-a1e0-ea882dd5a814 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '290e2bfce15b45919748b7ab7c07168d'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:56:52.781572 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-69a14004-560e-4e5c-a1e0-ea882dd5a814 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '290e2bfce15b45919748b7ab7c07168d'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:56:52.793896 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-69a14004-560e-4e5c-a1e0-ea882dd5a814 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '290e2bfce15b45919748b7ab7c07168d'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:56:52.802414 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-69a14004-560e-4e5c-a1e0-ea882dd5a814 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '290e2bfce15b45919748b7ab7c07168d'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:56:52.806358 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:56:52.812377 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1186/2387] 10.222.0.57 () {58 vars in 1224 bytes} [Fri Sep 16 07:56:52 2022] DELETE /identity/v3/users/290e2bfce15b45919748b7ab7c07168d => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 07:56:52.816617 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3a628b-f467-4656-a2cf-b337690dfddf None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:52.817099 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3a628b-f467-4656-a2cf-b337690dfddf None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:52.817464 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3a628b-f467-4656-a2cf-b337690dfddf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:52.827086 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad77170c-7421-4206-95ee-39f2b6a0444f None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:56:52.841210 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-ba3a628b-f467-4656-a2cf-b337690dfddf None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:56:52.843242 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-ba3a628b-f467-4656-a2cf-b337690dfddf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:56:52.848712 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:56:52.882219 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30080cdf-000a-47d6-8e41-586346453e99 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544bf6be4c24454a013ca110c43cef2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4735f453c0c24cc4a1c14e9ac84a0b46', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:56:52.882814 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30080cdf-000a-47d6-8e41-586346453e99 service cinder] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:52.883091 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30080cdf-000a-47d6-8e41-586346453e99 service cinder] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:52.883365 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30080cdf-000a-47d6-8e41-586346453e99 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:52.885172 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-30080cdf-000a-47d6-8e41-586346453e99 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:56:52.922153 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1187/2388] 10.222.0.57 () {58 vars in 958 bytes} [Fri Sep 16 07:56:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 07:56:52.932416 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3a628b-f467-4656-a2cf-b337690dfddf None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:56:52.933906 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-ba3a628b-f467-4656-a2cf-b337690dfddf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:56:52.968449 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30080cdf-000a-47d6-8e41-586346453e99 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:56:52.970091 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30080cdf-000a-47d6-8e41-586346453e99 service cinder] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:56:52.979531 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1202/2389] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Sep 16 07:56:52 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 16 07:56:53.008040 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3a628b-f467-4656-a2cf-b337690dfddf None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:56:53.011679 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6edf84-6a4e-481f-bac5-e18e99b7ec49 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1062e457207a41e4ba4f0a0c4bf36f1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4735f453c0c24cc4a1c14e9ac84a0b46', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:56:53.012302 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6edf84-6a4e-481f-bac5-e18e99b7ec49 service neutron] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:53.012579 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6edf84-6a4e-481f-bac5-e18e99b7ec49 service neutron] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:53.012849 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6edf84-6a4e-481f-bac5-e18e99b7ec49 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:53.022693 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6edf84-6a4e-481f-bac5-e18e99b7ec49 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:56:53.024106 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6edf84-6a4e-481f-bac5-e18e99b7ec49 service neutron] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:56:53.035187 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1188/2390] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Sep 16 07:56:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 07:56:53.430899 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30080cdf-000a-47d6-8e41-586346453e99 service cinder] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:56:53.432587 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-30080cdf-000a-47d6-8e41-586346453e99 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:56:53.450830 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30080cdf-000a-47d6-8e41-586346453e99 service cinder] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:56:53.456270 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04ca385-01a4-4dc0-988a-e99ccde15463 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:56:53.456906 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04ca385-01a4-4dc0-988a-e99ccde15463 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:53.457188 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04ca385-01a4-4dc0-988a-e99ccde15463 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:53.457501 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04ca385-01a4-4dc0-988a-e99ccde15463 admin admin] PATH_INFO: `/v3/projects/54788e36eb48475f9795d171493dd21e` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:53.458863 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04ca385-01a4-4dc0-988a-e99ccde15463 admin admin] RBAC: Authorizing `identity:delete_project(project_id=54788e36eb48475f9795d171493dd21e)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:56:53.460976 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04ca385-01a4-4dc0-988a-e99ccde15463 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:56:53.515111 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-c04ca385-01a4-4dc0-988a-e99ccde15463 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '54788e36eb48475f9795d171493dd21e', 'request_id': 'req-c04ca385-01a4-4dc0-988a-e99ccde15463'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:56:53.522852 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-c04ca385-01a4-4dc0-988a-e99ccde15463 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '54788e36eb48475f9795d171493dd21e', 'request_id': 'req-c04ca385-01a4-4dc0-988a-e99ccde15463'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:56:53.531097 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-c04ca385-01a4-4dc0-988a-e99ccde15463 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '54788e36eb48475f9795d171493dd21e', 'request_id': 'req-c04ca385-01a4-4dc0-988a-e99ccde15463'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:56:53.542457 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-c04ca385-01a4-4dc0-988a-e99ccde15463 admin admin] The token cache is being invalidate because project 54788e36eb48475f9795d171493dd21e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81431) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 07:56:53.542823 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-c04ca385-01a4-4dc0-988a-e99ccde15463 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:56:53.543593 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-c04ca385-01a4-4dc0-988a-e99ccde15463 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:56:53.545325 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1203/2391] 10.222.0.57 () {58 vars in 1233 bytes} [Fri Sep 16 07:56:53 2022] DELETE /identity/v3/projects/54788e36eb48475f9795d171493dd21e => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 07:56:53.550274 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495f51ae-c0bc-426f-821e-5f8971423bfd None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:53.550771 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495f51ae-c0bc-426f-821e-5f8971423bfd None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:53.550861 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495f51ae-c0bc-426f-821e-5f8971423bfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:53.570652 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-495f51ae-c0bc-426f-821e-5f8971423bfd None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:56:53.572123 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-495f51ae-c0bc-426f-821e-5f8971423bfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:56:53.681873 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1189/2392] 10.222.0.57 () {58 vars in 958 bytes} [Fri Sep 16 07:56:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 07:56:53.689514 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51336643-54a6-4799-8686-fec2e8bf6319 None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:53.690963 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51336643-54a6-4799-8686-fec2e8bf6319 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:53.690963 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51336643-54a6-4799-8686-fec2e8bf6319 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:53.720549 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-51336643-54a6-4799-8686-fec2e8bf6319 None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:56:53.721932 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-51336643-54a6-4799-8686-fec2e8bf6319 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:56:53.730797 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1204/2393] 10.222.0.57 () {58 vars in 958 bytes} [Fri Sep 16 07:56:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 07:56:53.734618 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495f51ae-c0bc-426f-821e-5f8971423bfd None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:56:53.746749 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495f51ae-c0bc-426f-821e-5f8971423bfd None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:56:53.752679 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09baf332-58d6-4632-832b-843b0452399a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:56:53.753499 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09baf332-58d6-4632-832b-843b0452399a admin admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:53.753933 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09baf332-58d6-4632-832b-843b0452399a admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:53.754311 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09baf332-58d6-4632-832b-843b0452399a admin admin] PATH_INFO: `/v3/domains` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:53.755066 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09baf332-58d6-4632-832b-843b0452399a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:56:53.755472 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09baf332-58d6-4632-832b-843b0452399a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:56:53.757310 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09baf332-58d6-4632-832b-843b0452399a admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:56:53.771368 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1190/2394] 10.222.0.57 () {58 vars in 1153 bytes} [Fri Sep 16 07:56:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:56:53.777301 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51336643-54a6-4799-8686-fec2e8bf6319 None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:56:53.787573 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51336643-54a6-4799-8686-fec2e8bf6319 None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:56:53.795409 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12311bbd-313f-4c90-b5fc-a8f33fb83617 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:56:53.797055 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12311bbd-313f-4c90-b5fc-a8f33fb83617 admin admin] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:53.797581 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12311bbd-313f-4c90-b5fc-a8f33fb83617 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:53.798160 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12311bbd-313f-4c90-b5fc-a8f33fb83617 admin admin] PATH_INFO: `/v3/projects` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:53.799133 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12311bbd-313f-4c90-b5fc-a8f33fb83617 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:56:53.802344 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12311bbd-313f-4c90-b5fc-a8f33fb83617 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:56:53.889182 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1205/2395] 10.222.0.57 () {60 vars in 1153 bytes} [Fri Sep 16 07:56:53 2022] POST /identity/v3/projects => generated 373 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 16 07:56:53.890519 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09baf332-58d6-4632-832b-843b0452399a admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:56:53.919474 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09baf332-58d6-4632-832b-843b0452399a admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:56:53.996989 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:56:54.018611 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912b869b-e1cf-4cd2-ae6f-3db44cd5113e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:56:54.019441 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912b869b-e1cf-4cd2-ae6f-3db44cd5113e admin admin] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:54.019813 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912b869b-e1cf-4cd2-ae6f-3db44cd5113e admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:54.020602 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912b869b-e1cf-4cd2-ae6f-3db44cd5113e admin admin] PATH_INFO: `/v3/users` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:54.021034 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912b869b-e1cf-4cd2-ae6f-3db44cd5113e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:56:54.023323 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912b869b-e1cf-4cd2-ae6f-3db44cd5113e admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:56:54.060328 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1191/2396] 10.222.0.57 () {60 vars in 1144 bytes} [Fri Sep 16 07:56:53 2022] POST /identity/v3/users => generated 287 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 07:56:54.064437 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12311bbd-313f-4c90-b5fc-a8f33fb83617 admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:56:54.071747 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:56:54.085780 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12311bbd-313f-4c90-b5fc-a8f33fb83617 admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:56:54.106718 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2a62f6-bce6-4fd9-af81-04e0f97edd53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:56:54.107688 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2a62f6-bce6-4fd9-af81-04e0f97edd53 admin admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:54.108119 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2a62f6-bce6-4fd9-af81-04e0f97edd53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:54.108379 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2a62f6-bce6-4fd9-af81-04e0f97edd53 admin admin] PATH_INFO: `/v3/roles` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:54.109336 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2a62f6-bce6-4fd9-af81-04e0f97edd53 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:56:54.111821 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2a62f6-bce6-4fd9-af81-04e0f97edd53 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:56:54.122659 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1206/2397] 10.222.0.57 () {58 vars in 1122 bytes} [Fri Sep 16 07:56:54 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 07:56:54.127219 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912b869b-e1cf-4cd2-ae6f-3db44cd5113e admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:56:54.137675 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912b869b-e1cf-4cd2-ae6f-3db44cd5113e admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:56:54.143027 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec00881-8fb4-40c4-b7c9-884e94b450c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:56:54.143647 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec00881-8fb4-40c4-b7c9-884e94b450c3 admin admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:54.143927 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec00881-8fb4-40c4-b7c9-884e94b450c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:54.144195 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec00881-8fb4-40c4-b7c9-884e94b450c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:54.144859 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec00881-8fb4-40c4-b7c9-884e94b450c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:56:54.146513 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec00881-8fb4-40c4-b7c9-884e94b450c3 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:56:54.161241 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1192/2398] 10.222.0.57 () {58 vars in 1122 bytes} [Fri Sep 16 07:56:54 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 07:56:54.162697 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2a62f6-bce6-4fd9-af81-04e0f97edd53 admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:56:54.173998 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2a62f6-bce6-4fd9-af81-04e0f97edd53 admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:56:54.179276 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c5bdff-28e3-43e3-adc6-c30daed40352 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:56:54.179932 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c5bdff-28e3-43e3-adc6-c30daed40352 admin admin] REQUEST_METHOD: `PUT` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:54.180368 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c5bdff-28e3-43e3-adc6-c30daed40352 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:54.180599 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c5bdff-28e3-43e3-adc6-c30daed40352 admin admin] PATH_INFO: `/v3/projects/859811c18c2e46a1862f5e1670bbd561/users/6316ccd0d73b4645985bf1dfb1fec089/roles/4818d38cf2564825b312e66c9eb24762` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:54.195648 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c5bdff-28e3-43e3-adc6-c30daed40352 admin admin] RBAC: Authorizing `identity:create_grant(project_id=859811c18c2e46a1862f5e1670bbd561, user_id=6316ccd0d73b4645985bf1dfb1fec089, role_id=4818d38cf2564825b312e66c9eb24762)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:56:54.198333 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c5bdff-28e3-43e3-adc6-c30daed40352 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:56:54.211959 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1207/2399] 10.222.0.57 () {60 vars in 1483 bytes} [Fri Sep 16 07:56:54 2022] PUT /identity/v3/projects/859811c18c2e46a1862f5e1670bbd561/users/6316ccd0d73b4645985bf1dfb1fec089/roles/4818d38cf2564825b312e66c9eb24762 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 07:56:54.222511 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ae876e-cc1c-4c1a-93a1-04c020032db7 None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:54.222795 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ae876e-cc1c-4c1a-93a1-04c020032db7 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:54.223070 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ae876e-cc1c-4c1a-93a1-04c020032db7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:54.254920 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-35ae876e-cc1c-4c1a-93a1-04c020032db7 None None] MFA Rules not processed for user `6316ccd0d73b4645985bf1dfb1fec089`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:56:54.256168 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-35ae876e-cc1c-4c1a-93a1-04c020032db7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:56:54.338389 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1193/2400] 10.222.0.57 () {58 vars in 958 bytes} [Fri Sep 16 07:56:54 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 07:56:54.356557 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c5bdff-28e3-43e3-adc6-c30daed40352 admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:56:54.358485 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-d9c5bdff-28e3-43e3-adc6-c30daed40352 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:56:54.422537 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c5bdff-28e3-43e3-adc6-c30daed40352 admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:56:54.426244 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb64dec-e224-4ec0-b01e-f6e7cad3299f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544bf6be4c24454a013ca110c43cef2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4735f453c0c24cc4a1c14e9ac84a0b46', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:56:54.426846 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb64dec-e224-4ec0-b01e-f6e7cad3299f service cinder] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:54.427127 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb64dec-e224-4ec0-b01e-f6e7cad3299f service cinder] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:54.427399 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb64dec-e224-4ec0-b01e-f6e7cad3299f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:54.436265 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb64dec-e224-4ec0-b01e-f6e7cad3299f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:56:54.437699 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb64dec-e224-4ec0-b01e-f6e7cad3299f service cinder] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:56:54.447070 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1208/2401] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Sep 16 07:56:54 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 07:56:54.476232 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ae876e-cc1c-4c1a-93a1-04c020032db7 None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:56:54.547853 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ae876e-cc1c-4c1a-93a1-04c020032db7 None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:56:54.557930 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979a62d1-eaa8-43cc-bc9e-eae7ffc6d1fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:56:54.558582 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979a62d1-eaa8-43cc-bc9e-eae7ffc6d1fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:54.558862 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979a62d1-eaa8-43cc-bc9e-eae7ffc6d1fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:54.559140 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979a62d1-eaa8-43cc-bc9e-eae7ffc6d1fd admin admin] PATH_INFO: `/v3/users/6316ccd0d73b4645985bf1dfb1fec089` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:54.561031 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979a62d1-eaa8-43cc-bc9e-eae7ffc6d1fd admin admin] RBAC: Authorizing `identity:delete_user(user_id=6316ccd0d73b4645985bf1dfb1fec089)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:56:54.562810 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979a62d1-eaa8-43cc-bc9e-eae7ffc6d1fd admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:56:54.617857 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-979a62d1-eaa8-43cc-bc9e-eae7ffc6d1fd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6316ccd0d73b4645985bf1dfb1fec089'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:56:54.618571 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-979a62d1-eaa8-43cc-bc9e-eae7ffc6d1fd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6316ccd0d73b4645985bf1dfb1fec089'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:56:54.622545 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=88,keystone:INSERT=4,keystone:DELETE=8 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:56:54.628018 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-979a62d1-eaa8-43cc-bc9e-eae7ffc6d1fd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6316ccd0d73b4645985bf1dfb1fec089'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:56:54.642576 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-979a62d1-eaa8-43cc-bc9e-eae7ffc6d1fd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6316ccd0d73b4645985bf1dfb1fec089'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:56:54.649445 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-979a62d1-eaa8-43cc-bc9e-eae7ffc6d1fd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6316ccd0d73b4645985bf1dfb1fec089'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:56:54.655700 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1194/2402] 10.222.0.57 () {58 vars in 1224 bytes} [Fri Sep 16 07:56:54 2022] DELETE /identity/v3/users/6316ccd0d73b4645985bf1dfb1fec089 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 16 07:56:54.660255 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9063a4-13ce-4f21-9591-0c40b5b0cbc0 None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:54.660543 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9063a4-13ce-4f21-9591-0c40b5b0cbc0 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:54.660819 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9063a4-13ce-4f21-9591-0c40b5b0cbc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:54.680464 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-1d9063a4-13ce-4f21-9591-0c40b5b0cbc0 None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:56:54.681682 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-1d9063a4-13ce-4f21-9591-0c40b5b0cbc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:56:54.744027 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1209/2403] 10.222.0.57 () {58 vars in 958 bytes} [Fri Sep 16 07:56:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 07:56:54.755360 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979a62d1-eaa8-43cc-bc9e-eae7ffc6d1fd admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:56:54.757355 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-979a62d1-eaa8-43cc-bc9e-eae7ffc6d1fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:56:54.816516 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979a62d1-eaa8-43cc-bc9e-eae7ffc6d1fd admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:56:54.820892 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8817b994-55b3-4723-9416-2860605717fd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1062e457207a41e4ba4f0a0c4bf36f1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4735f453c0c24cc4a1c14e9ac84a0b46', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:56:54.821611 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8817b994-55b3-4723-9416-2860605717fd service neutron] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:54.821956 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8817b994-55b3-4723-9416-2860605717fd service neutron] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:54.822266 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8817b994-55b3-4723-9416-2860605717fd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:54.832858 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8817b994-55b3-4723-9416-2860605717fd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:56:54.834328 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8817b994-55b3-4723-9416-2860605717fd service neutron] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:56:54.847054 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1195/2404] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Sep 16 07:56:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 07:56:55.199862 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9063a4-13ce-4f21-9591-0c40b5b0cbc0 None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:56:55.201910 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-1d9063a4-13ce-4f21-9591-0c40b5b0cbc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:56:55.224970 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9063a4-13ce-4f21-9591-0c40b5b0cbc0 None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:56:55.244192 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5538241-3901-4600-877b-9e09292be89b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:56:55.245130 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5538241-3901-4600-877b-9e09292be89b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:55.245411 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5538241-3901-4600-877b-9e09292be89b admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:55.245777 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5538241-3901-4600-877b-9e09292be89b admin admin] PATH_INFO: `/v3/projects/859811c18c2e46a1862f5e1670bbd561` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:55.247341 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5538241-3901-4600-877b-9e09292be89b admin admin] RBAC: Authorizing `identity:delete_project(project_id=859811c18c2e46a1862f5e1670bbd561)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:56:55.250068 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5538241-3901-4600-877b-9e09292be89b admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:56:55.338536 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-e5538241-3901-4600-877b-9e09292be89b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '859811c18c2e46a1862f5e1670bbd561', 'request_id': 'req-e5538241-3901-4600-877b-9e09292be89b'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:56:55.349031 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-e5538241-3901-4600-877b-9e09292be89b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '859811c18c2e46a1862f5e1670bbd561', 'request_id': 'req-e5538241-3901-4600-877b-9e09292be89b'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:56:55.358485 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-e5538241-3901-4600-877b-9e09292be89b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '859811c18c2e46a1862f5e1670bbd561', 'request_id': 'req-e5538241-3901-4600-877b-9e09292be89b'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:56:55.364470 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=92,keystone:INSERT=2,keystone:DELETE=6 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:56:55.383166 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-e5538241-3901-4600-877b-9e09292be89b admin admin] The token cache is being invalidate because project 859811c18c2e46a1862f5e1670bbd561 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81431) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 07:56:55.383928 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-e5538241-3901-4600-877b-9e09292be89b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:56:55.385058 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-e5538241-3901-4600-877b-9e09292be89b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:56:55.386408 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1210/2405] 10.222.0.57 () {58 vars in 1233 bytes} [Fri Sep 16 07:56:55 2022] DELETE /identity/v3/projects/859811c18c2e46a1862f5e1670bbd561 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 07:56:55.394340 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94592bfd-ec7b-4685-812c-b53d33bdf683 None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:55.395540 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94592bfd-ec7b-4685-812c-b53d33bdf683 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:55.396607 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94592bfd-ec7b-4685-812c-b53d33bdf683 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:55.442453 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-94592bfd-ec7b-4685-812c-b53d33bdf683 None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:56:55.443797 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-94592bfd-ec7b-4685-812c-b53d33bdf683 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:56:55.558780 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1196/2406] 10.222.0.57 () {58 vars in 958 bytes} [Fri Sep 16 07:56:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 07:56:55.567752 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7955eec-ca54-425e-bb5f-c24190a5d282 None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:55.568682 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7955eec-ca54-425e-bb5f-c24190a5d282 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:55.569248 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7955eec-ca54-425e-bb5f-c24190a5d282 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:55.590724 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-e7955eec-ca54-425e-bb5f-c24190a5d282 None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:56:55.592491 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-e7955eec-ca54-425e-bb5f-c24190a5d282 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:56:55.604285 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1211/2407] 10.222.0.57 () {58 vars in 958 bytes} [Fri Sep 16 07:56:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 16 07:56:55.608991 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94592bfd-ec7b-4685-812c-b53d33bdf683 None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:56:55.627326 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94592bfd-ec7b-4685-812c-b53d33bdf683 None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:56:55.639995 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebec0f78-dcb6-463a-8185-78ba282dedaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:56:55.640405 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebec0f78-dcb6-463a-8185-78ba282dedaa admin admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:55.642009 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebec0f78-dcb6-463a-8185-78ba282dedaa admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:55.642364 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebec0f78-dcb6-463a-8185-78ba282dedaa admin admin] PATH_INFO: `/v3/domains` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:55.643110 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebec0f78-dcb6-463a-8185-78ba282dedaa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:56:55.643509 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebec0f78-dcb6-463a-8185-78ba282dedaa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:56:55.645173 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebec0f78-dcb6-463a-8185-78ba282dedaa admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:56:55.662109 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1197/2408] 10.222.0.57 () {58 vars in 1153 bytes} [Fri Sep 16 07:56:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:56:55.663544 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7955eec-ca54-425e-bb5f-c24190a5d282 None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:56:55.675826 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7955eec-ca54-425e-bb5f-c24190a5d282 None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:56:55.680812 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294f9f97-c084-441e-91db-c3a37d5456e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:56:55.681417 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294f9f97-c084-441e-91db-c3a37d5456e3 admin admin] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:55.681696 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294f9f97-c084-441e-91db-c3a37d5456e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:55.682000 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294f9f97-c084-441e-91db-c3a37d5456e3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:55.682626 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294f9f97-c084-441e-91db-c3a37d5456e3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:56:55.684555 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294f9f97-c084-441e-91db-c3a37d5456e3 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:56:55.726636 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1212/2409] 10.222.0.57 () {60 vars in 1153 bytes} [Fri Sep 16 07:56:55 2022] POST /identity/v3/projects => generated 365 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 07:56:55.731489 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebec0f78-dcb6-463a-8185-78ba282dedaa admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:56:55.742339 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebec0f78-dcb6-463a-8185-78ba282dedaa admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:56:55.828186 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8541eb1e-8a9b-48e4-8625-c8d7a1a95866 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:56:55.829011 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8541eb1e-8a9b-48e4-8625-c8d7a1a95866 admin admin] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:55.829439 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8541eb1e-8a9b-48e4-8625-c8d7a1a95866 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:55.829931 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8541eb1e-8a9b-48e4-8625-c8d7a1a95866 admin admin] PATH_INFO: `/v3/users` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:55.830757 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8541eb1e-8a9b-48e4-8625-c8d7a1a95866 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:56:55.833053 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8541eb1e-8a9b-48e4-8625-c8d7a1a95866 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:56:55.843935 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:56:55.864174 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1198/2410] 10.222.0.57 () {60 vars in 1144 bytes} [Fri Sep 16 07:56:55 2022] POST /identity/v3/users => generated 283 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 07:56:55.865361 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294f9f97-c084-441e-91db-c3a37d5456e3 admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:56:55.877522 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294f9f97-c084-441e-91db-c3a37d5456e3 admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:56:55.882218 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3500d61a-3ae5-428b-8ba4-bff68356dfd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:56:55.882824 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3500d61a-3ae5-428b-8ba4-bff68356dfd4 admin admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:55.883095 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3500d61a-3ae5-428b-8ba4-bff68356dfd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:55.883368 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3500d61a-3ae5-428b-8ba4-bff68356dfd4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:55.884077 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3500d61a-3ae5-428b-8ba4-bff68356dfd4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:56:55.885753 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3500d61a-3ae5-428b-8ba4-bff68356dfd4 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:56:55.896704 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1213/2411] 10.222.0.57 () {58 vars in 1122 bytes} [Fri Sep 16 07:56:55 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 16 07:56:55.900637 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8541eb1e-8a9b-48e4-8625-c8d7a1a95866 admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:56:55.911460 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8541eb1e-8a9b-48e4-8625-c8d7a1a95866 admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:56:55.916128 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e467dd5-dede-4363-a29e-b475352b854e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:56:55.916711 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e467dd5-dede-4363-a29e-b475352b854e admin admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:55.916992 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e467dd5-dede-4363-a29e-b475352b854e admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:55.917267 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e467dd5-dede-4363-a29e-b475352b854e admin admin] PATH_INFO: `/v3/roles` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:55.917945 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e467dd5-dede-4363-a29e-b475352b854e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:56:55.919562 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e467dd5-dede-4363-a29e-b475352b854e admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:56:55.930469 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1199/2412] 10.222.0.57 () {58 vars in 1122 bytes} [Fri Sep 16 07:56:55 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 07:56:55.935048 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3500d61a-3ae5-428b-8ba4-bff68356dfd4 admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:56:55.945813 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3500d61a-3ae5-428b-8ba4-bff68356dfd4 admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:56:55.950351 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e71463c-750e-4a8b-9ebe-911bd3edfa0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:56:55.950998 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e71463c-750e-4a8b-9ebe-911bd3edfa0d admin admin] REQUEST_METHOD: `PUT` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:55.951275 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e71463c-750e-4a8b-9ebe-911bd3edfa0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:55.951550 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e71463c-750e-4a8b-9ebe-911bd3edfa0d admin admin] PATH_INFO: `/v3/projects/af8badf8d541456185ecb86631f650f7/users/d5cbb4df2923409582c7f0c9d0d1af63/roles/4818d38cf2564825b312e66c9eb24762` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:55.965750 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e71463c-750e-4a8b-9ebe-911bd3edfa0d admin admin] RBAC: Authorizing `identity:create_grant(project_id=af8badf8d541456185ecb86631f650f7, user_id=d5cbb4df2923409582c7f0c9d0d1af63, role_id=4818d38cf2564825b312e66c9eb24762)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:56:55.968934 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e71463c-750e-4a8b-9ebe-911bd3edfa0d admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:56:55.982077 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1214/2413] 10.222.0.57 () {60 vars in 1483 bytes} [Fri Sep 16 07:56:55 2022] PUT /identity/v3/projects/af8badf8d541456185ecb86631f650f7/users/d5cbb4df2923409582c7f0c9d0d1af63/roles/4818d38cf2564825b312e66c9eb24762 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 07:56:55.994756 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af72cac-81f1-4c7e-a421-206839929176 None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:55.995365 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af72cac-81f1-4c7e-a421-206839929176 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:55.995774 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af72cac-81f1-4c7e-a421-206839929176 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:56.029825 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-0af72cac-81f1-4c7e-a421-206839929176 None None] MFA Rules not processed for user `d5cbb4df2923409582c7f0c9d0d1af63`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:56:56.031354 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-0af72cac-81f1-4c7e-a421-206839929176 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:56:56.111185 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1200/2414] 10.222.0.57 () {58 vars in 958 bytes} [Fri Sep 16 07:56:55 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 07:56:56.120606 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e71463c-750e-4a8b-9ebe-911bd3edfa0d admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:56:56.122402 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-6e71463c-750e-4a8b-9ebe-911bd3edfa0d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:56:56.186926 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e71463c-750e-4a8b-9ebe-911bd3edfa0d admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:56:56.190549 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e850f5-5e2d-4348-9928-98c342311fb8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544bf6be4c24454a013ca110c43cef2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4735f453c0c24cc4a1c14e9ac84a0b46', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:56:56.191164 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e850f5-5e2d-4348-9928-98c342311fb8 service cinder] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:56.191442 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e850f5-5e2d-4348-9928-98c342311fb8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:56.191713 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e850f5-5e2d-4348-9928-98c342311fb8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:56.199785 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e850f5-5e2d-4348-9928-98c342311fb8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:56:56.201248 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e850f5-5e2d-4348-9928-98c342311fb8 service cinder] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:56:56.210357 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1215/2415] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Sep 16 07:56:56 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 07:56:57.406299 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af72cac-81f1-4c7e-a421-206839929176 None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:56:57.408336 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-0af72cac-81f1-4c7e-a421-206839929176 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:56:57.481695 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af72cac-81f1-4c7e-a421-206839929176 None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:56:57.487476 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc5d4e5-ac72-4123-93d1-f34cd9827a61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:56:57.488110 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc5d4e5-ac72-4123-93d1-f34cd9827a61 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:57.488393 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc5d4e5-ac72-4123-93d1-f34cd9827a61 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:57.488669 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc5d4e5-ac72-4123-93d1-f34cd9827a61 admin admin] PATH_INFO: `/v3/users/3925551645284171ad59c06075159be8` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:57.489895 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc5d4e5-ac72-4123-93d1-f34cd9827a61 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3925551645284171ad59c06075159be8)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:56:57.492077 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc5d4e5-ac72-4123-93d1-f34cd9827a61 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:56:57.540703 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-ddc5d4e5-ac72-4123-93d1-f34cd9827a61 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3925551645284171ad59c06075159be8'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:56:57.541353 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-ddc5d4e5-ac72-4123-93d1-f34cd9827a61 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3925551645284171ad59c06075159be8'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:56:57.549552 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-ddc5d4e5-ac72-4123-93d1-f34cd9827a61 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3925551645284171ad59c06075159be8'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:56:57.561839 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:INSERT=4,keystone:SELECT=86,keystone:DELETE=10 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:56:57.563208 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-ddc5d4e5-ac72-4123-93d1-f34cd9827a61 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3925551645284171ad59c06075159be8'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:56:57.572399 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-ddc5d4e5-ac72-4123-93d1-f34cd9827a61 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3925551645284171ad59c06075159be8'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:56:57.580823 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1201/2416] 10.222.0.57 () {58 vars in 1224 bytes} [Fri Sep 16 07:56:57 2022] DELETE /identity/v3/users/3925551645284171ad59c06075159be8 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 07:56:57.585523 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdcf6cc-5712-459e-b1a5-7a475075b1e4 None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:57.586048 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdcf6cc-5712-459e-b1a5-7a475075b1e4 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:57.586246 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdcf6cc-5712-459e-b1a5-7a475075b1e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:57.606433 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-acdcf6cc-5712-459e-b1a5-7a475075b1e4 None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:56:57.608412 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-acdcf6cc-5712-459e-b1a5-7a475075b1e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:56:57.679819 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1216/2417] 10.222.0.57 () {58 vars in 958 bytes} [Fri Sep 16 07:56:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 16 07:56:57.681589 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc5d4e5-ac72-4123-93d1-f34cd9827a61 admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:56:57.683042 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-ddc5d4e5-ac72-4123-93d1-f34cd9827a61 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:56:57.751192 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc5d4e5-ac72-4123-93d1-f34cd9827a61 admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:56:57.754971 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c2464d-5eec-4687-96af-0e22be967108 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1062e457207a41e4ba4f0a0c4bf36f1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4735f453c0c24cc4a1c14e9ac84a0b46', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:56:57.755578 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c2464d-5eec-4687-96af-0e22be967108 service neutron] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:57.755853 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c2464d-5eec-4687-96af-0e22be967108 service neutron] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:57.756168 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c2464d-5eec-4687-96af-0e22be967108 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:57.766765 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c2464d-5eec-4687-96af-0e22be967108 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:56:57.769561 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c2464d-5eec-4687-96af-0e22be967108 service neutron] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:56:57.779974 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1202/2418] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Sep 16 07:56:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 07:56:58.200674 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdcf6cc-5712-459e-b1a5-7a475075b1e4 None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:56:58.203184 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-acdcf6cc-5712-459e-b1a5-7a475075b1e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:56:58.234236 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdcf6cc-5712-459e-b1a5-7a475075b1e4 None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:56:58.249797 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dccf239-f102-4a44-9636-8961da397a4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:56:58.251938 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dccf239-f102-4a44-9636-8961da397a4c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:56:58.254043 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dccf239-f102-4a44-9636-8961da397a4c admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:56:58.254615 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dccf239-f102-4a44-9636-8961da397a4c admin admin] PATH_INFO: `/v3/projects/d6644cf5c1db4471bb9d2c76f1d7f0fc` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:56:58.256098 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dccf239-f102-4a44-9636-8961da397a4c admin admin] RBAC: Authorizing `identity:delete_project(project_id=d6644cf5c1db4471bb9d2c76f1d7f0fc)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:56:58.258294 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dccf239-f102-4a44-9636-8961da397a4c admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:56:58.312162 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:DELETE=3,keystone:SELECT=95,keystone:INSERT=2 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:56:58.346280 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-2dccf239-f102-4a44-9636-8961da397a4c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd6644cf5c1db4471bb9d2c76f1d7f0fc', 'request_id': 'req-2dccf239-f102-4a44-9636-8961da397a4c'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:56:58.354035 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-2dccf239-f102-4a44-9636-8961da397a4c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd6644cf5c1db4471bb9d2c76f1d7f0fc', 'request_id': 'req-2dccf239-f102-4a44-9636-8961da397a4c'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:56:58.368013 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-2dccf239-f102-4a44-9636-8961da397a4c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd6644cf5c1db4471bb9d2c76f1d7f0fc', 'request_id': 'req-2dccf239-f102-4a44-9636-8961da397a4c'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:56:58.394218 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-2dccf239-f102-4a44-9636-8961da397a4c admin admin] The token cache is being invalidate because project d6644cf5c1db4471bb9d2c76f1d7f0fc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81431) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 07:56:58.394511 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-2dccf239-f102-4a44-9636-8961da397a4c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:56:58.406883 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-2dccf239-f102-4a44-9636-8961da397a4c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:56:58.412725 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1217/2419] 10.222.0.57 () {58 vars in 1233 bytes} [Fri Sep 16 07:56:58 2022] DELETE /identity/v3/projects/d6644cf5c1db4471bb9d2c76f1d7f0fc => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 07:57:03.114035 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c2464d-5eec-4687-96af-0e22be967108 service neutron] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:57:03.115939 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-42c2464d-5eec-4687-96af-0e22be967108 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:57:03.128597 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c2464d-5eec-4687-96af-0e22be967108 service neutron] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:57:03.195785 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282abe6b-77b6-4994-8687-df0ef1b02aba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:57:03.196331 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282abe6b-77b6-4994-8687-df0ef1b02aba admin admin] REQUEST_METHOD: `DELETE` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:57:03.196612 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282abe6b-77b6-4994-8687-df0ef1b02aba admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:57:03.196885 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282abe6b-77b6-4994-8687-df0ef1b02aba admin admin] PATH_INFO: `/v3/users/4163db8c602b4e8badf93125ad329cda` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:57:03.198046 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282abe6b-77b6-4994-8687-df0ef1b02aba admin admin] RBAC: Authorizing `identity:delete_user(user_id=4163db8c602b4e8badf93125ad329cda)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:57:03.200015 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282abe6b-77b6-4994-8687-df0ef1b02aba admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:57:03.266479 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-282abe6b-77b6-4994-8687-df0ef1b02aba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4163db8c602b4e8badf93125ad329cda'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:57:03.267140 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-282abe6b-77b6-4994-8687-df0ef1b02aba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4163db8c602b4e8badf93125ad329cda'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:57:03.278847 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-282abe6b-77b6-4994-8687-df0ef1b02aba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4163db8c602b4e8badf93125ad329cda'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:57:03.297284 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-282abe6b-77b6-4994-8687-df0ef1b02aba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4163db8c602b4e8badf93125ad329cda'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:57:03.307362 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-282abe6b-77b6-4994-8687-df0ef1b02aba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4163db8c602b4e8badf93125ad329cda'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:57:03.314127 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1203/2420] 10.222.0.57 () {58 vars in 1224 bytes} [Fri Sep 16 07:57:03 2022] DELETE /identity/v3/users/4163db8c602b4e8badf93125ad329cda => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 16 07:57:03.318426 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ab6a0f-055d-443d-b754-9473442326b0 None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:57:03.319390 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ab6a0f-055d-443d-b754-9473442326b0 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:57:03.319858 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ab6a0f-055d-443d-b754-9473442326b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:57:03.344157 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-57ab6a0f-055d-443d-b754-9473442326b0 None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:57:03.345515 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-57ab6a0f-055d-443d-b754-9473442326b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:57:03.418867 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1218/2421] 10.222.0.57 () {58 vars in 958 bytes} [Fri Sep 16 07:57:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 07:57:03.430173 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282abe6b-77b6-4994-8687-df0ef1b02aba admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:57:03.432275 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-282abe6b-77b6-4994-8687-df0ef1b02aba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:57:03.444579 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:57:03.499292 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282abe6b-77b6-4994-8687-df0ef1b02aba admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:57:03.505127 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e82ca2-e39b-4c49-ae13-9693e6cdd6ae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1062e457207a41e4ba4f0a0c4bf36f1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4735f453c0c24cc4a1c14e9ac84a0b46', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:57:03.505847 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e82ca2-e39b-4c49-ae13-9693e6cdd6ae service neutron] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:57:03.506176 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e82ca2-e39b-4c49-ae13-9693e6cdd6ae service neutron] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:57:03.506451 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e82ca2-e39b-4c49-ae13-9693e6cdd6ae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:57:03.516494 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e82ca2-e39b-4c49-ae13-9693e6cdd6ae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:57:03.517956 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e82ca2-e39b-4c49-ae13-9693e6cdd6ae service neutron] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:57:03.527836 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1204/2422] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Sep 16 07:57:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 16 07:57:03.683788 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ab6a0f-055d-443d-b754-9473442326b0 None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:57:03.685523 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-57ab6a0f-055d-443d-b754-9473442326b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:57:03.703998 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ab6a0f-055d-443d-b754-9473442326b0 None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:57:03.712365 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71d0e20-4449-4e82-bdc7-613d9a5b330f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:57:03.713107 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71d0e20-4449-4e82-bdc7-613d9a5b330f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:57:03.713543 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71d0e20-4449-4e82-bdc7-613d9a5b330f admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:57:03.713957 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71d0e20-4449-4e82-bdc7-613d9a5b330f admin admin] PATH_INFO: `/v3/users/0a40e8318e784571a7f1f0c0fb465ca5` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:57:03.715338 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71d0e20-4449-4e82-bdc7-613d9a5b330f admin admin] RBAC: Authorizing `identity:delete_user(user_id=0a40e8318e784571a7f1f0c0fb465ca5)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:57:03.718285 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71d0e20-4449-4e82-bdc7-613d9a5b330f admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:57:03.772338 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-e71d0e20-4449-4e82-bdc7-613d9a5b330f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0a40e8318e784571a7f1f0c0fb465ca5'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:57:03.785031 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-e71d0e20-4449-4e82-bdc7-613d9a5b330f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0a40e8318e784571a7f1f0c0fb465ca5'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:57:03.787133 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-e71d0e20-4449-4e82-bdc7-613d9a5b330f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0a40e8318e784571a7f1f0c0fb465ca5'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:57:03.793828 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-e71d0e20-4449-4e82-bdc7-613d9a5b330f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0a40e8318e784571a7f1f0c0fb465ca5'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:57:03.801742 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-e71d0e20-4449-4e82-bdc7-613d9a5b330f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0a40e8318e784571a7f1f0c0fb465ca5'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:57:03.809799 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1219/2423] 10.222.0.57 () {58 vars in 1224 bytes} [Fri Sep 16 07:57:03 2022] DELETE /identity/v3/users/0a40e8318e784571a7f1f0c0fb465ca5 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 07:57:03.812993 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd97b914-c68c-4893-bb2e-3524d05a67d3 None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:57:03.813366 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd97b914-c68c-4893-bb2e-3524d05a67d3 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:57:03.813748 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd97b914-c68c-4893-bb2e-3524d05a67d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:57:03.834168 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-cd97b914-c68c-4893-bb2e-3524d05a67d3 None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:57:03.835480 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-cd97b914-c68c-4893-bb2e-3524d05a67d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:57:03.901242 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1205/2424] 10.222.0.57 () {58 vars in 958 bytes} [Fri Sep 16 07:57:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 07:57:03.912484 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71d0e20-4449-4e82-bdc7-613d9a5b330f admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:57:03.914524 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-e71d0e20-4449-4e82-bdc7-613d9a5b330f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:57:03.940522 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd97b914-c68c-4893-bb2e-3524d05a67d3 None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:57:03.942912 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-cd97b914-c68c-4893-bb2e-3524d05a67d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:57:03.961554 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd97b914-c68c-4893-bb2e-3524d05a67d3 None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:57:03.969467 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e69b1c-9c1f-480a-8038-8981e464a475 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:57:03.970380 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e69b1c-9c1f-480a-8038-8981e464a475 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:57:03.970833 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e69b1c-9c1f-480a-8038-8981e464a475 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:57:03.971192 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e69b1c-9c1f-480a-8038-8981e464a475 admin admin] PATH_INFO: `/v3/projects/f449be05beea419e9c152bb067522c7b` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:57:03.972649 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e69b1c-9c1f-480a-8038-8981e464a475 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f449be05beea419e9c152bb067522c7b)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:57:03.974716 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e69b1c-9c1f-480a-8038-8981e464a475 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:57:03.976713 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:57:04.013299 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71d0e20-4449-4e82-bdc7-613d9a5b330f admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:57:04.018223 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf3ebb4-c590-4a0c-8a3e-f43869385123 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1062e457207a41e4ba4f0a0c4bf36f1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4735f453c0c24cc4a1c14e9ac84a0b46', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:57:04.019921 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf3ebb4-c590-4a0c-8a3e-f43869385123 service neutron] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:57:04.020205 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf3ebb4-c590-4a0c-8a3e-f43869385123 service neutron] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:57:04.020484 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf3ebb4-c590-4a0c-8a3e-f43869385123 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:57:04.034559 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf3ebb4-c590-4a0c-8a3e-f43869385123 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:57:04.036007 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf3ebb4-c590-4a0c-8a3e-f43869385123 service neutron] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:57:04.043186 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-12e69b1c-9c1f-480a-8038-8981e464a475 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f449be05beea419e9c152bb067522c7b', 'request_id': 'req-12e69b1c-9c1f-480a-8038-8981e464a475'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:57:04.054199 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1220/2425] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Sep 16 07:57:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 07:57:04.055646 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-12e69b1c-9c1f-480a-8038-8981e464a475 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f449be05beea419e9c152bb067522c7b', 'request_id': 'req-12e69b1c-9c1f-480a-8038-8981e464a475'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:57:04.063353 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-12e69b1c-9c1f-480a-8038-8981e464a475 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f449be05beea419e9c152bb067522c7b', 'request_id': 'req-12e69b1c-9c1f-480a-8038-8981e464a475'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:57:04.075185 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-12e69b1c-9c1f-480a-8038-8981e464a475 admin admin] The token cache is being invalidate because project f449be05beea419e9c152bb067522c7b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81430) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 07:57:04.075470 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-12e69b1c-9c1f-480a-8038-8981e464a475 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:57:04.076128 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-12e69b1c-9c1f-480a-8038-8981e464a475 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:57:04.077674 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1206/2426] 10.222.0.57 () {58 vars in 1233 bytes} [Fri Sep 16 07:57:03 2022] DELETE /identity/v3/projects/f449be05beea419e9c152bb067522c7b => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 16 07:57:04.088728 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06573b81-f209-49b0-9914-3fe8765ebbab None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:57:04.089008 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06573b81-f209-49b0-9914-3fe8765ebbab None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:57:04.089280 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06573b81-f209-49b0-9914-3fe8765ebbab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:57:04.117154 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-06573b81-f209-49b0-9914-3fe8765ebbab None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:57:04.118396 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-06573b81-f209-49b0-9914-3fe8765ebbab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:57:04.208378 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1221/2427] 10.222.0.57 () {58 vars in 958 bytes} [Fri Sep 16 07:57:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 07:57:04.216427 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17909a7-8ff1-4d3c-96ad-194796184783 None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:57:04.216919 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17909a7-8ff1-4d3c-96ad-194796184783 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:57:04.218160 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17909a7-8ff1-4d3c-96ad-194796184783 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:57:04.240239 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-a17909a7-8ff1-4d3c-96ad-194796184783 None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:57:04.241977 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-a17909a7-8ff1-4d3c-96ad-194796184783 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:57:04.250808 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1207/2428] 10.222.0.57 () {58 vars in 958 bytes} [Fri Sep 16 07:57:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 07:57:04.255321 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06573b81-f209-49b0-9914-3fe8765ebbab None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:57:04.271378 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06573b81-f209-49b0-9914-3fe8765ebbab None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:57:04.277447 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac2cfd5-e15a-498a-8835-9172fcefc927 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:57:04.278030 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac2cfd5-e15a-498a-8835-9172fcefc927 admin admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:57:04.278309 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac2cfd5-e15a-498a-8835-9172fcefc927 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:57:04.278692 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac2cfd5-e15a-498a-8835-9172fcefc927 admin admin] PATH_INFO: `/v3/domains` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:57:04.280024 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac2cfd5-e15a-498a-8835-9172fcefc927 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:57:04.280548 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac2cfd5-e15a-498a-8835-9172fcefc927 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:57:04.282484 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac2cfd5-e15a-498a-8835-9172fcefc927 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:57:04.302154 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1222/2429] 10.222.0.57 () {58 vars in 1153 bytes} [Fri Sep 16 07:57:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:57:04.306445 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17909a7-8ff1-4d3c-96ad-194796184783 None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:57:04.324709 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17909a7-8ff1-4d3c-96ad-194796184783 None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:57:04.331442 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05103334-621c-41da-ad41-d51864feeb05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:57:04.332061 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05103334-621c-41da-ad41-d51864feeb05 admin admin] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:57:04.332345 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05103334-621c-41da-ad41-d51864feeb05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:57:04.332737 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05103334-621c-41da-ad41-d51864feeb05 admin admin] PATH_INFO: `/v3/projects` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:57:04.333248 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05103334-621c-41da-ad41-d51864feeb05 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:57:04.335173 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05103334-621c-41da-ad41-d51864feeb05 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:57:04.377674 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1208/2430] 10.222.0.57 () {60 vars in 1153 bytes} [Fri Sep 16 07:57:04 2022] POST /identity/v3/projects => generated 373 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 16 07:57:04.383377 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac2cfd5-e15a-498a-8835-9172fcefc927 admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:57:04.395132 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05103334-621c-41da-ad41-d51864feeb05 admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:57:04.399393 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-05103334-621c-41da-ad41-d51864feeb05 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:57:04.409373 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac2cfd5-e15a-498a-8835-9172fcefc927 admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:57:04.422467 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:57:04.495934 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e3335c-2b44-4096-a36b-1337113455e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:57:04.496680 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e3335c-2b44-4096-a36b-1337113455e5 admin admin] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:57:04.497123 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05103334-621c-41da-ad41-d51864feeb05 admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:57:04.497266 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e3335c-2b44-4096-a36b-1337113455e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:57:04.497782 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e3335c-2b44-4096-a36b-1337113455e5 admin admin] PATH_INFO: `/v3/users` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:57:04.498848 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e3335c-2b44-4096-a36b-1337113455e5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:57:04.507069 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef31646-3251-4cad-acbe-cde7a6417919 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:57:04.507069 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef31646-3251-4cad-acbe-cde7a6417919 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:57:04.507069 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef31646-3251-4cad-acbe-cde7a6417919 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:57:04.507069 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef31646-3251-4cad-acbe-cde7a6417919 admin admin] PATH_INFO: `/v3/projects/d10eb429f76b4257a72cbec75dff706a` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:57:04.507597 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e3335c-2b44-4096-a36b-1337113455e5 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:57:04.510719 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef31646-3251-4cad-acbe-cde7a6417919 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d10eb429f76b4257a72cbec75dff706a)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:57:04.513027 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef31646-3251-4cad-acbe-cde7a6417919 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:57:04.537943 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1223/2431] 10.222.0.57 () {60 vars in 1144 bytes} [Fri Sep 16 07:57:04 2022] POST /identity/v3/users => generated 287 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 07:57:04.540964 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e3335c-2b44-4096-a36b-1337113455e5 admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:57:04.552801 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e3335c-2b44-4096-a36b-1337113455e5 admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:57:04.558916 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c0d0f3-d05f-4c49-bb25-c3363430a1b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:57:04.559506 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c0d0f3-d05f-4c49-bb25-c3363430a1b5 admin admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:57:04.559901 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c0d0f3-d05f-4c49-bb25-c3363430a1b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:57:04.560454 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c0d0f3-d05f-4c49-bb25-c3363430a1b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:57:04.561107 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c0d0f3-d05f-4c49-bb25-c3363430a1b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:57:04.562894 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c0d0f3-d05f-4c49-bb25-c3363430a1b5 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:57:04.579034 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1224/2432] 10.222.0.57 () {58 vars in 1122 bytes} [Fri Sep 16 07:57:04 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 07:57:04.580187 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c0d0f3-d05f-4c49-bb25-c3363430a1b5 admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:57:04.581065 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-7ef31646-3251-4cad-acbe-cde7a6417919 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd10eb429f76b4257a72cbec75dff706a', 'request_id': 'req-7ef31646-3251-4cad-acbe-cde7a6417919'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:57:04.590966 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c0d0f3-d05f-4c49-bb25-c3363430a1b5 admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:57:04.592655 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-7ef31646-3251-4cad-acbe-cde7a6417919 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd10eb429f76b4257a72cbec75dff706a', 'request_id': 'req-7ef31646-3251-4cad-acbe-cde7a6417919'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:57:04.599278 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-7ef31646-3251-4cad-acbe-cde7a6417919 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd10eb429f76b4257a72cbec75dff706a', 'request_id': 'req-7ef31646-3251-4cad-acbe-cde7a6417919'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:57:04.611770 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-7ef31646-3251-4cad-acbe-cde7a6417919 admin admin] The token cache is being invalidate because project d10eb429f76b4257a72cbec75dff706a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81430) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 07:57:04.612088 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-7ef31646-3251-4cad-acbe-cde7a6417919 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:57:04.612885 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-7ef31646-3251-4cad-acbe-cde7a6417919 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:57:04.614526 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1209/2433] 10.222.0.57 () {58 vars in 1233 bytes} [Fri Sep 16 07:57:04 2022] DELETE /identity/v3/projects/d10eb429f76b4257a72cbec75dff706a => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 07:57:04.640784 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:57:04.675915 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6afd921-210c-489c-bc67-277e64197c51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:57:04.685782 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6afd921-210c-489c-bc67-277e64197c51 admin admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:57:04.685782 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6afd921-210c-489c-bc67-277e64197c51 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:57:04.685782 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6afd921-210c-489c-bc67-277e64197c51 admin admin] PATH_INFO: `/v3/roles` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:57:04.685782 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6afd921-210c-489c-bc67-277e64197c51 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:57:04.685782 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6afd921-210c-489c-bc67-277e64197c51 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:57:04.692287 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1225/2434] 10.222.0.57 () {58 vars in 1122 bytes} [Fri Sep 16 07:57:04 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 16 07:57:04.696376 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef31646-3251-4cad-acbe-cde7a6417919 admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:57:04.697943 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-7ef31646-3251-4cad-acbe-cde7a6417919 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:57:04.716299 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef31646-3251-4cad-acbe-cde7a6417919 admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:57:04.722872 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc78699a-9e75-4003-ad55-d4044b140a26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:57:04.723982 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc78699a-9e75-4003-ad55-d4044b140a26 admin admin] REQUEST_METHOD: `PUT` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:57:04.724273 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc78699a-9e75-4003-ad55-d4044b140a26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:57:04.724565 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc78699a-9e75-4003-ad55-d4044b140a26 admin admin] PATH_INFO: `/v3/projects/7e815cc8cdf34567a4b14058f60cdfa8/users/62cb498605bd4e66b25af0d7317966bf/roles/4818d38cf2564825b312e66c9eb24762` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:57:04.746305 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc78699a-9e75-4003-ad55-d4044b140a26 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e815cc8cdf34567a4b14058f60cdfa8, user_id=62cb498605bd4e66b25af0d7317966bf, role_id=4818d38cf2564825b312e66c9eb24762)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:57:04.767670 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc78699a-9e75-4003-ad55-d4044b140a26 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:57:04.793108 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1210/2435] 10.222.0.57 () {60 vars in 1483 bytes} [Fri Sep 16 07:57:04 2022] PUT /identity/v3/projects/7e815cc8cdf34567a4b14058f60cdfa8/users/62cb498605bd4e66b25af0d7317966bf/roles/4818d38cf2564825b312e66c9eb24762 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 07:57:04.867233 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9d07a5-8732-47b9-8c0f-c365e03a98a2 None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:57:04.867547 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9d07a5-8732-47b9-8c0f-c365e03a98a2 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:57:04.867870 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9d07a5-8732-47b9-8c0f-c365e03a98a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:57:04.900896 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-ea9d07a5-8732-47b9-8c0f-c365e03a98a2 None None] MFA Rules not processed for user `62cb498605bd4e66b25af0d7317966bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:57:04.902315 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-ea9d07a5-8732-47b9-8c0f-c365e03a98a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:57:04.983045 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1226/2436] 10.222.0.57 () {58 vars in 958 bytes} [Fri Sep 16 07:57:04 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 07:57:04.995725 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc78699a-9e75-4003-ad55-d4044b140a26 admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:57:05.006396 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-bc78699a-9e75-4003-ad55-d4044b140a26 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:57:05.132776 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc78699a-9e75-4003-ad55-d4044b140a26 admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:57:05.136900 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c948e8-4504-4cfa-88f6-3ddaad5ffade service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544bf6be4c24454a013ca110c43cef2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4735f453c0c24cc4a1c14e9ac84a0b46', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:57:05.137565 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c948e8-4504-4cfa-88f6-3ddaad5ffade service cinder] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:57:05.137929 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c948e8-4504-4cfa-88f6-3ddaad5ffade service cinder] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:57:05.138215 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c948e8-4504-4cfa-88f6-3ddaad5ffade service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:57:05.159044 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c948e8-4504-4cfa-88f6-3ddaad5ffade service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:57:05.160001 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c948e8-4504-4cfa-88f6-3ddaad5ffade service cinder] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:57:05.171863 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1211/2437] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Sep 16 07:57:04 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 07:57:05.213688 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9d07a5-8732-47b9-8c0f-c365e03a98a2 None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:57:05.305295 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9d07a5-8732-47b9-8c0f-c365e03a98a2 None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:57:05.305295 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39495821-6ca6-452a-b684-a4ec9e650019 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:57:05.305295 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39495821-6ca6-452a-b684-a4ec9e650019 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:57:05.305295 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39495821-6ca6-452a-b684-a4ec9e650019 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:57:05.305621 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39495821-6ca6-452a-b684-a4ec9e650019 admin admin] PATH_INFO: `/v3/users/62cb498605bd4e66b25af0d7317966bf` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:57:05.305621 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39495821-6ca6-452a-b684-a4ec9e650019 admin admin] RBAC: Authorizing `identity:delete_user(user_id=62cb498605bd4e66b25af0d7317966bf)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:57:05.307343 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39495821-6ca6-452a-b684-a4ec9e650019 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:57:05.395326 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-39495821-6ca6-452a-b684-a4ec9e650019 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '62cb498605bd4e66b25af0d7317966bf'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:57:05.412270 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-39495821-6ca6-452a-b684-a4ec9e650019 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '62cb498605bd4e66b25af0d7317966bf'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:57:05.413225 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-39495821-6ca6-452a-b684-a4ec9e650019 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '62cb498605bd4e66b25af0d7317966bf'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:57:05.414999 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:57:05.421875 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-39495821-6ca6-452a-b684-a4ec9e650019 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '62cb498605bd4e66b25af0d7317966bf'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:57:05.429401 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-39495821-6ca6-452a-b684-a4ec9e650019 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '62cb498605bd4e66b25af0d7317966bf'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:57:05.435425 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1227/2438] 10.222.0.57 () {58 vars in 1224 bytes} [Fri Sep 16 07:57:05 2022] DELETE /identity/v3/users/62cb498605bd4e66b25af0d7317966bf => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 07:57:05.440071 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d38036-e919-4c52-84a6-386cdb1d0462 None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:57:05.440551 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d38036-e919-4c52-84a6-386cdb1d0462 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:57:05.441496 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d38036-e919-4c52-84a6-386cdb1d0462 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:57:05.465896 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-a1d38036-e919-4c52-84a6-386cdb1d0462 None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:57:05.468130 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-a1d38036-e919-4c52-84a6-386cdb1d0462 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:57:05.481048 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:57:05.537253 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1212/2439] 10.222.0.57 () {58 vars in 958 bytes} [Fri Sep 16 07:57:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 07:57:05.547466 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39495821-6ca6-452a-b684-a4ec9e650019 admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:57:05.548885 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-39495821-6ca6-452a-b684-a4ec9e650019 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:57:05.623021 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39495821-6ca6-452a-b684-a4ec9e650019 admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:57:05.626834 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6184d458-7a07-41f5-959b-028dfabd02b2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1062e457207a41e4ba4f0a0c4bf36f1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4735f453c0c24cc4a1c14e9ac84a0b46', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:57:05.627476 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6184d458-7a07-41f5-959b-028dfabd02b2 service neutron] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:57:05.627725 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6184d458-7a07-41f5-959b-028dfabd02b2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:57:05.627989 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6184d458-7a07-41f5-959b-028dfabd02b2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:57:05.642573 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6184d458-7a07-41f5-959b-028dfabd02b2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:57:05.644239 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6184d458-7a07-41f5-959b-028dfabd02b2 service neutron] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:57:05.655220 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1228/2440] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Sep 16 07:57:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 07:57:05.810097 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d38036-e919-4c52-84a6-386cdb1d0462 None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:57:05.812533 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-a1d38036-e919-4c52-84a6-386cdb1d0462 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:57:05.825964 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d38036-e919-4c52-84a6-386cdb1d0462 None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:57:05.831529 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcad282b-fdef-43c9-a4df-db4f6fef99aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:57:05.832171 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcad282b-fdef-43c9-a4df-db4f6fef99aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:57:05.832577 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcad282b-fdef-43c9-a4df-db4f6fef99aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:57:05.832852 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcad282b-fdef-43c9-a4df-db4f6fef99aa admin admin] PATH_INFO: `/v3/users/75980abad269461aba51fd6387d0147e` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:57:05.834027 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcad282b-fdef-43c9-a4df-db4f6fef99aa admin admin] RBAC: Authorizing `identity:delete_user(user_id=75980abad269461aba51fd6387d0147e)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:57:05.835975 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcad282b-fdef-43c9-a4df-db4f6fef99aa admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:57:05.923063 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-dcad282b-fdef-43c9-a4df-db4f6fef99aa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '75980abad269461aba51fd6387d0147e'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:57:05.923755 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-dcad282b-fdef-43c9-a4df-db4f6fef99aa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '75980abad269461aba51fd6387d0147e'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:57:05.934574 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-dcad282b-fdef-43c9-a4df-db4f6fef99aa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '75980abad269461aba51fd6387d0147e'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:57:05.956751 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-dcad282b-fdef-43c9-a4df-db4f6fef99aa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '75980abad269461aba51fd6387d0147e'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:57:05.964813 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-dcad282b-fdef-43c9-a4df-db4f6fef99aa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '75980abad269461aba51fd6387d0147e'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:57:05.971103 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1213/2441] 10.222.0.57 () {58 vars in 1224 bytes} [Fri Sep 16 07:57:05 2022] DELETE /identity/v3/users/75980abad269461aba51fd6387d0147e => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 16 07:57:05.975419 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfebf77-966a-4b1b-9b6b-5a2a40f2f59a None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:57:05.975721 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfebf77-966a-4b1b-9b6b-5a2a40f2f59a None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:57:05.975990 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfebf77-966a-4b1b-9b6b-5a2a40f2f59a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:57:05.995979 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-6bfebf77-966a-4b1b-9b6b-5a2a40f2f59a None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:57:05.997315 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-6bfebf77-966a-4b1b-9b6b-5a2a40f2f59a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:57:06.073653 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1229/2442] 10.222.0.57 () {58 vars in 958 bytes} [Fri Sep 16 07:57:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 16 07:57:06.084635 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcad282b-fdef-43c9-a4df-db4f6fef99aa admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:57:06.086185 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-dcad282b-fdef-43c9-a4df-db4f6fef99aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:57:06.093570 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfebf77-966a-4b1b-9b6b-5a2a40f2f59a None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:57:06.094962 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-6bfebf77-966a-4b1b-9b6b-5a2a40f2f59a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:57:06.110821 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfebf77-966a-4b1b-9b6b-5a2a40f2f59a None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:57:06.125638 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba40e8bf-0ce1-4b13-85f7-2ae4a426199b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:57:06.126275 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba40e8bf-0ce1-4b13-85f7-2ae4a426199b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:57:06.126560 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba40e8bf-0ce1-4b13-85f7-2ae4a426199b admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:57:06.126848 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba40e8bf-0ce1-4b13-85f7-2ae4a426199b admin admin] PATH_INFO: `/v3/projects/7e815cc8cdf34567a4b14058f60cdfa8` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:57:06.128081 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba40e8bf-0ce1-4b13-85f7-2ae4a426199b admin admin] RBAC: Authorizing `identity:delete_project(project_id=7e815cc8cdf34567a4b14058f60cdfa8)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:57:06.130056 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba40e8bf-0ce1-4b13-85f7-2ae4a426199b admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:57:06.160620 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcad282b-fdef-43c9-a4df-db4f6fef99aa admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:57:06.164513 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298e643c-15fc-4960-95dc-b9727c28e53b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1062e457207a41e4ba4f0a0c4bf36f1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4735f453c0c24cc4a1c14e9ac84a0b46', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:57:06.165122 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298e643c-15fc-4960-95dc-b9727c28e53b service neutron] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:57:06.165408 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298e643c-15fc-4960-95dc-b9727c28e53b service neutron] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:57:06.165694 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298e643c-15fc-4960-95dc-b9727c28e53b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:57:06.179186 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298e643c-15fc-4960-95dc-b9727c28e53b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:57:06.181273 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298e643c-15fc-4960-95dc-b9727c28e53b service neutron] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:57:06.189509 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-ba40e8bf-0ce1-4b13-85f7-2ae4a426199b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7e815cc8cdf34567a4b14058f60cdfa8', 'request_id': 'req-ba40e8bf-0ce1-4b13-85f7-2ae4a426199b'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:57:06.194484 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1214/2443] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Sep 16 07:57:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 07:57:06.196851 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-ba40e8bf-0ce1-4b13-85f7-2ae4a426199b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7e815cc8cdf34567a4b14058f60cdfa8', 'request_id': 'req-ba40e8bf-0ce1-4b13-85f7-2ae4a426199b'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:57:06.207525 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-ba40e8bf-0ce1-4b13-85f7-2ae4a426199b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7e815cc8cdf34567a4b14058f60cdfa8', 'request_id': 'req-ba40e8bf-0ce1-4b13-85f7-2ae4a426199b'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:57:06.222124 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-ba40e8bf-0ce1-4b13-85f7-2ae4a426199b admin admin] The token cache is being invalidate because project 7e815cc8cdf34567a4b14058f60cdfa8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81431) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 07:57:06.222425 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-ba40e8bf-0ce1-4b13-85f7-2ae4a426199b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:57:06.223138 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-ba40e8bf-0ce1-4b13-85f7-2ae4a426199b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:57:06.224852 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1230/2444] 10.222.0.57 () {58 vars in 1233 bytes} [Fri Sep 16 07:57:06 2022] DELETE /identity/v3/projects/7e815cc8cdf34567a4b14058f60cdfa8 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 07:57:06.557344 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0424a597-51b0-4e68-a33d-6533b8ba0a56 None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:57:06.557834 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0424a597-51b0-4e68-a33d-6533b8ba0a56 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:57:06.557939 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0424a597-51b0-4e68-a33d-6533b8ba0a56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:57:06.582093 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-0424a597-51b0-4e68-a33d-6533b8ba0a56 None None] MFA Rules not processed for user `56eb9bbabb65436bb095952159df184c`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:57:06.583805 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-0424a597-51b0-4e68-a33d-6533b8ba0a56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:57:06.606772 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba40e8bf-0ce1-4b13-85f7-2ae4a426199b admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:57:06.608372 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-ba40e8bf-0ce1-4b13-85f7-2ae4a426199b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:57:06.624473 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:INSERT=2,keystone:DELETE=8,keystone:SELECT=90 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:57:06.654176 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:57:06.696631 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1215/2445] 10.222.0.57 () {58 vars in 1009 bytes} [Fri Sep 16 07:57:06 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 07:57:06.729499 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba40e8bf-0ce1-4b13-85f7-2ae4a426199b admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:57:06.736018 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabac2ea-dbe5-44f9-95a1-e6f0c62ed30c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:57:06.736791 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabac2ea-dbe5-44f9-95a1-e6f0c62ed30c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:57:06.737130 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabac2ea-dbe5-44f9-95a1-e6f0c62ed30c admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:57:06.737359 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabac2ea-dbe5-44f9-95a1-e6f0c62ed30c admin admin] PATH_INFO: `/v3/projects/0c67add2448e4ca195f569eef789d0e7` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:57:06.738693 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabac2ea-dbe5-44f9-95a1-e6f0c62ed30c admin admin] RBAC: Authorizing `identity:delete_project(project_id=0c67add2448e4ca195f569eef789d0e7)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:57:06.740448 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabac2ea-dbe5-44f9-95a1-e6f0c62ed30c admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:57:06.758522 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0424a597-51b0-4e68-a33d-6533b8ba0a56 None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:57:06.759979 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-0424a597-51b0-4e68-a33d-6533b8ba0a56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:57:06.807556 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-eabac2ea-dbe5-44f9-95a1-e6f0c62ed30c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0c67add2448e4ca195f569eef789d0e7', 'request_id': 'req-eabac2ea-dbe5-44f9-95a1-e6f0c62ed30c'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:57:06.815075 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-eabac2ea-dbe5-44f9-95a1-e6f0c62ed30c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0c67add2448e4ca195f569eef789d0e7', 'request_id': 'req-eabac2ea-dbe5-44f9-95a1-e6f0c62ed30c'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:57:06.822518 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-eabac2ea-dbe5-44f9-95a1-e6f0c62ed30c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0c67add2448e4ca195f569eef789d0e7', 'request_id': 'req-eabac2ea-dbe5-44f9-95a1-e6f0c62ed30c'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:57:06.834687 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-eabac2ea-dbe5-44f9-95a1-e6f0c62ed30c admin admin] The token cache is being invalidate because project 0c67add2448e4ca195f569eef789d0e7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81431) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 07:57:06.834861 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-eabac2ea-dbe5-44f9-95a1-e6f0c62ed30c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:57:06.835569 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-eabac2ea-dbe5-44f9-95a1-e6f0c62ed30c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:57:06.838407 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1231/2446] 10.222.0.57 () {58 vars in 1233 bytes} [Fri Sep 16 07:57:06 2022] DELETE /identity/v3/projects/0c67add2448e4ca195f569eef789d0e7 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 07:57:06.847970 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabac2ea-dbe5-44f9-95a1-e6f0c62ed30c admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:57:06.851726 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-eabac2ea-dbe5-44f9-95a1-e6f0c62ed30c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:57:06.853564 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0424a597-51b0-4e68-a33d-6533b8ba0a56 None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:57:06.969774 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabac2ea-dbe5-44f9-95a1-e6f0c62ed30c admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:57:06.988913 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8066d0ce-ee9b-413c-9ebf-fc9c9c0643dc service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38abb0283b41449d8183b88912f2574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4735f453c0c24cc4a1c14e9ac84a0b46', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:57:06.989576 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8066d0ce-ee9b-413c-9ebf-fc9c9c0643dc service swift] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:57:06.989974 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8066d0ce-ee9b-413c-9ebf-fc9c9c0643dc service swift] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:57:06.990798 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8066d0ce-ee9b-413c-9ebf-fc9c9c0643dc service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:57:06.994538 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2657e7f0-94b3-48f3-9135-682fbf604bde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:57:06.995101 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2657e7f0-94b3-48f3-9135-682fbf604bde admin admin] REQUEST_METHOD: `DELETE` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:57:06.995381 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2657e7f0-94b3-48f3-9135-682fbf604bde admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:57:06.995649 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2657e7f0-94b3-48f3-9135-682fbf604bde admin admin] PATH_INFO: `/v3/users/62655d0e639e4397b1e1dc7d50b1df9b` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:57:06.996752 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-8066d0ce-ee9b-413c-9ebf-fc9c9c0643dc service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:57:06.999006 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2657e7f0-94b3-48f3-9135-682fbf604bde admin admin] RBAC: Authorizing `identity:delete_user(user_id=62655d0e639e4397b1e1dc7d50b1df9b)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:57:07.002177 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2657e7f0-94b3-48f3-9135-682fbf604bde admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:57:07.086115 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:57:07.094311 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-2657e7f0-94b3-48f3-9135-682fbf604bde admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '62655d0e639e4397b1e1dc7d50b1df9b'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:57:07.126598 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8066d0ce-ee9b-413c-9ebf-fc9c9c0643dc service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:57:07.127507 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-2657e7f0-94b3-48f3-9135-682fbf604bde admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '62655d0e639e4397b1e1dc7d50b1df9b'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:57:07.129667 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8066d0ce-ee9b-413c-9ebf-fc9c9c0643dc service swift] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:57:07.130251 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-2657e7f0-94b3-48f3-9135-682fbf604bde admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '62655d0e639e4397b1e1dc7d50b1df9b'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:57:07.141946 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-2657e7f0-94b3-48f3-9135-682fbf604bde admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '62655d0e639e4397b1e1dc7d50b1df9b'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:57:07.146387 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1216/2447] 10.222.0.57 () {60 vars in 1384 bytes} [Fri Sep 16 07:57:06 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 16 07:57:07.165104 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-2657e7f0-94b3-48f3-9135-682fbf604bde admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '62655d0e639e4397b1e1dc7d50b1df9b'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:57:07.176554 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1232/2448] 10.222.0.57 () {58 vars in 1224 bytes} [Fri Sep 16 07:57:06 2022] DELETE /identity/v3/users/62655d0e639e4397b1e1dc7d50b1df9b => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 07:57:07.522585 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8066d0ce-ee9b-413c-9ebf-fc9c9c0643dc service swift] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:57:07.557747 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8066d0ce-ee9b-413c-9ebf-fc9c9c0643dc service swift] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:57:07.580744 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:57:07.628676 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea544ecd-565e-4808-8249-207b6abad8f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:57:07.629324 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea544ecd-565e-4808-8249-207b6abad8f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:57:07.629606 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea544ecd-565e-4808-8249-207b6abad8f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:57:07.629909 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea544ecd-565e-4808-8249-207b6abad8f4 admin admin] PATH_INFO: `/v3/projects/38afdc8f944844ab94c82617b7c8a035` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:57:07.631077 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea544ecd-565e-4808-8249-207b6abad8f4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=38afdc8f944844ab94c82617b7c8a035)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:57:07.633033 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea544ecd-565e-4808-8249-207b6abad8f4 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:57:07.688719 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-ea544ecd-565e-4808-8249-207b6abad8f4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '38afdc8f944844ab94c82617b7c8a035', 'request_id': 'req-ea544ecd-565e-4808-8249-207b6abad8f4'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:57:07.697588 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-ea544ecd-565e-4808-8249-207b6abad8f4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '38afdc8f944844ab94c82617b7c8a035', 'request_id': 'req-ea544ecd-565e-4808-8249-207b6abad8f4'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:57:07.704149 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-ea544ecd-565e-4808-8249-207b6abad8f4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '38afdc8f944844ab94c82617b7c8a035', 'request_id': 'req-ea544ecd-565e-4808-8249-207b6abad8f4'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:57:07.717905 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-ea544ecd-565e-4808-8249-207b6abad8f4 admin admin] The token cache is being invalidate because project 38afdc8f944844ab94c82617b7c8a035 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81430) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 07:57:07.718924 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-ea544ecd-565e-4808-8249-207b6abad8f4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:57:07.719783 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-ea544ecd-565e-4808-8249-207b6abad8f4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:57:07.721588 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1217/2449] 10.222.0.57 () {58 vars in 1233 bytes} [Fri Sep 16 07:57:07 2022] DELETE /identity/v3/projects/38afdc8f944844ab94c82617b7c8a035 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 07:57:07.726723 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ed25ff-2cc2-4881-903a-f3436f52688b None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:57:07.727185 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ed25ff-2cc2-4881-903a-f3436f52688b None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:57:07.727279 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ed25ff-2cc2-4881-903a-f3436f52688b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:57:07.759022 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-33ed25ff-2cc2-4881-903a-f3436f52688b None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:57:07.760487 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-33ed25ff-2cc2-4881-903a-f3436f52688b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:57:07.843955 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1233/2450] 10.222.0.57 () {58 vars in 958 bytes} [Fri Sep 16 07:57:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 07:57:07.853749 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42dc59c-9b59-4996-a215-9dcd7e01fd47 None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:57:07.854208 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42dc59c-9b59-4996-a215-9dcd7e01fd47 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:57:07.854510 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42dc59c-9b59-4996-a215-9dcd7e01fd47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:57:07.879707 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-a42dc59c-9b59-4996-a215-9dcd7e01fd47 None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:57:07.880864 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-a42dc59c-9b59-4996-a215-9dcd7e01fd47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:57:07.889473 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1218/2451] 10.222.0.57 () {58 vars in 958 bytes} [Fri Sep 16 07:57:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 07:57:07.895944 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ed25ff-2cc2-4881-903a-f3436f52688b None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:57:07.907535 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ed25ff-2cc2-4881-903a-f3436f52688b None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:57:07.912516 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9209aa46-d6da-449f-8da3-0f8457a34ce1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:57:07.913174 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9209aa46-d6da-449f-8da3-0f8457a34ce1 admin admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:57:07.913458 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9209aa46-d6da-449f-8da3-0f8457a34ce1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:57:07.913752 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9209aa46-d6da-449f-8da3-0f8457a34ce1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:57:07.914397 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9209aa46-d6da-449f-8da3-0f8457a34ce1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:57:07.914693 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9209aa46-d6da-449f-8da3-0f8457a34ce1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:57:07.916437 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9209aa46-d6da-449f-8da3-0f8457a34ce1 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:57:07.929978 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1234/2452] 10.222.0.57 () {58 vars in 1153 bytes} [Fri Sep 16 07:57:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:57:07.934809 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42dc59c-9b59-4996-a215-9dcd7e01fd47 None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:57:07.946092 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42dc59c-9b59-4996-a215-9dcd7e01fd47 None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:57:07.951387 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7d591a-5505-4953-80a4-77accade69fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:57:07.952201 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7d591a-5505-4953-80a4-77accade69fc admin admin] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:57:07.952510 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7d591a-5505-4953-80a4-77accade69fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:57:07.953010 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7d591a-5505-4953-80a4-77accade69fc admin admin] PATH_INFO: `/v3/projects` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:57:07.953779 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7d591a-5505-4953-80a4-77accade69fc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:57:07.955776 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7d591a-5505-4953-80a4-77accade69fc admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:57:08.007014 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1219/2453] 10.222.0.57 () {60 vars in 1153 bytes} [Fri Sep 16 07:57:07 2022] POST /identity/v3/projects => generated 357 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 16 07:57:08.011390 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9209aa46-d6da-449f-8da3-0f8457a34ce1 admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:57:08.027874 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9209aa46-d6da-449f-8da3-0f8457a34ce1 admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:57:08.132608 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d56334-1c68-4fa6-980c-cce174ac8947 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:57:08.133146 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d56334-1c68-4fa6-980c-cce174ac8947 admin admin] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:57:08.133443 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d56334-1c68-4fa6-980c-cce174ac8947 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:57:08.133875 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d56334-1c68-4fa6-980c-cce174ac8947 admin admin] PATH_INFO: `/v3/users` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:57:08.134893 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d56334-1c68-4fa6-980c-cce174ac8947 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:57:08.136616 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d56334-1c68-4fa6-980c-cce174ac8947 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:57:08.170881 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1235/2454] 10.222.0.57 () {60 vars in 1144 bytes} [Fri Sep 16 07:57:08 2022] POST /identity/v3/users => generated 279 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 07:57:08.175288 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7d591a-5505-4953-80a4-77accade69fc admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:57:08.192650 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7d591a-5505-4953-80a4-77accade69fc admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:57:08.199033 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1de9e5-54e3-4c8f-8c6c-220dc8bd64a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:57:08.199727 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1de9e5-54e3-4c8f-8c6c-220dc8bd64a0 admin admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:57:08.200084 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1de9e5-54e3-4c8f-8c6c-220dc8bd64a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:57:08.200314 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1de9e5-54e3-4c8f-8c6c-220dc8bd64a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:57:08.201011 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1de9e5-54e3-4c8f-8c6c-220dc8bd64a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:57:08.203963 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1de9e5-54e3-4c8f-8c6c-220dc8bd64a0 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:57:08.223949 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1220/2455] 10.222.0.57 () {58 vars in 1122 bytes} [Fri Sep 16 07:57:08 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 07:57:08.229793 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d56334-1c68-4fa6-980c-cce174ac8947 admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:57:08.255639 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d56334-1c68-4fa6-980c-cce174ac8947 admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:57:08.262135 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a51e64-1b95-411a-846d-61b2b6f703fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:57:08.262927 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a51e64-1b95-411a-846d-61b2b6f703fb admin admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:57:08.263356 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a51e64-1b95-411a-846d-61b2b6f703fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:57:08.263507 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a51e64-1b95-411a-846d-61b2b6f703fb admin admin] PATH_INFO: `/v3/roles` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:57:08.264747 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a51e64-1b95-411a-846d-61b2b6f703fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:57:08.266435 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a51e64-1b95-411a-846d-61b2b6f703fb admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:57:08.290966 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1236/2456] 10.222.0.57 () {58 vars in 1122 bytes} [Fri Sep 16 07:57:08 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 07:57:08.296112 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1de9e5-54e3-4c8f-8c6c-220dc8bd64a0 admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:57:08.306637 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1de9e5-54e3-4c8f-8c6c-220dc8bd64a0 admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:57:08.315883 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d153f62-b4b6-4bec-a443-08d3c5ff89ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:57:08.316608 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d153f62-b4b6-4bec-a443-08d3c5ff89ab admin admin] REQUEST_METHOD: `PUT` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:57:08.316942 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d153f62-b4b6-4bec-a443-08d3c5ff89ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:57:08.317236 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d153f62-b4b6-4bec-a443-08d3c5ff89ab admin admin] PATH_INFO: `/v3/projects/00953412b9de405cb20b22986be755bd/users/8fc4f14ec2674dc78321903a88ed6837/roles/4818d38cf2564825b312e66c9eb24762` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:57:08.340285 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d153f62-b4b6-4bec-a443-08d3c5ff89ab admin admin] RBAC: Authorizing `identity:create_grant(project_id=00953412b9de405cb20b22986be755bd, user_id=8fc4f14ec2674dc78321903a88ed6837, role_id=4818d38cf2564825b312e66c9eb24762)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:57:08.343410 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d153f62-b4b6-4bec-a443-08d3c5ff89ab admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:57:08.363583 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1221/2457] 10.222.0.57 () {60 vars in 1483 bytes} [Fri Sep 16 07:57:08 2022] PUT /identity/v3/projects/00953412b9de405cb20b22986be755bd/users/8fc4f14ec2674dc78321903a88ed6837/roles/4818d38cf2564825b312e66c9eb24762 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 07:57:08.377917 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ea2f45-e794-4dde-8421-5153688c2500 None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:57:08.378198 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ea2f45-e794-4dde-8421-5153688c2500 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:57:08.378472 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ea2f45-e794-4dde-8421-5153688c2500 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:57:08.413189 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-a5ea2f45-e794-4dde-8421-5153688c2500 None None] MFA Rules not processed for user `8fc4f14ec2674dc78321903a88ed6837`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:57:08.414442 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-a5ea2f45-e794-4dde-8421-5153688c2500 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:57:08.432335 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:57:08.502791 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1237/2458] 10.222.0.57 () {58 vars in 958 bytes} [Fri Sep 16 07:57:08 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 07:57:08.507166 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d153f62-b4b6-4bec-a443-08d3c5ff89ab admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:57:08.592859 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:57:08.624222 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d153f62-b4b6-4bec-a443-08d3c5ff89ab admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:57:08.634826 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1b32d1-cd75-49d2-892c-e535d9df88bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:57:08.635775 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1b32d1-cd75-49d2-892c-e535d9df88bc admin admin] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:57:08.636655 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1b32d1-cd75-49d2-892c-e535d9df88bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:57:08.637092 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1b32d1-cd75-49d2-892c-e535d9df88bc admin admin] PATH_INFO: `/v3/projects` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:57:08.638114 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1b32d1-cd75-49d2-892c-e535d9df88bc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:57:08.641593 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1b32d1-cd75-49d2-892c-e535d9df88bc admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:57:08.688224 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1222/2459] 10.222.0.57 () {60 vars in 1153 bytes} [Fri Sep 16 07:57:08 2022] POST /identity/v3/projects => generated 355 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 07:57:08.689407 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ea2f45-e794-4dde-8421-5153688c2500 None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:57:08.704107 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ea2f45-e794-4dde-8421-5153688c2500 None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:57:08.806853 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbce4652-f743-43f0-b387-1fb08236804b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:57:08.807621 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbce4652-f743-43f0-b387-1fb08236804b admin admin] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:57:08.807910 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbce4652-f743-43f0-b387-1fb08236804b admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:57:08.808344 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbce4652-f743-43f0-b387-1fb08236804b admin admin] PATH_INFO: `/v3/users` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:57:08.809083 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbce4652-f743-43f0-b387-1fb08236804b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:57:08.812125 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbce4652-f743-43f0-b387-1fb08236804b admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:57:08.846101 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1238/2460] 10.222.0.57 () {60 vars in 1144 bytes} [Fri Sep 16 07:57:08 2022] POST /identity/v3/users => generated 284 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 07:57:08.847539 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1b32d1-cd75-49d2-892c-e535d9df88bc admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:57:08.861977 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1b32d1-cd75-49d2-892c-e535d9df88bc admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:57:08.867629 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f3686b-0d34-4349-84c6-52043300ee1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:57:08.868241 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f3686b-0d34-4349-84c6-52043300ee1a admin admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:57:08.868540 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f3686b-0d34-4349-84c6-52043300ee1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:57:08.868860 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f3686b-0d34-4349-84c6-52043300ee1a admin admin] PATH_INFO: `/v3/roles` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:57:08.869633 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f3686b-0d34-4349-84c6-52043300ee1a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:57:08.872922 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f3686b-0d34-4349-84c6-52043300ee1a admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:57:08.889870 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1223/2461] 10.222.0.57 () {58 vars in 1122 bytes} [Fri Sep 16 07:57:08 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 07:57:08.891250 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbce4652-f743-43f0-b387-1fb08236804b admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:57:08.904261 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbce4652-f743-43f0-b387-1fb08236804b admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:57:08.912249 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5304423d-1eae-4af6-ad07-3339829147a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:57:08.913126 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5304423d-1eae-4af6-ad07-3339829147a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:57:08.913429 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5304423d-1eae-4af6-ad07-3339829147a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:57:08.913782 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5304423d-1eae-4af6-ad07-3339829147a6 admin admin] PATH_INFO: `/v3/projects/1e593458d15c4a80a186358d41f7025f/users/5da2fc0269ba4402bb1809de45488223/roles/567db03c91854ad9af1e9a87ec1bd275` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:57:08.948334 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5304423d-1eae-4af6-ad07-3339829147a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e593458d15c4a80a186358d41f7025f, user_id=5da2fc0269ba4402bb1809de45488223, role_id=567db03c91854ad9af1e9a87ec1bd275)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:57:08.952051 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5304423d-1eae-4af6-ad07-3339829147a6 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:57:08.982056 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1239/2462] 10.222.0.57 () {60 vars in 1483 bytes} [Fri Sep 16 07:57:08 2022] PUT /identity/v3/projects/1e593458d15c4a80a186358d41f7025f/users/5da2fc0269ba4402bb1809de45488223/roles/567db03c91854ad9af1e9a87ec1bd275 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 07:57:08.985748 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f3686b-0d34-4349-84c6-52043300ee1a admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:57:08.998592 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f3686b-0d34-4349-84c6-52043300ee1a admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:57:09.135020 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b353ca5b-6e24-4187-a274-6036fe03256b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:57:09.135647 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b353ca5b-6e24-4187-a274-6036fe03256b admin admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:57:09.135979 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b353ca5b-6e24-4187-a274-6036fe03256b admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:57:09.136250 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b353ca5b-6e24-4187-a274-6036fe03256b admin admin] PATH_INFO: `/v3/roles` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:57:09.136925 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b353ca5b-6e24-4187-a274-6036fe03256b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:57:09.139120 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b353ca5b-6e24-4187-a274-6036fe03256b admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:57:09.160254 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1224/2463] 10.222.0.57 () {58 vars in 1122 bytes} [Fri Sep 16 07:57:08 2022] GET /identity/v3/roles => generated 1420 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 07:57:09.167493 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5304423d-1eae-4af6-ad07-3339829147a6 admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:57:09.188406 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5304423d-1eae-4af6-ad07-3339829147a6 admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:57:09.196278 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b722ceaf-5b1e-4ba2-8ba1-1d7fe14d34c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:57:09.196985 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b722ceaf-5b1e-4ba2-8ba1-1d7fe14d34c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:57:09.197234 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b722ceaf-5b1e-4ba2-8ba1-1d7fe14d34c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:57:09.197512 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b722ceaf-5b1e-4ba2-8ba1-1d7fe14d34c8 admin admin] PATH_INFO: `/v3/projects/1e593458d15c4a80a186358d41f7025f/users/5da2fc0269ba4402bb1809de45488223/roles/567db03c91854ad9af1e9a87ec1bd275` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:57:09.199500 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b722ceaf-5b1e-4ba2-8ba1-1d7fe14d34c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e593458d15c4a80a186358d41f7025f, user_id=5da2fc0269ba4402bb1809de45488223, role_id=567db03c91854ad9af1e9a87ec1bd275)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:57:09.203894 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b722ceaf-5b1e-4ba2-8ba1-1d7fe14d34c8 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:57:09.225335 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1240/2464] 10.222.0.57 () {60 vars in 1483 bytes} [Fri Sep 16 07:57:09 2022] PUT /identity/v3/projects/1e593458d15c4a80a186358d41f7025f/users/5da2fc0269ba4402bb1809de45488223/roles/567db03c91854ad9af1e9a87ec1bd275 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 16 07:57:09.235467 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c22ec57-f77e-4c9d-b8d1-ee2976eec4c6 None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:57:09.235954 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c22ec57-f77e-4c9d-b8d1-ee2976eec4c6 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:57:09.236336 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c22ec57-f77e-4c9d-b8d1-ee2976eec4c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:57:09.301068 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-5c22ec57-f77e-4c9d-b8d1-ee2976eec4c6 None None] MFA Rules not processed for user `5da2fc0269ba4402bb1809de45488223`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:57:09.302331 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-5c22ec57-f77e-4c9d-b8d1-ee2976eec4c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:57:09.438880 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1225/2465] 10.222.0.57 () {58 vars in 958 bytes} [Fri Sep 16 07:57:09 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 07:57:09.447089 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b722ceaf-5b1e-4ba2-8ba1-1d7fe14d34c8 admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:57:09.450311 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-b722ceaf-5b1e-4ba2-8ba1-1d7fe14d34c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:57:09.592985 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b722ceaf-5b1e-4ba2-8ba1-1d7fe14d34c8 admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:57:09.597294 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484494be-a8cb-402a-8f30-2c54a0020406 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544bf6be4c24454a013ca110c43cef2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4735f453c0c24cc4a1c14e9ac84a0b46', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:57:09.598405 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484494be-a8cb-402a-8f30-2c54a0020406 service cinder] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:57:09.598755 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484494be-a8cb-402a-8f30-2c54a0020406 service cinder] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:57:09.599097 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484494be-a8cb-402a-8f30-2c54a0020406 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:57:09.610581 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484494be-a8cb-402a-8f30-2c54a0020406 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:57:09.612191 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484494be-a8cb-402a-8f30-2c54a0020406 service cinder] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:57:09.624809 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1241/2466] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Sep 16 07:57:09 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 16 07:57:09.772975 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c22ec57-f77e-4c9d-b8d1-ee2976eec4c6 None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:57:09.785033 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c22ec57-f77e-4c9d-b8d1-ee2976eec4c6 None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:57:09.792652 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc003fa5-be41-4ca8-9bc9-344592e4e486 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544bf6be4c24454a013ca110c43cef2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4735f453c0c24cc4a1c14e9ac84a0b46', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:57:09.793270 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc003fa5-be41-4ca8-9bc9-344592e4e486 service cinder] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:57:09.793622 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc003fa5-be41-4ca8-9bc9-344592e4e486 service cinder] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:57:09.793894 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc003fa5-be41-4ca8-9bc9-344592e4e486 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:57:09.901256 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:57:09.927804 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc003fa5-be41-4ca8-9bc9-344592e4e486 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:57:09.929370 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc003fa5-be41-4ca8-9bc9-344592e4e486 service cinder] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:57:09.942943 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1226/2467] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Sep 16 07:57:09 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 07:57:10.786232 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1399d9-5b39-4e53-b4ea-0896ebc801f2 None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:57:10.786930 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1399d9-5b39-4e53-b4ea-0896ebc801f2 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:57:10.792672 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1399d9-5b39-4e53-b4ea-0896ebc801f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:57:10.811613 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-7e1399d9-5b39-4e53-b4ea-0896ebc801f2 None None] MFA Rules not processed for user `c0bb5e7b0e664b3ebbce9f6317b83778`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:57:10.813175 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-7e1399d9-5b39-4e53-b4ea-0896ebc801f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:57:10.826802 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:57:10.968880 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1242/2468] 10.222.0.57 () {58 vars in 958 bytes} [Fri Sep 16 07:57:10 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 16 07:57:19.938144 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=9 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:57:20.951530 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=21 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:57:23.165742 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee9382f-adab-4edc-bdbd-d505aec107bd None None] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:57:23.166204 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee9382f-adab-4edc-bdbd-d505aec107bd None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:57:23.166388 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee9382f-adab-4edc-bdbd-d505aec107bd None None] PATH_INFO: `/` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:57:23.167839 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1227/2469] 10.222.0.57 () {54 vars in 921 bytes} [Fri Sep 16 07:57:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 07:57:23.174091 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8948c899-dc9c-44af-9a9a-71c5a966647a None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:57:23.174613 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8948c899-dc9c-44af-9a9a-71c5a966647a None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:57:23.174613 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8948c899-dc9c-44af-9a9a-71c5a966647a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:57:23.196418 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-8948c899-dc9c-44af-9a9a-71c5a966647a None None] MFA Rules not processed for user `9bec4d9b08514461a1bf63c6b88f53b2`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:57:23.197823 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-8948c899-dc9c-44af-9a9a-71c5a966647a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:57:23.268063 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1243/2470] 10.222.0.57 () {58 vars in 1018 bytes} [Fri Sep 16 07:57:23 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 07:57:23.279466 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee9382f-adab-4edc-bdbd-d505aec107bd None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:57:23.281340 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-7ee9382f-adab-4edc-bdbd-d505aec107bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:57:23.345952 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee9382f-adab-4edc-bdbd-d505aec107bd None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:57:23.350104 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bdf46b-b285-4a5f-bdc9-61ea22b19b4a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceecb2c2fe9842e3b228848e00fd11ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4735f453c0c24cc4a1c14e9ac84a0b46', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:57:23.350708 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bdf46b-b285-4a5f-bdc9-61ea22b19b4a service glance] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:57:23.350985 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bdf46b-b285-4a5f-bdc9-61ea22b19b4a service glance] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:57:23.351258 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bdf46b-b285-4a5f-bdc9-61ea22b19b4a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:57:23.364535 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38bdf46b-b285-4a5f-bdc9-61ea22b19b4a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:57:23.366280 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38bdf46b-b285-4a5f-bdc9-61ea22b19b4a service glance] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:57:23.385465 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1228/2471] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Sep 16 07:57:23 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 07:57:23.502284 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b6d422-5f69-4b47-8422-511fa9eab6bd None None] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:57:23.502632 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b6d422-5f69-4b47-8422-511fa9eab6bd None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:57:23.502994 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b6d422-5f69-4b47-8422-511fa9eab6bd None None] PATH_INFO: `/` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:57:23.505744 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1244/2472] 10.222.0.57 () {54 vars in 921 bytes} [Fri Sep 16 07:57:23 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 16 07:57:23.510867 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa6c0c8-e65c-4f10-94bc-92873310829d None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:57:23.511232 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa6c0c8-e65c-4f10-94bc-92873310829d None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:57:23.511586 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa6c0c8-e65c-4f10-94bc-92873310829d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:57:23.534745 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-efa6c0c8-e65c-4f10-94bc-92873310829d None None] MFA Rules not processed for user `1062e457207a41e4ba4f0a0c4bf36f1d`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:57:23.535959 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-efa6c0c8-e65c-4f10-94bc-92873310829d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:57:23.588974 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1229/2473] 10.222.0.57 () {58 vars in 1018 bytes} [Fri Sep 16 07:57:23 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 16 07:57:23.602162 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b6d422-5f69-4b47-8422-511fa9eab6bd None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:57:23.604032 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-a7b6d422-5f69-4b47-8422-511fa9eab6bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:57:23.617674 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b6d422-5f69-4b47-8422-511fa9eab6bd None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:57:23.625528 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a9fcc1-c127-4f36-bcf3-1bc1ad19303a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1062e457207a41e4ba4f0a0c4bf36f1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4735f453c0c24cc4a1c14e9ac84a0b46', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:57:23.626187 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a9fcc1-c127-4f36-bcf3-1bc1ad19303a service neutron] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:57:23.626463 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a9fcc1-c127-4f36-bcf3-1bc1ad19303a service neutron] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:57:23.626734 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a9fcc1-c127-4f36-bcf3-1bc1ad19303a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:57:23.634351 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a9fcc1-c127-4f36-bcf3-1bc1ad19303a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:57:23.635779 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a9fcc1-c127-4f36-bcf3-1bc1ad19303a service neutron] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:57:23.644180 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1245/2474] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Sep 16 07:57:23 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 07:57:23.762673 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bba330-6e92-409d-b5e3-2523cff6942f None None] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:57:23.762966 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bba330-6e92-409d-b5e3-2523cff6942f None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:57:23.763241 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bba330-6e92-409d-b5e3-2523cff6942f None None] PATH_INFO: `/` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:57:23.764632 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1230/2475] 10.222.0.57 () {54 vars in 921 bytes} [Fri Sep 16 07:57:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 07:57:23.770956 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c29589-f23b-4941-92d4-35ea426114fa None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:57:23.771182 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c29589-f23b-4941-92d4-35ea426114fa None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:57:23.771456 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c29589-f23b-4941-92d4-35ea426114fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:57:23.791289 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-81c29589-f23b-4941-92d4-35ea426114fa None None] MFA Rules not processed for user `9bec4d9b08514461a1bf63c6b88f53b2`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:57:23.792503 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-81c29589-f23b-4941-92d4-35ea426114fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:57:23.802371 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1246/2476] 10.222.0.57 () {58 vars in 1018 bytes} [Fri Sep 16 07:57:23 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 16 07:57:23.814373 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bba330-6e92-409d-b5e3-2523cff6942f None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:57:23.826267 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bba330-6e92-409d-b5e3-2523cff6942f None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:57:23.832721 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342d8667-84ce-43e1-87d0-a4873fa86fc6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1062e457207a41e4ba4f0a0c4bf36f1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4735f453c0c24cc4a1c14e9ac84a0b46', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:57:23.833521 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342d8667-84ce-43e1-87d0-a4873fa86fc6 service neutron] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:57:23.833904 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342d8667-84ce-43e1-87d0-a4873fa86fc6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:57:23.834252 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342d8667-84ce-43e1-87d0-a4873fa86fc6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:57:23.848295 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342d8667-84ce-43e1-87d0-a4873fa86fc6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:57:23.850183 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342d8667-84ce-43e1-87d0-a4873fa86fc6 service neutron] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:57:23.861995 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1231/2477] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Sep 16 07:57:23 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 07:57:24.986378 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c29589-f23b-4941-92d4-35ea426114fa None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:57:25.000321 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c29589-f23b-4941-92d4-35ea426114fa None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:57:25.004304 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0ef23f-aad2-44dc-8e8e-ad168ce79d5b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1062e457207a41e4ba4f0a0c4bf36f1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4735f453c0c24cc4a1c14e9ac84a0b46', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:57:25.005025 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0ef23f-aad2-44dc-8e8e-ad168ce79d5b service neutron] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:57:25.005404 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0ef23f-aad2-44dc-8e8e-ad168ce79d5b service neutron] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:57:25.005807 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0ef23f-aad2-44dc-8e8e-ad168ce79d5b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:57:25.007864 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-aa0ef23f-aad2-44dc-8e8e-ad168ce79d5b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:57:25.099295 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0ef23f-aad2-44dc-8e8e-ad168ce79d5b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:57:25.101323 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0ef23f-aad2-44dc-8e8e-ad168ce79d5b service neutron] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:57:25.128654 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1247/2478] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Sep 16 07:57:24 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 07:57:26.935303 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342d8667-84ce-43e1-87d0-a4873fa86fc6 service neutron] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:57:27.024774 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342d8667-84ce-43e1-87d0-a4873fa86fc6 service neutron] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:57:27.037057 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be6fd82-2c76-44fb-9174-b08171216e7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:57:27.039277 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be6fd82-2c76-44fb-9174-b08171216e7b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:57:27.041516 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be6fd82-2c76-44fb-9174-b08171216e7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:57:27.041850 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be6fd82-2c76-44fb-9174-b08171216e7b admin admin] PATH_INFO: `/v3/users/8fc4f14ec2674dc78321903a88ed6837` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:57:27.043594 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be6fd82-2c76-44fb-9174-b08171216e7b admin admin] RBAC: Authorizing `identity:delete_user(user_id=8fc4f14ec2674dc78321903a88ed6837)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:57:27.045550 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be6fd82-2c76-44fb-9174-b08171216e7b admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:57:27.145672 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:57:27.158859 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-7be6fd82-2c76-44fb-9174-b08171216e7b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8fc4f14ec2674dc78321903a88ed6837'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:57:27.159772 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-7be6fd82-2c76-44fb-9174-b08171216e7b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8fc4f14ec2674dc78321903a88ed6837'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:57:27.178076 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-7be6fd82-2c76-44fb-9174-b08171216e7b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8fc4f14ec2674dc78321903a88ed6837'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:57:27.196972 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-7be6fd82-2c76-44fb-9174-b08171216e7b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8fc4f14ec2674dc78321903a88ed6837'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:57:27.206747 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-7be6fd82-2c76-44fb-9174-b08171216e7b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8fc4f14ec2674dc78321903a88ed6837'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:57:27.219747 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1232/2479] 10.222.0.57 () {58 vars in 1224 bytes} [Fri Sep 16 07:57:26 2022] DELETE /identity/v3/users/8fc4f14ec2674dc78321903a88ed6837 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 07:57:27.220693 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f5da19-5607-4e3b-85be-43f4b1da0cae None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:57:27.221152 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f5da19-5607-4e3b-85be-43f4b1da0cae None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:57:27.221270 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f5da19-5607-4e3b-85be-43f4b1da0cae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:57:27.250741 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-a3f5da19-5607-4e3b-85be-43f4b1da0cae None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:57:27.252961 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-a3f5da19-5607-4e3b-85be-43f4b1da0cae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:57:27.357654 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1248/2480] 10.222.0.57 () {58 vars in 958 bytes} [Fri Sep 16 07:57:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 07:57:27.390634 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be6fd82-2c76-44fb-9174-b08171216e7b admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:57:27.392473 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-7be6fd82-2c76-44fb-9174-b08171216e7b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:57:27.468619 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be6fd82-2c76-44fb-9174-b08171216e7b admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:57:27.472713 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3eaea0-e049-47fa-877f-951d3e19406d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1062e457207a41e4ba4f0a0c4bf36f1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4735f453c0c24cc4a1c14e9ac84a0b46', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:57:27.473335 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3eaea0-e049-47fa-877f-951d3e19406d service neutron] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:57:27.473664 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3eaea0-e049-47fa-877f-951d3e19406d service neutron] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:57:27.474053 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3eaea0-e049-47fa-877f-951d3e19406d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:57:27.489572 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3eaea0-e049-47fa-877f-951d3e19406d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:57:27.491741 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3eaea0-e049-47fa-877f-951d3e19406d service neutron] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:57:27.505675 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1233/2481] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Sep 16 07:57:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 07:57:28.126579 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f5da19-5607-4e3b-85be-43f4b1da0cae None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:57:28.128119 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-a3f5da19-5607-4e3b-85be-43f4b1da0cae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:57:28.141835 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f5da19-5607-4e3b-85be-43f4b1da0cae None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:57:28.147259 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afe34a4-f7dd-4a5d-ae48-bd3900d4dcc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:57:28.147953 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afe34a4-f7dd-4a5d-ae48-bd3900d4dcc8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:57:28.148232 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afe34a4-f7dd-4a5d-ae48-bd3900d4dcc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:57:28.148536 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afe34a4-f7dd-4a5d-ae48-bd3900d4dcc8 admin admin] PATH_INFO: `/v3/projects/00953412b9de405cb20b22986be755bd` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:57:28.149664 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afe34a4-f7dd-4a5d-ae48-bd3900d4dcc8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=00953412b9de405cb20b22986be755bd)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:57:28.152017 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afe34a4-f7dd-4a5d-ae48-bd3900d4dcc8 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:57:28.153373 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:57:28.207275 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-5afe34a4-f7dd-4a5d-ae48-bd3900d4dcc8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '00953412b9de405cb20b22986be755bd', 'request_id': 'req-5afe34a4-f7dd-4a5d-ae48-bd3900d4dcc8'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:57:28.213750 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-5afe34a4-f7dd-4a5d-ae48-bd3900d4dcc8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '00953412b9de405cb20b22986be755bd', 'request_id': 'req-5afe34a4-f7dd-4a5d-ae48-bd3900d4dcc8'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:57:28.222124 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-5afe34a4-f7dd-4a5d-ae48-bd3900d4dcc8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '00953412b9de405cb20b22986be755bd', 'request_id': 'req-5afe34a4-f7dd-4a5d-ae48-bd3900d4dcc8'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:57:28.233161 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-5afe34a4-f7dd-4a5d-ae48-bd3900d4dcc8 admin admin] The token cache is being invalidate because project 00953412b9de405cb20b22986be755bd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81431) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 07:57:28.234045 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-5afe34a4-f7dd-4a5d-ae48-bd3900d4dcc8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:57:28.234890 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-5afe34a4-f7dd-4a5d-ae48-bd3900d4dcc8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:57:28.236398 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1249/2482] 10.222.0.57 () {58 vars in 1233 bytes} [Fri Sep 16 07:57:28 2022] DELETE /identity/v3/projects/00953412b9de405cb20b22986be755bd => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 07:57:28.241155 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3eaea0-e049-47fa-877f-951d3e19406d service neutron] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:57:28.251200 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3eaea0-e049-47fa-877f-951d3e19406d service neutron] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:57:28.309370 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3aa40d8-6314-4ff6-88e8-9415c1a342d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:57:28.310029 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3aa40d8-6314-4ff6-88e8-9415c1a342d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:57:28.310317 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3aa40d8-6314-4ff6-88e8-9415c1a342d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:57:28.310590 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3aa40d8-6314-4ff6-88e8-9415c1a342d6 admin admin] PATH_INFO: `/v3/users/5da2fc0269ba4402bb1809de45488223` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:57:28.311757 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3aa40d8-6314-4ff6-88e8-9415c1a342d6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5da2fc0269ba4402bb1809de45488223)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:57:28.313670 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3aa40d8-6314-4ff6-88e8-9415c1a342d6 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:57:28.363862 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-f3aa40d8-6314-4ff6-88e8-9415c1a342d6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5da2fc0269ba4402bb1809de45488223'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:57:28.364527 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-f3aa40d8-6314-4ff6-88e8-9415c1a342d6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5da2fc0269ba4402bb1809de45488223'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:57:28.372011 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-f3aa40d8-6314-4ff6-88e8-9415c1a342d6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5da2fc0269ba4402bb1809de45488223'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:57:28.379392 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:57:28.386732 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-f3aa40d8-6314-4ff6-88e8-9415c1a342d6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5da2fc0269ba4402bb1809de45488223'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:57:28.395685 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-f3aa40d8-6314-4ff6-88e8-9415c1a342d6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5da2fc0269ba4402bb1809de45488223'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:57:28.402598 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1234/2483] 10.222.0.57 () {58 vars in 1224 bytes} [Fri Sep 16 07:57:28 2022] DELETE /identity/v3/users/5da2fc0269ba4402bb1809de45488223 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 16 07:57:28.850841 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5381bb9-b049-4be0-90b7-9ecfd3b34f98 None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:57:28.851719 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5381bb9-b049-4be0-90b7-9ecfd3b34f98 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:57:28.851719 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5381bb9-b049-4be0-90b7-9ecfd3b34f98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:57:28.872769 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-a5381bb9-b049-4be0-90b7-9ecfd3b34f98 None None] MFA Rules not processed for user `56eb9bbabb65436bb095952159df184c`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:57:28.874528 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-a5381bb9-b049-4be0-90b7-9ecfd3b34f98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:57:28.940036 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1250/2484] 10.222.0.57 () {58 vars in 1009 bytes} [Fri Sep 16 07:57:28 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 07:57:28.952029 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3aa40d8-6314-4ff6-88e8-9415c1a342d6 admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:57:28.954519 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-f3aa40d8-6314-4ff6-88e8-9415c1a342d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:57:28.955717 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5381bb9-b049-4be0-90b7-9ecfd3b34f98 None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:57:28.957254 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-a5381bb9-b049-4be0-90b7-9ecfd3b34f98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:57:29.093678 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5381bb9-b049-4be0-90b7-9ecfd3b34f98 None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:57:29.099568 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc743c85-9fdc-4a5f-8e18-fe97e0676d23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:57:29.100214 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc743c85-9fdc-4a5f-8e18-fe97e0676d23 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:57:29.100494 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc743c85-9fdc-4a5f-8e18-fe97e0676d23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:57:29.100767 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc743c85-9fdc-4a5f-8e18-fe97e0676d23 admin admin] PATH_INFO: `/v3/projects/1e593458d15c4a80a186358d41f7025f` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:57:29.105141 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc743c85-9fdc-4a5f-8e18-fe97e0676d23 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1e593458d15c4a80a186358d41f7025f)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:57:29.105287 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3aa40d8-6314-4ff6-88e8-9415c1a342d6 admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:57:29.105389 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc743c85-9fdc-4a5f-8e18-fe97e0676d23 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:57:29.110012 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33035d4f-b267-48ad-b7c3-a04bb002273f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38abb0283b41449d8183b88912f2574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4735f453c0c24cc4a1c14e9ac84a0b46', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:57:29.110628 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33035d4f-b267-48ad-b7c3-a04bb002273f service swift] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:57:29.110985 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33035d4f-b267-48ad-b7c3-a04bb002273f service swift] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:57:29.111160 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33035d4f-b267-48ad-b7c3-a04bb002273f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:57:29.120990 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33035d4f-b267-48ad-b7c3-a04bb002273f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:57:29.122603 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33035d4f-b267-48ad-b7c3-a04bb002273f service swift] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:57:29.131492 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1235/2485] 10.222.0.57 () {60 vars in 1384 bytes} [Fri Sep 16 07:57:28 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 16 07:57:29.159231 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:57:29.170616 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-bc743c85-9fdc-4a5f-8e18-fe97e0676d23 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1e593458d15c4a80a186358d41f7025f', 'request_id': 'req-bc743c85-9fdc-4a5f-8e18-fe97e0676d23'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:57:29.180526 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-bc743c85-9fdc-4a5f-8e18-fe97e0676d23 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1e593458d15c4a80a186358d41f7025f', 'request_id': 'req-bc743c85-9fdc-4a5f-8e18-fe97e0676d23'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:57:29.200939 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-bc743c85-9fdc-4a5f-8e18-fe97e0676d23 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1e593458d15c4a80a186358d41f7025f', 'request_id': 'req-bc743c85-9fdc-4a5f-8e18-fe97e0676d23'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:57:29.230330 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-bc743c85-9fdc-4a5f-8e18-fe97e0676d23 admin admin] The token cache is being invalidate because project 1e593458d15c4a80a186358d41f7025f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81431) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 07:57:29.231869 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-bc743c85-9fdc-4a5f-8e18-fe97e0676d23 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:57:29.234583 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-bc743c85-9fdc-4a5f-8e18-fe97e0676d23 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:57:29.238047 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1251/2486] 10.222.0.57 () {58 vars in 1233 bytes} [Fri Sep 16 07:57:28 2022] DELETE /identity/v3/projects/1e593458d15c4a80a186358d41f7025f => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 07:57:29.245206 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278164a5-164e-40a2-bdc6-1dfa76ce8783 None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:57:29.245833 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278164a5-164e-40a2-bdc6-1dfa76ce8783 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:57:29.246068 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278164a5-164e-40a2-bdc6-1dfa76ce8783 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:57:29.303624 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-278164a5-164e-40a2-bdc6-1dfa76ce8783 None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:57:29.305978 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-278164a5-164e-40a2-bdc6-1dfa76ce8783 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:57:29.413942 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1236/2487] 10.222.0.57 () {58 vars in 958 bytes} [Fri Sep 16 07:57:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 07:57:29.423480 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6768b0-0315-4899-95d4-2e2097fd910a None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:57:29.423802 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6768b0-0315-4899-95d4-2e2097fd910a None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:57:29.424076 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6768b0-0315-4899-95d4-2e2097fd910a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:57:29.448723 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-fb6768b0-0315-4899-95d4-2e2097fd910a None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:57:29.450146 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-fb6768b0-0315-4899-95d4-2e2097fd910a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:57:29.459944 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1252/2488] 10.222.0.57 () {58 vars in 958 bytes} [Fri Sep 16 07:57:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 07:57:29.465535 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278164a5-164e-40a2-bdc6-1dfa76ce8783 None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:57:29.476509 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278164a5-164e-40a2-bdc6-1dfa76ce8783 None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:57:29.481854 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc9929e-152b-4ab2-8807-9cd858f8c98f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:57:29.482471 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc9929e-152b-4ab2-8807-9cd858f8c98f admin admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:57:29.482751 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc9929e-152b-4ab2-8807-9cd858f8c98f admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:57:29.483267 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc9929e-152b-4ab2-8807-9cd858f8c98f admin admin] PATH_INFO: `/v3/domains` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:57:29.486622 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc9929e-152b-4ab2-8807-9cd858f8c98f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:57:29.486622 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc9929e-152b-4ab2-8807-9cd858f8c98f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:57:29.486622 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc9929e-152b-4ab2-8807-9cd858f8c98f admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:57:29.501890 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1237/2489] 10.222.0.57 () {58 vars in 1153 bytes} [Fri Sep 16 07:57:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:57:29.506620 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6768b0-0315-4899-95d4-2e2097fd910a None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:57:29.518738 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6768b0-0315-4899-95d4-2e2097fd910a None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:57:29.523995 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1024a6ee-d627-4712-aee5-036990372804 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:57:29.524842 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1024a6ee-d627-4712-aee5-036990372804 admin admin] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:57:29.525212 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1024a6ee-d627-4712-aee5-036990372804 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:57:29.525573 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1024a6ee-d627-4712-aee5-036990372804 admin admin] PATH_INFO: `/v3/projects` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:57:29.526496 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1024a6ee-d627-4712-aee5-036990372804 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:57:29.528587 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1024a6ee-d627-4712-aee5-036990372804 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:57:29.570297 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1253/2490] 10.222.0.57 () {60 vars in 1153 bytes} [Fri Sep 16 07:57:29 2022] POST /identity/v3/projects => generated 387 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 07:57:29.574833 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc9929e-152b-4ab2-8807-9cd858f8c98f admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:57:29.596916 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc9929e-152b-4ab2-8807-9cd858f8c98f admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:57:29.682502 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:57:29.696115 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df7d10a-3d2d-4da2-a722-e4c575f0afef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:57:29.698634 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df7d10a-3d2d-4da2-a722-e4c575f0afef admin admin] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:57:29.699042 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df7d10a-3d2d-4da2-a722-e4c575f0afef admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:57:29.706203 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df7d10a-3d2d-4da2-a722-e4c575f0afef admin admin] PATH_INFO: `/v3/users` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:57:29.707039 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df7d10a-3d2d-4da2-a722-e4c575f0afef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:57:29.709309 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df7d10a-3d2d-4da2-a722-e4c575f0afef admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:57:29.751949 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1238/2491] 10.222.0.57 () {60 vars in 1144 bytes} [Fri Sep 16 07:57:29 2022] POST /identity/v3/users => generated 294 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 07:57:29.756175 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1024a6ee-d627-4712-aee5-036990372804 admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:57:29.767523 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1024a6ee-d627-4712-aee5-036990372804 admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:57:29.772972 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb352f7-3ce0-4110-991f-5493e58799e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:57:29.773827 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb352f7-3ce0-4110-991f-5493e58799e4 admin admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:57:29.774432 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb352f7-3ce0-4110-991f-5493e58799e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:57:29.774432 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb352f7-3ce0-4110-991f-5493e58799e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:57:29.775037 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb352f7-3ce0-4110-991f-5493e58799e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:57:29.776876 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb352f7-3ce0-4110-991f-5493e58799e4 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:57:29.803548 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1254/2492] 10.222.0.57 () {58 vars in 1122 bytes} [Fri Sep 16 07:57:29 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 07:57:29.807598 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df7d10a-3d2d-4da2-a722-e4c575f0afef admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:57:29.818658 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df7d10a-3d2d-4da2-a722-e4c575f0afef admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:57:29.825293 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351a4cdb-9862-4e11-a569-f0f68e224972 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:57:29.826028 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351a4cdb-9862-4e11-a569-f0f68e224972 admin admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:57:29.826380 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351a4cdb-9862-4e11-a569-f0f68e224972 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:57:29.826744 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351a4cdb-9862-4e11-a569-f0f68e224972 admin admin] PATH_INFO: `/v3/roles` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:57:29.827515 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351a4cdb-9862-4e11-a569-f0f68e224972 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:57:29.829258 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351a4cdb-9862-4e11-a569-f0f68e224972 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:57:29.843454 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1239/2493] 10.222.0.57 () {58 vars in 1122 bytes} [Fri Sep 16 07:57:29 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 07:57:29.849128 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb352f7-3ce0-4110-991f-5493e58799e4 admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:57:29.865448 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb352f7-3ce0-4110-991f-5493e58799e4 admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:57:29.870776 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de982a95-2b5f-4fba-b036-a7a044a02ddd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:57:29.871511 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de982a95-2b5f-4fba-b036-a7a044a02ddd admin admin] REQUEST_METHOD: `PUT` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:57:29.871719 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de982a95-2b5f-4fba-b036-a7a044a02ddd admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:57:29.872010 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de982a95-2b5f-4fba-b036-a7a044a02ddd admin admin] PATH_INFO: `/v3/projects/6819c60e01ca4d04ae7f732ef7116249/users/275cd7abcb07434594b0f3414cf8bffd/roles/4818d38cf2564825b312e66c9eb24762` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:57:29.888783 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de982a95-2b5f-4fba-b036-a7a044a02ddd admin admin] RBAC: Authorizing `identity:create_grant(project_id=6819c60e01ca4d04ae7f732ef7116249, user_id=275cd7abcb07434594b0f3414cf8bffd, role_id=4818d38cf2564825b312e66c9eb24762)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:57:29.892056 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de982a95-2b5f-4fba-b036-a7a044a02ddd admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:57:29.909656 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1255/2494] 10.222.0.57 () {60 vars in 1483 bytes} [Fri Sep 16 07:57:29 2022] PUT /identity/v3/projects/6819c60e01ca4d04ae7f732ef7116249/users/275cd7abcb07434594b0f3414cf8bffd/roles/4818d38cf2564825b312e66c9eb24762 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 07:57:29.920094 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67c46e3-9b52-49d0-810b-2f281520a9ac None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:57:29.920431 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67c46e3-9b52-49d0-810b-2f281520a9ac None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:57:29.920872 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67c46e3-9b52-49d0-810b-2f281520a9ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:57:29.953055 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-e67c46e3-9b52-49d0-810b-2f281520a9ac None None] MFA Rules not processed for user `275cd7abcb07434594b0f3414cf8bffd`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:57:29.954417 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-e67c46e3-9b52-49d0-810b-2f281520a9ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:57:30.050171 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de982a95-2b5f-4fba-b036-a7a044a02ddd admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:57:30.073932 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1240/2495] 10.222.0.57 () {58 vars in 958 bytes} [Fri Sep 16 07:57:29 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 07:57:30.172197 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de982a95-2b5f-4fba-b036-a7a044a02ddd admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:57:30.177234 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ea53e0-f9dc-4df0-bb14-6ae4875729d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:57:30.177988 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ea53e0-f9dc-4df0-bb14-6ae4875729d7 admin admin] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:57:30.178601 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ea53e0-f9dc-4df0-bb14-6ae4875729d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:57:30.178944 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ea53e0-f9dc-4df0-bb14-6ae4875729d7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:57:30.179660 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ea53e0-f9dc-4df0-bb14-6ae4875729d7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:57:30.181924 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ea53e0-f9dc-4df0-bb14-6ae4875729d7 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:57:30.227382 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1256/2496] 10.222.0.57 () {60 vars in 1153 bytes} [Fri Sep 16 07:57:30 2022] POST /identity/v3/projects => generated 387 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 07:57:30.228986 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67c46e3-9b52-49d0-810b-2f281520a9ac None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:57:30.243501 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67c46e3-9b52-49d0-810b-2f281520a9ac None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:57:30.314033 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fcd41e-461a-4f67-b9a8-1d73c32d516a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:57:30.314837 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fcd41e-461a-4f67-b9a8-1d73c32d516a admin admin] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:57:30.315298 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fcd41e-461a-4f67-b9a8-1d73c32d516a admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:57:30.318579 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fcd41e-461a-4f67-b9a8-1d73c32d516a admin admin] PATH_INFO: `/v3/users` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:57:30.319556 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85fcd41e-461a-4f67-b9a8-1d73c32d516a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:57:30.321839 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85fcd41e-461a-4f67-b9a8-1d73c32d516a admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:57:30.359227 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1241/2497] 10.222.0.57 () {60 vars in 1144 bytes} [Fri Sep 16 07:57:30 2022] POST /identity/v3/users => generated 300 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 07:57:30.360689 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ea53e0-f9dc-4df0-bb14-6ae4875729d7 admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:57:30.379378 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ea53e0-f9dc-4df0-bb14-6ae4875729d7 admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:57:30.386987 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd989366-e9a2-467d-b4c6-3e27537ff302 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:57:30.387947 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd989366-e9a2-467d-b4c6-3e27537ff302 admin admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:57:30.388414 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd989366-e9a2-467d-b4c6-3e27537ff302 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:57:30.388898 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd989366-e9a2-467d-b4c6-3e27537ff302 admin admin] PATH_INFO: `/v3/roles` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:57:30.389817 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd989366-e9a2-467d-b4c6-3e27537ff302 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:57:30.392264 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd989366-e9a2-467d-b4c6-3e27537ff302 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:57:30.415521 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1257/2498] 10.222.0.57 () {58 vars in 1122 bytes} [Fri Sep 16 07:57:30 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 16 07:57:30.419774 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fcd41e-461a-4f67-b9a8-1d73c32d516a admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:57:30.436071 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fcd41e-461a-4f67-b9a8-1d73c32d516a admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:57:30.453399 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831dd2d1-6195-41ea-b394-c09b5181c044 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:57:30.454124 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831dd2d1-6195-41ea-b394-c09b5181c044 admin admin] REQUEST_METHOD: `PUT` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:57:30.454405 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831dd2d1-6195-41ea-b394-c09b5181c044 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:57:30.454684 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831dd2d1-6195-41ea-b394-c09b5181c044 admin admin] PATH_INFO: `/v3/projects/898b7745aa284e33adba7063cd544b7b/users/932c0892f4914514a6991cf05cb5cbe1/roles/567db03c91854ad9af1e9a87ec1bd275` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:57:30.479105 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831dd2d1-6195-41ea-b394-c09b5181c044 admin admin] RBAC: Authorizing `identity:create_grant(project_id=898b7745aa284e33adba7063cd544b7b, user_id=932c0892f4914514a6991cf05cb5cbe1, role_id=567db03c91854ad9af1e9a87ec1bd275)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:57:30.483167 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831dd2d1-6195-41ea-b394-c09b5181c044 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:57:30.502055 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1242/2499] 10.222.0.57 () {60 vars in 1483 bytes} [Fri Sep 16 07:57:30 2022] PUT /identity/v3/projects/898b7745aa284e33adba7063cd544b7b/users/932c0892f4914514a6991cf05cb5cbe1/roles/567db03c91854ad9af1e9a87ec1bd275 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 07:57:30.506134 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd989366-e9a2-467d-b4c6-3e27537ff302 admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:57:30.517388 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd989366-e9a2-467d-b4c6-3e27537ff302 admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:57:30.560881 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:57:30.613012 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad5f3f2-5374-4f1d-bd4a-29647df006ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:57:30.613012 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad5f3f2-5374-4f1d-bd4a-29647df006ed admin admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:57:30.613012 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad5f3f2-5374-4f1d-bd4a-29647df006ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:57:30.613012 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad5f3f2-5374-4f1d-bd4a-29647df006ed admin admin] PATH_INFO: `/v3/roles` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:57:30.613404 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad5f3f2-5374-4f1d-bd4a-29647df006ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:57:30.613404 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad5f3f2-5374-4f1d-bd4a-29647df006ed admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:57:30.625275 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1258/2500] 10.222.0.57 () {58 vars in 1122 bytes} [Fri Sep 16 07:57:30 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 07:57:30.629706 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831dd2d1-6195-41ea-b394-c09b5181c044 admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:57:30.641117 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831dd2d1-6195-41ea-b394-c09b5181c044 admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:57:30.656578 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d333790-b795-4317-81d7-25000bddb85c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:57:30.657454 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d333790-b795-4317-81d7-25000bddb85c admin admin] REQUEST_METHOD: `PUT` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:57:30.657771 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d333790-b795-4317-81d7-25000bddb85c admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:57:30.658425 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d333790-b795-4317-81d7-25000bddb85c admin admin] PATH_INFO: `/v3/projects/898b7745aa284e33adba7063cd544b7b/users/932c0892f4914514a6991cf05cb5cbe1/roles/567db03c91854ad9af1e9a87ec1bd275` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:57:30.661133 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d333790-b795-4317-81d7-25000bddb85c admin admin] RBAC: Authorizing `identity:create_grant(project_id=898b7745aa284e33adba7063cd544b7b, user_id=932c0892f4914514a6991cf05cb5cbe1, role_id=567db03c91854ad9af1e9a87ec1bd275)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:57:30.664843 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d333790-b795-4317-81d7-25000bddb85c admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:57:30.684444 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1243/2501] 10.222.0.57 () {60 vars in 1483 bytes} [Fri Sep 16 07:57:30 2022] PUT /identity/v3/projects/898b7745aa284e33adba7063cd544b7b/users/932c0892f4914514a6991cf05cb5cbe1/roles/567db03c91854ad9af1e9a87ec1bd275 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 16 07:57:30.696744 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945ba105-37a2-41c3-b360-12ed8c5a1ee8 None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:57:30.697029 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945ba105-37a2-41c3-b360-12ed8c5a1ee8 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:57:30.697417 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945ba105-37a2-41c3-b360-12ed8c5a1ee8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:57:30.735703 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-945ba105-37a2-41c3-b360-12ed8c5a1ee8 None None] MFA Rules not processed for user `932c0892f4914514a6991cf05cb5cbe1`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:57:30.737168 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-945ba105-37a2-41c3-b360-12ed8c5a1ee8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:57:30.761495 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d333790-b795-4317-81d7-25000bddb85c admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:57:30.763329 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-0d333790-b795-4317-81d7-25000bddb85c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:57:30.814892 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:57:30.842120 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1259/2502] 10.222.0.57 () {58 vars in 958 bytes} [Fri Sep 16 07:57:30 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 07:57:30.854429 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945ba105-37a2-41c3-b360-12ed8c5a1ee8 None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:57:30.859194 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-945ba105-37a2-41c3-b360-12ed8c5a1ee8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:57:30.899286 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d333790-b795-4317-81d7-25000bddb85c admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:57:30.906346 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8007b12e-f3ae-45cd-8695-288cfa51a525 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:57:30.907155 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8007b12e-f3ae-45cd-8695-288cfa51a525 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:57:30.907516 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8007b12e-f3ae-45cd-8695-288cfa51a525 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:57:30.907981 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8007b12e-f3ae-45cd-8695-288cfa51a525 admin admin] PATH_INFO: `/v3/users/d5cbb4df2923409582c7f0c9d0d1af63` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:57:30.910529 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8007b12e-f3ae-45cd-8695-288cfa51a525 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d5cbb4df2923409582c7f0c9d0d1af63)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:57:30.912445 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8007b12e-f3ae-45cd-8695-288cfa51a525 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:57:30.936193 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945ba105-37a2-41c3-b360-12ed8c5a1ee8 None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:57:30.941359 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b6a0db-7a51-4cfa-be75-80cf12a6f29d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544bf6be4c24454a013ca110c43cef2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4735f453c0c24cc4a1c14e9ac84a0b46', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:57:30.942083 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b6a0db-7a51-4cfa-be75-80cf12a6f29d service cinder] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:57:30.942375 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b6a0db-7a51-4cfa-be75-80cf12a6f29d service cinder] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:57:30.942655 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b6a0db-7a51-4cfa-be75-80cf12a6f29d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:57:30.956279 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b6a0db-7a51-4cfa-be75-80cf12a6f29d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:57:30.958032 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b6a0db-7a51-4cfa-be75-80cf12a6f29d service cinder] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:57:30.971801 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1260/2503] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Sep 16 07:57:30 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 16 07:57:30.987422 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-8007b12e-f3ae-45cd-8695-288cfa51a525 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd5cbb4df2923409582c7f0c9d0d1af63'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:57:30.988502 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-8007b12e-f3ae-45cd-8695-288cfa51a525 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd5cbb4df2923409582c7f0c9d0d1af63'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:57:31.035642 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-8007b12e-f3ae-45cd-8695-288cfa51a525 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd5cbb4df2923409582c7f0c9d0d1af63'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:57:31.069980 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-8007b12e-f3ae-45cd-8695-288cfa51a525 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd5cbb4df2923409582c7f0c9d0d1af63'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:57:31.095582 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-8007b12e-f3ae-45cd-8695-288cfa51a525 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd5cbb4df2923409582c7f0c9d0d1af63'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:57:31.118949 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1244/2504] 10.222.0.57 () {58 vars in 1224 bytes} [Fri Sep 16 07:57:30 2022] DELETE /identity/v3/users/d5cbb4df2923409582c7f0c9d0d1af63 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 16 07:57:31.123558 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99741af4-d3d3-46dc-9824-b8b89e40da45 None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:57:31.124692 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99741af4-d3d3-46dc-9824-b8b89e40da45 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:57:31.125202 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99741af4-d3d3-46dc-9824-b8b89e40da45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:57:31.162137 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-99741af4-d3d3-46dc-9824-b8b89e40da45 None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:57:31.170846 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-99741af4-d3d3-46dc-9824-b8b89e40da45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:57:31.291273 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:57:31.311782 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1261/2505] 10.222.0.57 () {58 vars in 958 bytes} [Fri Sep 16 07:57:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 16 07:57:31.319676 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8007b12e-f3ae-45cd-8695-288cfa51a525 admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:57:31.322384 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-8007b12e-f3ae-45cd-8695-288cfa51a525 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:57:31.456929 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8007b12e-f3ae-45cd-8695-288cfa51a525 admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:57:31.464244 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ed39f8-19f4-43c5-8294-1207278350c5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1062e457207a41e4ba4f0a0c4bf36f1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4735f453c0c24cc4a1c14e9ac84a0b46', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:57:31.465393 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ed39f8-19f4-43c5-8294-1207278350c5 service neutron] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:57:31.466130 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ed39f8-19f4-43c5-8294-1207278350c5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:57:31.466582 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ed39f8-19f4-43c5-8294-1207278350c5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:57:31.486365 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ed39f8-19f4-43c5-8294-1207278350c5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:57:31.489104 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ed39f8-19f4-43c5-8294-1207278350c5 service neutron] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:57:31.505126 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1245/2506] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Sep 16 07:57:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 07:57:32.022625 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99741af4-d3d3-46dc-9824-b8b89e40da45 None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:57:32.024135 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-99741af4-d3d3-46dc-9824-b8b89e40da45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:57:32.037595 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99741af4-d3d3-46dc-9824-b8b89e40da45 None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:57:32.043138 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a454e385-2d45-4943-8bc2-9792d148d5e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:57:32.043915 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a454e385-2d45-4943-8bc2-9792d148d5e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:57:32.044366 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a454e385-2d45-4943-8bc2-9792d148d5e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:57:32.044705 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a454e385-2d45-4943-8bc2-9792d148d5e7 admin admin] PATH_INFO: `/v3/users/275cd7abcb07434594b0f3414cf8bffd` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:57:32.046919 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a454e385-2d45-4943-8bc2-9792d148d5e7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=275cd7abcb07434594b0f3414cf8bffd)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:57:32.049083 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a454e385-2d45-4943-8bc2-9792d148d5e7 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:57:32.142990 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-a454e385-2d45-4943-8bc2-9792d148d5e7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '275cd7abcb07434594b0f3414cf8bffd'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:57:32.178461 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-a454e385-2d45-4943-8bc2-9792d148d5e7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '275cd7abcb07434594b0f3414cf8bffd'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:57:32.179310 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-a454e385-2d45-4943-8bc2-9792d148d5e7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '275cd7abcb07434594b0f3414cf8bffd'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:57:32.190603 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-a454e385-2d45-4943-8bc2-9792d148d5e7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '275cd7abcb07434594b0f3414cf8bffd'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:57:32.198897 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-a454e385-2d45-4943-8bc2-9792d148d5e7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '275cd7abcb07434594b0f3414cf8bffd'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:57:32.206390 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1262/2507] 10.222.0.57 () {58 vars in 1224 bytes} [Fri Sep 16 07:57:32 2022] DELETE /identity/v3/users/275cd7abcb07434594b0f3414cf8bffd => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 07:57:32.211637 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087ead2d-bd09-4ad5-ab6c-c8b4ebddbe02 None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:57:32.212271 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087ead2d-bd09-4ad5-ab6c-c8b4ebddbe02 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:57:32.212789 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087ead2d-bd09-4ad5-ab6c-c8b4ebddbe02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:57:32.252464 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a454e385-2d45-4943-8bc2-9792d148d5e7 admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:57:32.254899 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-a454e385-2d45-4943-8bc2-9792d148d5e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:57:32.255381 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-087ead2d-bd09-4ad5-ab6c-c8b4ebddbe02 None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:57:32.257012 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-087ead2d-bd09-4ad5-ab6c-c8b4ebddbe02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:57:32.341331 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:57:32.372367 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a454e385-2d45-4943-8bc2-9792d148d5e7 admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:57:32.379365 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15b77ca-7f7e-4304-9e65-f7117f3414e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:57:32.380261 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15b77ca-7f7e-4304-9e65-f7117f3414e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:57:32.380698 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15b77ca-7f7e-4304-9e65-f7117f3414e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:57:32.381133 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15b77ca-7f7e-4304-9e65-f7117f3414e6 admin admin] PATH_INFO: `/v3/projects/af8badf8d541456185ecb86631f650f7` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:57:32.382497 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15b77ca-7f7e-4304-9e65-f7117f3414e6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=af8badf8d541456185ecb86631f650f7)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:57:32.384825 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15b77ca-7f7e-4304-9e65-f7117f3414e6 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:57:32.387759 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1246/2508] 10.222.0.57 () {58 vars in 958 bytes} [Fri Sep 16 07:57:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 07:57:32.397384 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087ead2d-bd09-4ad5-ab6c-c8b4ebddbe02 None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:57:32.400078 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-087ead2d-bd09-4ad5-ab6c-c8b4ebddbe02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:57:32.480532 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-f15b77ca-7f7e-4304-9e65-f7117f3414e6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'af8badf8d541456185ecb86631f650f7', 'request_id': 'req-f15b77ca-7f7e-4304-9e65-f7117f3414e6'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:57:32.489643 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-f15b77ca-7f7e-4304-9e65-f7117f3414e6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'af8badf8d541456185ecb86631f650f7', 'request_id': 'req-f15b77ca-7f7e-4304-9e65-f7117f3414e6'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:57:32.506378 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-f15b77ca-7f7e-4304-9e65-f7117f3414e6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'af8badf8d541456185ecb86631f650f7', 'request_id': 'req-f15b77ca-7f7e-4304-9e65-f7117f3414e6'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:57:32.535446 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-f15b77ca-7f7e-4304-9e65-f7117f3414e6 admin admin] The token cache is being invalidate because project af8badf8d541456185ecb86631f650f7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81431) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 07:57:32.535798 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-f15b77ca-7f7e-4304-9e65-f7117f3414e6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:57:32.536523 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-f15b77ca-7f7e-4304-9e65-f7117f3414e6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:57:32.538561 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1263/2509] 10.222.0.57 () {58 vars in 1233 bytes} [Fri Sep 16 07:57:32 2022] DELETE /identity/v3/projects/af8badf8d541456185ecb86631f650f7 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 07:57:32.547313 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2787093-ecfa-46ae-a522-f245408ec595 None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:57:32.547751 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2787093-ecfa-46ae-a522-f245408ec595 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:57:32.548158 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2787093-ecfa-46ae-a522-f245408ec595 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:57:32.556248 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087ead2d-bd09-4ad5-ab6c-c8b4ebddbe02 None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:57:32.556895 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:57:32.581396 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-a2787093-ecfa-46ae-a522-f245408ec595 None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:57:32.582805 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-a2787093-ecfa-46ae-a522-f245408ec595 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:57:32.644880 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95049eb6-095e-4be8-9122-6773854faaff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1062e457207a41e4ba4f0a0c4bf36f1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4735f453c0c24cc4a1c14e9ac84a0b46', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:57:32.645598 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95049eb6-095e-4be8-9122-6773854faaff service neutron] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:57:32.649877 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95049eb6-095e-4be8-9122-6773854faaff service neutron] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:57:32.650506 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95049eb6-095e-4be8-9122-6773854faaff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:57:32.652814 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-95049eb6-095e-4be8-9122-6773854faaff service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:57:32.656284 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1264/2510] 10.222.0.57 () {58 vars in 958 bytes} [Fri Sep 16 07:57:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 07:57:32.664066 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3c80e0-8426-4bcf-b30f-fe53490d5acf None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:57:32.664424 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3c80e0-8426-4bcf-b30f-fe53490d5acf None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:57:32.664790 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3c80e0-8426-4bcf-b30f-fe53490d5acf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:57:32.671943 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95049eb6-095e-4be8-9122-6773854faaff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:57:32.673907 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95049eb6-095e-4be8-9122-6773854faaff service neutron] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:57:32.689773 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1247/2511] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Sep 16 07:57:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 16 07:57:32.690639 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-1f3c80e0-8426-4bcf-b30f-fe53490d5acf None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:57:32.692048 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-1f3c80e0-8426-4bcf-b30f-fe53490d5acf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:57:32.708204 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1265/2512] 10.222.0.57 () {58 vars in 958 bytes} [Fri Sep 16 07:57:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 16 07:57:32.712486 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95049eb6-095e-4be8-9122-6773854faaff service neutron] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:57:32.729535 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95049eb6-095e-4be8-9122-6773854faaff service neutron] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:57:32.735799 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a92c74-8294-4fae-b6cf-e39cacdb9c8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:57:32.736524 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a92c74-8294-4fae-b6cf-e39cacdb9c8c admin admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:57:32.736877 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a92c74-8294-4fae-b6cf-e39cacdb9c8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:57:32.737219 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a92c74-8294-4fae-b6cf-e39cacdb9c8c admin admin] PATH_INFO: `/v3/domains` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:57:32.737978 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a92c74-8294-4fae-b6cf-e39cacdb9c8c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:57:32.738358 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a92c74-8294-4fae-b6cf-e39cacdb9c8c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:57:32.740338 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a92c74-8294-4fae-b6cf-e39cacdb9c8c admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:57:32.757648 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1248/2513] 10.222.0.57 () {58 vars in 1153 bytes} [Fri Sep 16 07:57:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:57:32.760781 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3c80e0-8426-4bcf-b30f-fe53490d5acf None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:57:32.771004 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3c80e0-8426-4bcf-b30f-fe53490d5acf None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:57:32.777535 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c65100c-c958-4c72-96f0-74fa409451c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:57:32.778754 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c65100c-c958-4c72-96f0-74fa409451c6 admin admin] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:57:32.779298 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c65100c-c958-4c72-96f0-74fa409451c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:57:32.779870 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c65100c-c958-4c72-96f0-74fa409451c6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:57:32.781062 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c65100c-c958-4c72-96f0-74fa409451c6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:57:32.783685 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c65100c-c958-4c72-96f0-74fa409451c6 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:57:32.830035 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1266/2514] 10.222.0.57 () {60 vars in 1153 bytes} [Fri Sep 16 07:57:32 2022] POST /identity/v3/projects => generated 373 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 07:57:32.830271 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a92c74-8294-4fae-b6cf-e39cacdb9c8c admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:57:32.848212 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a92c74-8294-4fae-b6cf-e39cacdb9c8c admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:57:32.958000 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb722f4e-aa57-465b-b6dc-68f8336cce3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:57:32.958623 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb722f4e-aa57-465b-b6dc-68f8336cce3f admin admin] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:57:32.958901 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb722f4e-aa57-465b-b6dc-68f8336cce3f admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:57:32.959168 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb722f4e-aa57-465b-b6dc-68f8336cce3f admin admin] PATH_INFO: `/v3/users` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:57:32.959791 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb722f4e-aa57-465b-b6dc-68f8336cce3f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:57:32.962406 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb722f4e-aa57-465b-b6dc-68f8336cce3f admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:57:32.997166 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1249/2515] 10.222.0.57 () {60 vars in 1144 bytes} [Fri Sep 16 07:57:32 2022] POST /identity/v3/users => generated 287 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 07:57:32.998633 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c65100c-c958-4c72-96f0-74fa409451c6 admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:57:33.011305 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c65100c-c958-4c72-96f0-74fa409451c6 admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:57:33.019211 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad71210-8c93-41cd-aa77-512879a52c4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:57:33.019911 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad71210-8c93-41cd-aa77-512879a52c4a admin admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:57:33.020187 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad71210-8c93-41cd-aa77-512879a52c4a admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:57:33.020456 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad71210-8c93-41cd-aa77-512879a52c4a admin admin] PATH_INFO: `/v3/roles` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:57:33.021123 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad71210-8c93-41cd-aa77-512879a52c4a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:57:33.022948 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad71210-8c93-41cd-aa77-512879a52c4a admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:57:33.038426 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1267/2516] 10.222.0.57 () {58 vars in 1122 bytes} [Fri Sep 16 07:57:32 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 07:57:33.039453 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb722f4e-aa57-465b-b6dc-68f8336cce3f admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:57:33.051164 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb722f4e-aa57-465b-b6dc-68f8336cce3f admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:57:33.057671 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b0841d-3bac-41fe-b1db-f2563bc1e8f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:57:33.059696 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b0841d-3bac-41fe-b1db-f2563bc1e8f5 admin admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:57:33.060272 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b0841d-3bac-41fe-b1db-f2563bc1e8f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:57:33.060827 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b0841d-3bac-41fe-b1db-f2563bc1e8f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:57:33.062534 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b0841d-3bac-41fe-b1db-f2563bc1e8f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:57:33.066695 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b0841d-3bac-41fe-b1db-f2563bc1e8f5 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:57:33.091670 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1250/2517] 10.222.0.57 () {58 vars in 1122 bytes} [Fri Sep 16 07:57:33 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 07:57:33.095655 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad71210-8c93-41cd-aa77-512879a52c4a admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:57:33.121555 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad71210-8c93-41cd-aa77-512879a52c4a admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:57:33.135034 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926681d3-012b-4d1a-a031-94f2203e484f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:57:33.135827 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926681d3-012b-4d1a-a031-94f2203e484f admin admin] REQUEST_METHOD: `PUT` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:57:33.136109 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926681d3-012b-4d1a-a031-94f2203e484f admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:57:33.136419 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926681d3-012b-4d1a-a031-94f2203e484f admin admin] PATH_INFO: `/v3/projects/c71b9d9cf8ef428297a0212201e7e6d9/users/fe7d50c001dc441c841357d3e9e6294b/roles/4818d38cf2564825b312e66c9eb24762` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:57:33.144921 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b0841d-3bac-41fe-b1db-f2563bc1e8f5 admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:57:33.147254 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-52b0841d-3bac-41fe-b1db-f2563bc1e8f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:57:33.166790 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:57:33.173387 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b0841d-3bac-41fe-b1db-f2563bc1e8f5 admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:57:33.177837 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926681d3-012b-4d1a-a031-94f2203e484f admin admin] RBAC: Authorizing `identity:create_grant(project_id=c71b9d9cf8ef428297a0212201e7e6d9, user_id=fe7d50c001dc441c841357d3e9e6294b, role_id=4818d38cf2564825b312e66c9eb24762)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:57:33.184268 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a556fb-7eca-483a-b5a3-d949532d9abf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:57:33.185119 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a556fb-7eca-483a-b5a3-d949532d9abf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:57:33.185570 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a556fb-7eca-483a-b5a3-d949532d9abf admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:57:33.185967 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a556fb-7eca-483a-b5a3-d949532d9abf admin admin] PATH_INFO: `/v3/projects/6819c60e01ca4d04ae7f732ef7116249` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:57:33.190134 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a556fb-7eca-483a-b5a3-d949532d9abf admin admin] RBAC: Authorizing `identity:delete_project(project_id=6819c60e01ca4d04ae7f732ef7116249)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:57:33.192736 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a556fb-7eca-483a-b5a3-d949532d9abf admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:57:33.193471 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926681d3-012b-4d1a-a031-94f2203e484f admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:57:33.225241 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1268/2518] 10.222.0.57 () {60 vars in 1483 bytes} [Fri Sep 16 07:57:33 2022] PUT /identity/v3/projects/c71b9d9cf8ef428297a0212201e7e6d9/users/fe7d50c001dc441c841357d3e9e6294b/roles/4818d38cf2564825b312e66c9eb24762 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 07:57:33.236359 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e92c6f7-0ff5-4950-b605-874dca3fa2f0 None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:57:33.236655 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e92c6f7-0ff5-4950-b605-874dca3fa2f0 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:57:33.236924 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e92c6f7-0ff5-4950-b605-874dca3fa2f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:57:33.309860 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-0e92c6f7-0ff5-4950-b605-874dca3fa2f0 None None] MFA Rules not processed for user `fe7d50c001dc441c841357d3e9e6294b`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:57:33.310111 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-f4a556fb-7eca-483a-b5a3-d949532d9abf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6819c60e01ca4d04ae7f732ef7116249', 'request_id': 'req-f4a556fb-7eca-483a-b5a3-d949532d9abf'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:57:33.314537 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-0e92c6f7-0ff5-4950-b605-874dca3fa2f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:57:33.325400 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-f4a556fb-7eca-483a-b5a3-d949532d9abf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6819c60e01ca4d04ae7f732ef7116249', 'request_id': 'req-f4a556fb-7eca-483a-b5a3-d949532d9abf'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:57:33.335670 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-f4a556fb-7eca-483a-b5a3-d949532d9abf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6819c60e01ca4d04ae7f732ef7116249', 'request_id': 'req-f4a556fb-7eca-483a-b5a3-d949532d9abf'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:57:33.364894 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-f4a556fb-7eca-483a-b5a3-d949532d9abf admin admin] The token cache is being invalidate because project 6819c60e01ca4d04ae7f732ef7116249 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81430) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 07:57:33.365872 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-f4a556fb-7eca-483a-b5a3-d949532d9abf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:57:33.366950 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-f4a556fb-7eca-483a-b5a3-d949532d9abf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:57:33.370948 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1251/2519] 10.222.0.57 () {58 vars in 1233 bytes} [Fri Sep 16 07:57:33 2022] DELETE /identity/v3/projects/6819c60e01ca4d04ae7f732ef7116249 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 07:57:33.375605 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a556fb-7eca-483a-b5a3-d949532d9abf admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:57:33.377851 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-f4a556fb-7eca-483a-b5a3-d949532d9abf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:57:33.490180 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1269/2520] 10.222.0.57 () {58 vars in 958 bytes} [Fri Sep 16 07:57:33 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 16 07:57:33.506690 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e92c6f7-0ff5-4950-b605-874dca3fa2f0 None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:57:33.508900 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-0e92c6f7-0ff5-4950-b605-874dca3fa2f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:57:33.570918 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a556fb-7eca-483a-b5a3-d949532d9abf admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:57:33.592489 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b153b880-6e4e-4303-93e5-77a76b02a86a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:57:33.593851 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b153b880-6e4e-4303-93e5-77a76b02a86a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:57:33.594230 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b153b880-6e4e-4303-93e5-77a76b02a86a admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:57:33.594397 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b153b880-6e4e-4303-93e5-77a76b02a86a admin admin] PATH_INFO: `/v3/users/932c0892f4914514a6991cf05cb5cbe1` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:57:33.596731 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b153b880-6e4e-4303-93e5-77a76b02a86a admin admin] RBAC: Authorizing `identity:delete_user(user_id=932c0892f4914514a6991cf05cb5cbe1)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:57:33.598770 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b153b880-6e4e-4303-93e5-77a76b02a86a admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:57:33.612061 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:57:33.670383 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e92c6f7-0ff5-4950-b605-874dca3fa2f0 None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:57:33.686986 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bb3644-acee-40e7-b735-779cd8fcd642 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544bf6be4c24454a013ca110c43cef2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4735f453c0c24cc4a1c14e9ac84a0b46', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:57:33.688014 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bb3644-acee-40e7-b735-779cd8fcd642 service cinder] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:57:33.688356 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bb3644-acee-40e7-b735-779cd8fcd642 service cinder] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:57:33.688706 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bb3644-acee-40e7-b735-779cd8fcd642 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:57:33.699564 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-b153b880-6e4e-4303-93e5-77a76b02a86a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '932c0892f4914514a6991cf05cb5cbe1'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:57:33.700829 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-b153b880-6e4e-4303-93e5-77a76b02a86a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '932c0892f4914514a6991cf05cb5cbe1'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:57:33.708061 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01bb3644-acee-40e7-b735-779cd8fcd642 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:57:33.709713 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01bb3644-acee-40e7-b735-779cd8fcd642 service cinder] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:57:33.720967 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-b153b880-6e4e-4303-93e5-77a76b02a86a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '932c0892f4914514a6991cf05cb5cbe1'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:57:33.741745 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1270/2521] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Sep 16 07:57:33 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 07:57:33.757927 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-b153b880-6e4e-4303-93e5-77a76b02a86a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '932c0892f4914514a6991cf05cb5cbe1'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:57:33.766586 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-b153b880-6e4e-4303-93e5-77a76b02a86a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '932c0892f4914514a6991cf05cb5cbe1'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:57:33.773989 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1252/2522] 10.222.0.57 () {58 vars in 1224 bytes} [Fri Sep 16 07:57:33 2022] DELETE /identity/v3/users/932c0892f4914514a6991cf05cb5cbe1 => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 07:57:34.244223 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bb3644-acee-40e7-b735-779cd8fcd642 service cinder] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:57:34.258882 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bb3644-acee-40e7-b735-779cd8fcd642 service cinder] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:57:34.382273 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7491641c-e793-46b1-b8dc-6086b9b1a2fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:57:34.382909 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7491641c-e793-46b1-b8dc-6086b9b1a2fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:57:34.383209 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7491641c-e793-46b1-b8dc-6086b9b1a2fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:57:34.383445 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7491641c-e793-46b1-b8dc-6086b9b1a2fe admin admin] PATH_INFO: `/v3/projects/898b7745aa284e33adba7063cd544b7b` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:57:34.384640 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7491641c-e793-46b1-b8dc-6086b9b1a2fe admin admin] RBAC: Authorizing `identity:delete_project(project_id=898b7745aa284e33adba7063cd544b7b)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:57:34.387598 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7491641c-e793-46b1-b8dc-6086b9b1a2fe admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:57:34.459160 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-7491641c-e793-46b1-b8dc-6086b9b1a2fe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '898b7745aa284e33adba7063cd544b7b', 'request_id': 'req-7491641c-e793-46b1-b8dc-6086b9b1a2fe'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:57:34.476603 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-7491641c-e793-46b1-b8dc-6086b9b1a2fe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '898b7745aa284e33adba7063cd544b7b', 'request_id': 'req-7491641c-e793-46b1-b8dc-6086b9b1a2fe'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:57:34.516647 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-7491641c-e793-46b1-b8dc-6086b9b1a2fe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '898b7745aa284e33adba7063cd544b7b', 'request_id': 'req-7491641c-e793-46b1-b8dc-6086b9b1a2fe'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:57:34.531445 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-7491641c-e793-46b1-b8dc-6086b9b1a2fe admin admin] The token cache is being invalidate because project 898b7745aa284e33adba7063cd544b7b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81431) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 07:57:34.531742 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-7491641c-e793-46b1-b8dc-6086b9b1a2fe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:57:34.532500 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-7491641c-e793-46b1-b8dc-6086b9b1a2fe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:57:34.534293 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1271/2523] 10.222.0.57 () {58 vars in 1233 bytes} [Fri Sep 16 07:57:34 2022] DELETE /identity/v3/projects/898b7745aa284e33adba7063cd544b7b => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 07:57:34.540080 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2776ecbf-944e-464a-95da-e64c2968f43d None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:57:34.540642 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2776ecbf-944e-464a-95da-e64c2968f43d None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:57:34.540749 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2776ecbf-944e-464a-95da-e64c2968f43d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:57:34.558117 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:57:34.578847 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-2776ecbf-944e-464a-95da-e64c2968f43d None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:57:34.580554 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-2776ecbf-944e-464a-95da-e64c2968f43d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:57:34.735097 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cbaa5e-3785-42c0-b81e-f838487dd749 None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:57:34.735938 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cbaa5e-3785-42c0-b81e-f838487dd749 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:57:34.736425 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cbaa5e-3785-42c0-b81e-f838487dd749 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:57:34.744402 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1253/2524] 10.222.0.57 () {58 vars in 958 bytes} [Fri Sep 16 07:57:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 16 07:57:34.795210 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-38cbaa5e-3785-42c0-b81e-f838487dd749 None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:57:34.796406 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-38cbaa5e-3785-42c0-b81e-f838487dd749 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:57:34.816990 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1272/2525] 10.222.0.57 () {58 vars in 958 bytes} [Fri Sep 16 07:57:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 16 07:57:34.821350 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2776ecbf-944e-464a-95da-e64c2968f43d None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:57:34.834042 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2776ecbf-944e-464a-95da-e64c2968f43d None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:57:34.839760 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84aae542-17cf-4d96-8bfd-d76d5dfed53b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:57:34.840900 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84aae542-17cf-4d96-8bfd-d76d5dfed53b admin admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:57:34.841182 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84aae542-17cf-4d96-8bfd-d76d5dfed53b admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:57:34.841586 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84aae542-17cf-4d96-8bfd-d76d5dfed53b admin admin] PATH_INFO: `/v3/domains` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:57:34.842585 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84aae542-17cf-4d96-8bfd-d76d5dfed53b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:57:34.843549 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84aae542-17cf-4d96-8bfd-d76d5dfed53b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:57:34.845918 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84aae542-17cf-4d96-8bfd-d76d5dfed53b admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:57:34.872049 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1254/2526] 10.222.0.57 () {58 vars in 1153 bytes} [Fri Sep 16 07:57:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:57:34.873215 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cbaa5e-3785-42c0-b81e-f838487dd749 None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:57:34.888245 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cbaa5e-3785-42c0-b81e-f838487dd749 None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:57:34.895816 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ece5795-bcb8-4e66-832a-9bd66004b58c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:57:34.896416 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ece5795-bcb8-4e66-832a-9bd66004b58c admin admin] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:57:34.896690 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ece5795-bcb8-4e66-832a-9bd66004b58c admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:57:34.896959 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ece5795-bcb8-4e66-832a-9bd66004b58c admin admin] PATH_INFO: `/v3/projects` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:57:34.897588 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ece5795-bcb8-4e66-832a-9bd66004b58c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:57:34.899695 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ece5795-bcb8-4e66-832a-9bd66004b58c admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:57:34.941051 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1273/2527] 10.222.0.57 () {60 vars in 1153 bytes} [Fri Sep 16 07:57:34 2022] POST /identity/v3/projects => generated 373 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 07:57:34.945445 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84aae542-17cf-4d96-8bfd-d76d5dfed53b admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:57:34.962565 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84aae542-17cf-4d96-8bfd-d76d5dfed53b admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:57:35.056930 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40670023-f7ea-4e78-afd4-e10adf23df03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:57:35.057701 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40670023-f7ea-4e78-afd4-e10adf23df03 admin admin] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:57:35.058106 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40670023-f7ea-4e78-afd4-e10adf23df03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:57:35.058445 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40670023-f7ea-4e78-afd4-e10adf23df03 admin admin] PATH_INFO: `/v3/users` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:57:35.059159 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40670023-f7ea-4e78-afd4-e10adf23df03 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:57:35.061250 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40670023-f7ea-4e78-afd4-e10adf23df03 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:57:35.088283 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1255/2528] 10.222.0.57 () {60 vars in 1144 bytes} [Fri Sep 16 07:57:34 2022] POST /identity/v3/users => generated 287 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 07:57:35.089198 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ece5795-bcb8-4e66-832a-9bd66004b58c admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:57:35.101437 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ece5795-bcb8-4e66-832a-9bd66004b58c admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:57:35.106290 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986a5937-9bba-4e2c-805d-4d4b34fe13a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:57:35.106978 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986a5937-9bba-4e2c-805d-4d4b34fe13a2 admin admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:57:35.107442 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986a5937-9bba-4e2c-805d-4d4b34fe13a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:57:35.107726 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986a5937-9bba-4e2c-805d-4d4b34fe13a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:57:35.109040 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986a5937-9bba-4e2c-805d-4d4b34fe13a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:57:35.110969 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986a5937-9bba-4e2c-805d-4d4b34fe13a2 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:57:35.125179 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1274/2529] 10.222.0.57 () {58 vars in 1122 bytes} [Fri Sep 16 07:57:35 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 16 07:57:35.126961 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40670023-f7ea-4e78-afd4-e10adf23df03 admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:57:35.137266 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40670023-f7ea-4e78-afd4-e10adf23df03 admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:57:35.142233 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cdce22-a0d3-485a-aa7c-29ef36375565 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:57:35.142960 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cdce22-a0d3-485a-aa7c-29ef36375565 admin admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:57:35.143246 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cdce22-a0d3-485a-aa7c-29ef36375565 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:57:35.143519 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cdce22-a0d3-485a-aa7c-29ef36375565 admin admin] PATH_INFO: `/v3/roles` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:57:35.144161 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5cdce22-a0d3-485a-aa7c-29ef36375565 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:57:35.145935 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5cdce22-a0d3-485a-aa7c-29ef36375565 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:57:35.158525 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1256/2530] 10.222.0.57 () {58 vars in 1122 bytes} [Fri Sep 16 07:57:35 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 07:57:35.162703 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986a5937-9bba-4e2c-805d-4d4b34fe13a2 admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:57:35.174970 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986a5937-9bba-4e2c-805d-4d4b34fe13a2 admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:57:35.179931 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d3f080-61ce-49a1-b560-d0b101d1e5dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:57:35.180599 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d3f080-61ce-49a1-b560-d0b101d1e5dd admin admin] REQUEST_METHOD: `PUT` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:57:35.183993 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d3f080-61ce-49a1-b560-d0b101d1e5dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:57:35.184326 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d3f080-61ce-49a1-b560-d0b101d1e5dd admin admin] PATH_INFO: `/v3/projects/2ff6eb955a634e4b9eb3f4d07d27628b/users/c34b791eb00b4df29e75007cd4e8a43a/roles/4818d38cf2564825b312e66c9eb24762` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:57:35.200250 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d3f080-61ce-49a1-b560-d0b101d1e5dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ff6eb955a634e4b9eb3f4d07d27628b, user_id=c34b791eb00b4df29e75007cd4e8a43a, role_id=4818d38cf2564825b312e66c9eb24762)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:57:35.203521 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d3f080-61ce-49a1-b560-d0b101d1e5dd admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:57:35.213700 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:57:35.221339 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1275/2531] 10.222.0.57 () {60 vars in 1483 bytes} [Fri Sep 16 07:57:35 2022] PUT /identity/v3/projects/2ff6eb955a634e4b9eb3f4d07d27628b/users/c34b791eb00b4df29e75007cd4e8a43a/roles/4818d38cf2564825b312e66c9eb24762 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 16 07:57:35.232447 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc32d5de-d87d-49ca-b4f1-d45db72f6449 None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:57:35.232739 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc32d5de-d87d-49ca-b4f1-d45db72f6449 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:57:35.233646 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc32d5de-d87d-49ca-b4f1-d45db72f6449 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:57:35.264803 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-fc32d5de-d87d-49ca-b4f1-d45db72f6449 None None] MFA Rules not processed for user `c34b791eb00b4df29e75007cd4e8a43a`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:57:35.266307 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-fc32d5de-d87d-49ca-b4f1-d45db72f6449 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:57:35.345059 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1257/2532] 10.222.0.57 () {58 vars in 958 bytes} [Fri Sep 16 07:57:35 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 07:57:35.357424 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d3f080-61ce-49a1-b560-d0b101d1e5dd admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:57:35.359855 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-62d3f080-61ce-49a1-b560-d0b101d1e5dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:57:35.429841 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e961ff-95d1-40df-a7d3-88dc32e8a2b3 None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:57:35.430210 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e961ff-95d1-40df-a7d3-88dc32e8a2b3 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:57:35.430564 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e961ff-95d1-40df-a7d3-88dc32e8a2b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:57:35.438302 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:57:35.441174 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d3f080-61ce-49a1-b560-d0b101d1e5dd admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:57:35.444938 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d24422a-b61e-4fce-b12b-534de43cb903 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceecb2c2fe9842e3b228848e00fd11ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4735f453c0c24cc4a1c14e9ac84a0b46', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:57:35.449408 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d24422a-b61e-4fce-b12b-534de43cb903 service glance] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:57:35.449408 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d24422a-b61e-4fce-b12b-534de43cb903 service glance] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:57:35.449408 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d24422a-b61e-4fce-b12b-534de43cb903 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:57:35.450915 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-55e961ff-95d1-40df-a7d3-88dc32e8a2b3 None None] MFA Rules not processed for user `fe7d50c001dc441c841357d3e9e6294b`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:57:35.452582 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-55e961ff-95d1-40df-a7d3-88dc32e8a2b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:57:35.459217 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d24422a-b61e-4fce-b12b-534de43cb903 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:57:35.460937 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d24422a-b61e-4fce-b12b-534de43cb903 service glance] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:57:35.471939 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1276/2533] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Sep 16 07:57:35 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 07:57:35.528376 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1258/2534] 10.222.0.57 () {58 vars in 958 bytes} [Fri Sep 16 07:57:35 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 16 07:57:45.467850 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=27 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:57:45.520775 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=24 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:57:46.692722 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c481c67d-cb70-45e1-bc0d-0429b22d6475 None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:57:46.693163 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c481c67d-cb70-45e1-bc0d-0429b22d6475 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:57:46.693369 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c481c67d-cb70-45e1-bc0d-0429b22d6475 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:57:46.718271 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-c481c67d-cb70-45e1-bc0d-0429b22d6475 None None] MFA Rules not processed for user `56eb9bbabb65436bb095952159df184c`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:57:46.722307 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-c481c67d-cb70-45e1-bc0d-0429b22d6475 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:57:46.784438 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1277/2535] 10.222.0.57 () {58 vars in 967 bytes} [Fri Sep 16 07:57:46 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 07:57:46.797947 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e961ff-95d1-40df-a7d3-88dc32e8a2b3 None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:57:46.799335 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-55e961ff-95d1-40df-a7d3-88dc32e8a2b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:57:46.874317 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e961ff-95d1-40df-a7d3-88dc32e8a2b3 None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:57:46.879357 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82b23bb-4518-4285-afcd-9e40f457b4c2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38abb0283b41449d8183b88912f2574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4735f453c0c24cc4a1c14e9ac84a0b46', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:57:46.879968 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82b23bb-4518-4285-afcd-9e40f457b4c2 service swift] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:57:46.880280 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82b23bb-4518-4285-afcd-9e40f457b4c2 service swift] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:57:46.880551 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82b23bb-4518-4285-afcd-9e40f457b4c2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:57:46.889862 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82b23bb-4518-4285-afcd-9e40f457b4c2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:57:46.891437 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82b23bb-4518-4285-afcd-9e40f457b4c2 service swift] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:57:46.899902 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1259/2536] 10.222.0.57 () {60 vars in 1384 bytes} [Fri Sep 16 07:57:46 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 16 07:57:52.354761 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c481c67d-cb70-45e1-bc0d-0429b22d6475 None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:57:52.540943 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c481c67d-cb70-45e1-bc0d-0429b22d6475 None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:57:52.546111 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab676353-6ffc-4a92-9512-ea7c06d1dd24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:57:52.546730 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab676353-6ffc-4a92-9512-ea7c06d1dd24 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:57:52.547002 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab676353-6ffc-4a92-9512-ea7c06d1dd24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:57:52.547266 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab676353-6ffc-4a92-9512-ea7c06d1dd24 admin admin] PATH_INFO: `/v3/users/c34b791eb00b4df29e75007cd4e8a43a` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:57:52.548380 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab676353-6ffc-4a92-9512-ea7c06d1dd24 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c34b791eb00b4df29e75007cd4e8a43a)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:57:52.550311 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab676353-6ffc-4a92-9512-ea7c06d1dd24 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:57:52.597842 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-ab676353-6ffc-4a92-9512-ea7c06d1dd24 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c34b791eb00b4df29e75007cd4e8a43a'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:57:52.610514 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-ab676353-6ffc-4a92-9512-ea7c06d1dd24 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c34b791eb00b4df29e75007cd4e8a43a'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:57:52.611192 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-ab676353-6ffc-4a92-9512-ea7c06d1dd24 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c34b791eb00b4df29e75007cd4e8a43a'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:57:52.619257 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-ab676353-6ffc-4a92-9512-ea7c06d1dd24 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c34b791eb00b4df29e75007cd4e8a43a'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:57:52.628059 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-ab676353-6ffc-4a92-9512-ea7c06d1dd24 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c34b791eb00b4df29e75007cd4e8a43a'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:57:52.633923 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1278/2537] 10.222.0.57 () {58 vars in 1224 bytes} [Fri Sep 16 07:57:52 2022] DELETE /identity/v3/users/c34b791eb00b4df29e75007cd4e8a43a => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 07:57:52.638494 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efe243f-f5ca-43d8-9777-167cf0b9ec24 None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:57:52.639013 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efe243f-f5ca-43d8-9777-167cf0b9ec24 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:57:52.639119 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efe243f-f5ca-43d8-9777-167cf0b9ec24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:57:52.658949 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-9efe243f-f5ca-43d8-9777-167cf0b9ec24 None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:57:52.660152 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-9efe243f-f5ca-43d8-9777-167cf0b9ec24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:57:52.728871 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1260/2538] 10.222.0.57 () {58 vars in 958 bytes} [Fri Sep 16 07:57:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 16 07:57:52.738815 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab676353-6ffc-4a92-9512-ea7c06d1dd24 admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:57:52.740624 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-ab676353-6ffc-4a92-9512-ea7c06d1dd24 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:57:52.771301 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:57:52.805411 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab676353-6ffc-4a92-9512-ea7c06d1dd24 admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:57:52.809091 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed173c41-d97a-48fe-a5c6-f96b50f620ab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1062e457207a41e4ba4f0a0c4bf36f1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4735f453c0c24cc4a1c14e9ac84a0b46', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:57:52.809795 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed173c41-d97a-48fe-a5c6-f96b50f620ab service neutron] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:57:52.810192 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed173c41-d97a-48fe-a5c6-f96b50f620ab service neutron] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:57:52.810535 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed173c41-d97a-48fe-a5c6-f96b50f620ab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:57:52.819901 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed173c41-d97a-48fe-a5c6-f96b50f620ab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:57:52.821372 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed173c41-d97a-48fe-a5c6-f96b50f620ab service neutron] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:57:52.831548 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1279/2539] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Sep 16 07:57:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 07:57:53.123987 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efe243f-f5ca-43d8-9777-167cf0b9ec24 None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:57:53.125416 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-9efe243f-f5ca-43d8-9777-167cf0b9ec24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:57:53.140949 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efe243f-f5ca-43d8-9777-167cf0b9ec24 None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:57:53.146546 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf43abc-c30b-46c7-ab10-aa0ab9aef443 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:57:53.147502 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf43abc-c30b-46c7-ab10-aa0ab9aef443 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:57:53.147789 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf43abc-c30b-46c7-ab10-aa0ab9aef443 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:57:53.148086 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf43abc-c30b-46c7-ab10-aa0ab9aef443 admin admin] PATH_INFO: `/v3/projects/2ff6eb955a634e4b9eb3f4d07d27628b` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:57:53.149320 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf43abc-c30b-46c7-ab10-aa0ab9aef443 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2ff6eb955a634e4b9eb3f4d07d27628b)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:57:53.151198 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf43abc-c30b-46c7-ab10-aa0ab9aef443 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:57:53.197811 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-abf43abc-c30b-46c7-ab10-aa0ab9aef443 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2ff6eb955a634e4b9eb3f4d07d27628b', 'request_id': 'req-abf43abc-c30b-46c7-ab10-aa0ab9aef443'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:57:53.206542 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-abf43abc-c30b-46c7-ab10-aa0ab9aef443 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2ff6eb955a634e4b9eb3f4d07d27628b', 'request_id': 'req-abf43abc-c30b-46c7-ab10-aa0ab9aef443'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:57:53.212559 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-abf43abc-c30b-46c7-ab10-aa0ab9aef443 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2ff6eb955a634e4b9eb3f4d07d27628b', 'request_id': 'req-abf43abc-c30b-46c7-ab10-aa0ab9aef443'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:57:53.223768 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-abf43abc-c30b-46c7-ab10-aa0ab9aef443 admin admin] The token cache is being invalidate because project 2ff6eb955a634e4b9eb3f4d07d27628b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81430) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 07:57:53.224060 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-abf43abc-c30b-46c7-ab10-aa0ab9aef443 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:57:53.224720 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-abf43abc-c30b-46c7-ab10-aa0ab9aef443 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:57:53.226251 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1261/2540] 10.222.0.57 () {58 vars in 1233 bytes} [Fri Sep 16 07:57:53 2022] DELETE /identity/v3/projects/2ff6eb955a634e4b9eb3f4d07d27628b => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 07:57:53.230995 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c26569-f7a3-4c6d-a830-70d72c13f833 None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:57:53.231279 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c26569-f7a3-4c6d-a830-70d72c13f833 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:57:53.231551 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c26569-f7a3-4c6d-a830-70d72c13f833 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:57:53.252787 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-95c26569-f7a3-4c6d-a830-70d72c13f833 None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:57:53.254018 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-95c26569-f7a3-4c6d-a830-70d72c13f833 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:57:53.314110 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1280/2541] 10.222.0.57 () {58 vars in 958 bytes} [Fri Sep 16 07:57:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 07:57:53.322800 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7857b3df-da2c-4e71-b4cf-a91462435b4d None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:57:53.323091 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7857b3df-da2c-4e71-b4cf-a91462435b4d None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:57:53.323377 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7857b3df-da2c-4e71-b4cf-a91462435b4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:57:53.343111 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-7857b3df-da2c-4e71-b4cf-a91462435b4d None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:57:53.344342 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-7857b3df-da2c-4e71-b4cf-a91462435b4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:57:53.352215 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1262/2542] 10.222.0.57 () {58 vars in 958 bytes} [Fri Sep 16 07:57:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 07:57:53.356346 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c26569-f7a3-4c6d-a830-70d72c13f833 None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:57:53.366731 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c26569-f7a3-4c6d-a830-70d72c13f833 None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:57:53.371254 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd30c99-8e5c-41a4-8230-1d8cafc2f455 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:57:53.371844 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd30c99-8e5c-41a4-8230-1d8cafc2f455 admin admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:57:53.372120 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd30c99-8e5c-41a4-8230-1d8cafc2f455 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:57:53.372389 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd30c99-8e5c-41a4-8230-1d8cafc2f455 admin admin] PATH_INFO: `/v3/domains` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:57:53.373669 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd30c99-8e5c-41a4-8230-1d8cafc2f455 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:57:53.373992 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd30c99-8e5c-41a4-8230-1d8cafc2f455 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:57:53.375605 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd30c99-8e5c-41a4-8230-1d8cafc2f455 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:57:53.386896 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1281/2543] 10.222.0.57 () {58 vars in 1153 bytes} [Fri Sep 16 07:57:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 07:57:53.391167 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7857b3df-da2c-4e71-b4cf-a91462435b4d None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:57:53.400360 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7857b3df-da2c-4e71-b4cf-a91462435b4d None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:57:53.405082 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea36ad54-59b2-4821-aca0-9fe930dd6190 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:57:53.405664 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea36ad54-59b2-4821-aca0-9fe930dd6190 admin admin] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:57:53.405967 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea36ad54-59b2-4821-aca0-9fe930dd6190 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:57:53.406235 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea36ad54-59b2-4821-aca0-9fe930dd6190 admin admin] PATH_INFO: `/v3/projects` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:57:53.406888 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea36ad54-59b2-4821-aca0-9fe930dd6190 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:57:53.408787 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea36ad54-59b2-4821-aca0-9fe930dd6190 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:57:53.413164 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:57:53.439850 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1263/2544] 10.222.0.57 () {60 vars in 1153 bytes} [Fri Sep 16 07:57:53 2022] POST /identity/v3/projects => generated 375 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 07:57:53.443982 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd30c99-8e5c-41a4-8230-1d8cafc2f455 admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:57:53.453967 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd30c99-8e5c-41a4-8230-1d8cafc2f455 admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:57:53.510154 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab90f5e1-4282-4aac-b52f-56f7f4743ee6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:57:53.510746 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab90f5e1-4282-4aac-b52f-56f7f4743ee6 admin admin] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:57:53.511026 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab90f5e1-4282-4aac-b52f-56f7f4743ee6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:57:53.511296 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab90f5e1-4282-4aac-b52f-56f7f4743ee6 admin admin] PATH_INFO: `/v3/users` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:57:53.511914 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab90f5e1-4282-4aac-b52f-56f7f4743ee6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:57:53.513874 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab90f5e1-4282-4aac-b52f-56f7f4743ee6 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:57:53.534142 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1282/2545] 10.222.0.57 () {60 vars in 1144 bytes} [Fri Sep 16 07:57:53 2022] POST /identity/v3/users => generated 288 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 07:57:53.539722 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea36ad54-59b2-4821-aca0-9fe930dd6190 admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:57:53.550592 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea36ad54-59b2-4821-aca0-9fe930dd6190 admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:57:53.556683 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ef5e75-8bb1-443d-8dc7-3d2c4de99726 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:57:53.557707 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ef5e75-8bb1-443d-8dc7-3d2c4de99726 admin admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:57:53.558255 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ef5e75-8bb1-443d-8dc7-3d2c4de99726 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:57:53.558725 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ef5e75-8bb1-443d-8dc7-3d2c4de99726 admin admin] PATH_INFO: `/v3/roles` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:57:53.559867 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ef5e75-8bb1-443d-8dc7-3d2c4de99726 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:57:53.563333 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ef5e75-8bb1-443d-8dc7-3d2c4de99726 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:57:53.574147 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1264/2546] 10.222.0.57 () {58 vars in 1122 bytes} [Fri Sep 16 07:57:53 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 07:57:53.578480 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab90f5e1-4282-4aac-b52f-56f7f4743ee6 admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:57:53.588906 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab90f5e1-4282-4aac-b52f-56f7f4743ee6 admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:57:53.593928 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4194fa92-94fb-42e1-be9a-d46c35210ced admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:57:53.594522 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4194fa92-94fb-42e1-be9a-d46c35210ced admin admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:57:53.594800 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4194fa92-94fb-42e1-be9a-d46c35210ced admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:57:53.595075 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4194fa92-94fb-42e1-be9a-d46c35210ced admin admin] PATH_INFO: `/v3/roles` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:57:53.595707 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4194fa92-94fb-42e1-be9a-d46c35210ced admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:57:53.597288 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4194fa92-94fb-42e1-be9a-d46c35210ced admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:57:53.607971 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1283/2547] 10.222.0.57 () {58 vars in 1122 bytes} [Fri Sep 16 07:57:53 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 07:57:53.611941 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ef5e75-8bb1-443d-8dc7-3d2c4de99726 admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:57:53.622361 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ef5e75-8bb1-443d-8dc7-3d2c4de99726 admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:57:53.627841 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44d7188-2cb5-4e2b-8632-e31aa05877e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:57:53.628485 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44d7188-2cb5-4e2b-8632-e31aa05877e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:57:53.628762 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44d7188-2cb5-4e2b-8632-e31aa05877e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:57:53.629033 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44d7188-2cb5-4e2b-8632-e31aa05877e4 admin admin] PATH_INFO: `/v3/projects/84083c4f861d4c94af817177c596bf6d/users/7f864048d6c44819837de0a00cda53ff/roles/4818d38cf2564825b312e66c9eb24762` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:57:53.643733 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44d7188-2cb5-4e2b-8632-e31aa05877e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=84083c4f861d4c94af817177c596bf6d, user_id=7f864048d6c44819837de0a00cda53ff, role_id=4818d38cf2564825b312e66c9eb24762)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:57:53.646327 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44d7188-2cb5-4e2b-8632-e31aa05877e4 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:57:53.659632 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1265/2548] 10.222.0.57 () {60 vars in 1483 bytes} [Fri Sep 16 07:57:53 2022] PUT /identity/v3/projects/84083c4f861d4c94af817177c596bf6d/users/7f864048d6c44819837de0a00cda53ff/roles/4818d38cf2564825b312e66c9eb24762 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 07:57:53.670389 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1c9d32-0100-4fe5-a228-c061df11744c None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:57:53.670773 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1c9d32-0100-4fe5-a228-c061df11744c None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:57:53.671055 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1c9d32-0100-4fe5-a228-c061df11744c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:57:53.698244 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-ed1c9d32-0100-4fe5-a228-c061df11744c None None] MFA Rules not processed for user `7f864048d6c44819837de0a00cda53ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:57:53.699436 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-ed1c9d32-0100-4fe5-a228-c061df11744c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:57:53.719403 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:57:53.763456 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1284/2549] 10.222.0.57 () {58 vars in 958 bytes} [Fri Sep 16 07:57:53 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 07:57:53.768096 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44d7188-2cb5-4e2b-8632-e31aa05877e4 admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:57:53.830279 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44d7188-2cb5-4e2b-8632-e31aa05877e4 admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:57:53.835008 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32403eef-ce33-4de8-ba46-e6c08133090d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:57:53.835614 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32403eef-ce33-4de8-ba46-e6c08133090d admin admin] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:57:53.835896 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32403eef-ce33-4de8-ba46-e6c08133090d admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:57:53.836170 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32403eef-ce33-4de8-ba46-e6c08133090d admin admin] PATH_INFO: `/v3/projects` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:57:53.836798 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32403eef-ce33-4de8-ba46-e6c08133090d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:57:53.838730 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32403eef-ce33-4de8-ba46-e6c08133090d admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:57:53.867830 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1266/2550] 10.222.0.57 () {60 vars in 1153 bytes} [Fri Sep 16 07:57:53 2022] POST /identity/v3/projects => generated 375 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 07:57:53.871968 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1c9d32-0100-4fe5-a228-c061df11744c None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:57:53.882519 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1c9d32-0100-4fe5-a228-c061df11744c None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:57:53.942973 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46be5246-75e6-47d0-b041-d1ae3cfde22e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:57:53.943585 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46be5246-75e6-47d0-b041-d1ae3cfde22e admin admin] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:57:53.943896 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46be5246-75e6-47d0-b041-d1ae3cfde22e admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:57:53.944292 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46be5246-75e6-47d0-b041-d1ae3cfde22e admin admin] PATH_INFO: `/v3/users` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:57:53.944933 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46be5246-75e6-47d0-b041-d1ae3cfde22e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:57:53.946886 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46be5246-75e6-47d0-b041-d1ae3cfde22e admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:57:53.968806 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1285/2551] 10.222.0.57 () {60 vars in 1144 bytes} [Fri Sep 16 07:57:53 2022] POST /identity/v3/users => generated 288 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 07:57:53.972766 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32403eef-ce33-4de8-ba46-e6c08133090d admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:57:53.983847 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32403eef-ce33-4de8-ba46-e6c08133090d admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:57:53.988530 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b265343-7760-4775-91e3-646324cb841e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:57:53.989465 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b265343-7760-4775-91e3-646324cb841e admin admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:57:53.989772 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b265343-7760-4775-91e3-646324cb841e admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:57:53.990310 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b265343-7760-4775-91e3-646324cb841e admin admin] PATH_INFO: `/v3/roles` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:57:53.990959 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b265343-7760-4775-91e3-646324cb841e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:57:53.992734 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b265343-7760-4775-91e3-646324cb841e admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:57:54.003556 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1267/2552] 10.222.0.57 () {58 vars in 1122 bytes} [Fri Sep 16 07:57:53 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 07:57:54.007527 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46be5246-75e6-47d0-b041-d1ae3cfde22e admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:57:54.018534 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46be5246-75e6-47d0-b041-d1ae3cfde22e admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:57:54.023167 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f613532c-976e-4790-85f8-0548880107f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:57:54.023810 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f613532c-976e-4790-85f8-0548880107f7 admin admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:57:54.024090 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f613532c-976e-4790-85f8-0548880107f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:57:54.024356 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f613532c-976e-4790-85f8-0548880107f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:57:54.024983 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f613532c-976e-4790-85f8-0548880107f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:57:54.026602 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f613532c-976e-4790-85f8-0548880107f7 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:57:54.037839 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1286/2553] 10.222.0.57 () {58 vars in 1122 bytes} [Fri Sep 16 07:57:54 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 07:57:54.042024 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b265343-7760-4775-91e3-646324cb841e admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:57:54.052200 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b265343-7760-4775-91e3-646324cb841e admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:57:54.056871 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdcf770-c2f4-44e7-9d57-8b5e4b0b6f4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:57:54.057533 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdcf770-c2f4-44e7-9d57-8b5e4b0b6f4e admin admin] REQUEST_METHOD: `PUT` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:57:54.057835 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdcf770-c2f4-44e7-9d57-8b5e4b0b6f4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:57:54.058157 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdcf770-c2f4-44e7-9d57-8b5e4b0b6f4e admin admin] PATH_INFO: `/v3/projects/f6c95b835b134461a5dfcb55ca585d52/users/30a7ed6279f84a698deef582b7fa834e/roles/4818d38cf2564825b312e66c9eb24762` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:57:54.074700 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fdcf770-c2f4-44e7-9d57-8b5e4b0b6f4e admin admin] RBAC: Authorizing `identity:create_grant(project_id=f6c95b835b134461a5dfcb55ca585d52, user_id=30a7ed6279f84a698deef582b7fa834e, role_id=4818d38cf2564825b312e66c9eb24762)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:57:54.078357 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fdcf770-c2f4-44e7-9d57-8b5e4b0b6f4e admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:57:54.093838 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1268/2554] 10.222.0.57 () {60 vars in 1483 bytes} [Fri Sep 16 07:57:54 2022] PUT /identity/v3/projects/f6c95b835b134461a5dfcb55ca585d52/users/30a7ed6279f84a698deef582b7fa834e/roles/4818d38cf2564825b312e66c9eb24762 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 07:57:54.104014 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c42352-27c7-4050-a537-1d187fef4e90 None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:57:54.104366 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c42352-27c7-4050-a537-1d187fef4e90 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:57:54.104698 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c42352-27c7-4050-a537-1d187fef4e90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:57:54.133333 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-89c42352-27c7-4050-a537-1d187fef4e90 None None] MFA Rules not processed for user `30a7ed6279f84a698deef582b7fa834e`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:57:54.134553 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-89c42352-27c7-4050-a537-1d187fef4e90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:57:54.196829 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1287/2555] 10.222.0.57 () {58 vars in 958 bytes} [Fri Sep 16 07:57:54 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 07:57:54.201436 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdcf770-c2f4-44e7-9d57-8b5e4b0b6f4e admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:57:54.264731 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdcf770-c2f4-44e7-9d57-8b5e4b0b6f4e admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:57:54.269676 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e965cc38-476c-4721-a9d4-81668553cd1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:57:54.270314 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e965cc38-476c-4721-a9d4-81668553cd1e admin admin] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:57:54.270592 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e965cc38-476c-4721-a9d4-81668553cd1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:57:54.270862 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e965cc38-476c-4721-a9d4-81668553cd1e admin admin] PATH_INFO: `/v3/projects` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:57:54.271509 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e965cc38-476c-4721-a9d4-81668553cd1e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:57:54.273413 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e965cc38-476c-4721-a9d4-81668553cd1e admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:57:54.279810 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:57:54.307023 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1269/2556] 10.222.0.57 () {60 vars in 1153 bytes} [Fri Sep 16 07:57:54 2022] POST /identity/v3/projects => generated 375 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 07:57:54.308454 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c42352-27c7-4050-a537-1d187fef4e90 None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:57:54.318899 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c42352-27c7-4050-a537-1d187fef4e90 None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:57:54.347892 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:57:54.379194 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc808c8-182e-49f5-b6df-9337b04d2cd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:57:54.379924 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc808c8-182e-49f5-b6df-9337b04d2cd9 admin admin] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:57:54.380074 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc808c8-182e-49f5-b6df-9337b04d2cd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:57:54.380338 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc808c8-182e-49f5-b6df-9337b04d2cd9 admin admin] PATH_INFO: `/v3/users` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:57:54.380979 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc808c8-182e-49f5-b6df-9337b04d2cd9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:57:54.382923 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc808c8-182e-49f5-b6df-9337b04d2cd9 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:57:54.406573 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1288/2557] 10.222.0.57 () {60 vars in 1144 bytes} [Fri Sep 16 07:57:54 2022] POST /identity/v3/users => generated 294 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 16 07:57:54.410967 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e965cc38-476c-4721-a9d4-81668553cd1e admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:57:54.422509 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e965cc38-476c-4721-a9d4-81668553cd1e admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:57:54.427335 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef913a4-803d-4ebe-a3cf-ab52ab527e9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:57:54.427982 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef913a4-803d-4ebe-a3cf-ab52ab527e9b admin admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:57:54.428271 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef913a4-803d-4ebe-a3cf-ab52ab527e9b admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:57:54.428525 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef913a4-803d-4ebe-a3cf-ab52ab527e9b admin admin] PATH_INFO: `/v3/roles` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:57:54.429171 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef913a4-803d-4ebe-a3cf-ab52ab527e9b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:57:54.430788 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef913a4-803d-4ebe-a3cf-ab52ab527e9b admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:57:54.441664 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1270/2558] 10.222.0.57 () {58 vars in 1122 bytes} [Fri Sep 16 07:57:54 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 07:57:54.446067 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc808c8-182e-49f5-b6df-9337b04d2cd9 admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:57:54.456905 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc808c8-182e-49f5-b6df-9337b04d2cd9 admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:57:54.461498 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d2db62-3dab-40be-82d0-965da4b019c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:57:54.462192 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d2db62-3dab-40be-82d0-965da4b019c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:57:54.462468 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d2db62-3dab-40be-82d0-965da4b019c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:57:54.462741 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d2db62-3dab-40be-82d0-965da4b019c1 admin admin] PATH_INFO: `/v3/projects/6cea269627974ec2a65d4846b101feae/users/3cf63faed71d4e98902e0011fd7781bc/roles/567db03c91854ad9af1e9a87ec1bd275` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:57:54.479969 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d2db62-3dab-40be-82d0-965da4b019c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6cea269627974ec2a65d4846b101feae, user_id=3cf63faed71d4e98902e0011fd7781bc, role_id=567db03c91854ad9af1e9a87ec1bd275)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:57:54.483785 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d2db62-3dab-40be-82d0-965da4b019c1 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:57:54.497984 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1289/2559] 10.222.0.57 () {60 vars in 1483 bytes} [Fri Sep 16 07:57:54 2022] PUT /identity/v3/projects/6cea269627974ec2a65d4846b101feae/users/3cf63faed71d4e98902e0011fd7781bc/roles/567db03c91854ad9af1e9a87ec1bd275 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 07:57:54.502231 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef913a4-803d-4ebe-a3cf-ab52ab527e9b admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:57:54.512721 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef913a4-803d-4ebe-a3cf-ab52ab527e9b admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:57:54.570680 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c978ebb8-3b92-4bea-8a89-28f1d54ff597 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:57:54.571337 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c978ebb8-3b92-4bea-8a89-28f1d54ff597 admin admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:57:54.571622 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c978ebb8-3b92-4bea-8a89-28f1d54ff597 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:57:54.571894 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c978ebb8-3b92-4bea-8a89-28f1d54ff597 admin admin] PATH_INFO: `/v3/roles` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:57:54.572535 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c978ebb8-3b92-4bea-8a89-28f1d54ff597 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:57:54.574200 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c978ebb8-3b92-4bea-8a89-28f1d54ff597 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:57:54.584616 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1271/2560] 10.222.0.57 () {58 vars in 1122 bytes} [Fri Sep 16 07:57:54 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 07:57:54.588623 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d2db62-3dab-40be-82d0-965da4b019c1 admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:57:54.599776 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d2db62-3dab-40be-82d0-965da4b019c1 admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:57:54.604350 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06724f0-e998-4b01-b281-cabc8f171ef8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:57:54.604989 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06724f0-e998-4b01-b281-cabc8f171ef8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:57:54.605392 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06724f0-e998-4b01-b281-cabc8f171ef8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:57:54.605670 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06724f0-e998-4b01-b281-cabc8f171ef8 admin admin] PATH_INFO: `/v3/projects/6cea269627974ec2a65d4846b101feae/users/3cf63faed71d4e98902e0011fd7781bc/roles/567db03c91854ad9af1e9a87ec1bd275` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:57:54.608271 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06724f0-e998-4b01-b281-cabc8f171ef8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6cea269627974ec2a65d4846b101feae, user_id=3cf63faed71d4e98902e0011fd7781bc, role_id=567db03c91854ad9af1e9a87ec1bd275)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:57:54.610998 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06724f0-e998-4b01-b281-cabc8f171ef8 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:57:54.621561 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1290/2561] 10.222.0.57 () {60 vars in 1483 bytes} [Fri Sep 16 07:57:54 2022] PUT /identity/v3/projects/6cea269627974ec2a65d4846b101feae/users/3cf63faed71d4e98902e0011fd7781bc/roles/567db03c91854ad9af1e9a87ec1bd275 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 16 07:57:54.632604 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8b74c0-5995-4a7b-ac26-47e765c9f1b9 None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:57:54.632892 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8b74c0-5995-4a7b-ac26-47e765c9f1b9 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:57:54.633167 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8b74c0-5995-4a7b-ac26-47e765c9f1b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:57:54.662162 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-5f8b74c0-5995-4a7b-ac26-47e765c9f1b9 None None] MFA Rules not processed for user `3cf63faed71d4e98902e0011fd7781bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:57:54.663522 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-5f8b74c0-5995-4a7b-ac26-47e765c9f1b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:57:54.734064 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1272/2562] 10.222.0.57 () {58 vars in 958 bytes} [Fri Sep 16 07:57:54 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 07:57:54.745544 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06724f0-e998-4b01-b281-cabc8f171ef8 admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:57:54.747265 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-c06724f0-e998-4b01-b281-cabc8f171ef8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:57:54.809075 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06724f0-e998-4b01-b281-cabc8f171ef8 admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:57:54.813581 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805d1990-074b-4140-aa92-98551ca48b16 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544bf6be4c24454a013ca110c43cef2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4735f453c0c24cc4a1c14e9ac84a0b46', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:57:54.814212 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805d1990-074b-4140-aa92-98551ca48b16 service cinder] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:57:54.814489 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805d1990-074b-4140-aa92-98551ca48b16 service cinder] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:57:54.814755 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805d1990-074b-4140-aa92-98551ca48b16 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:57:54.883708 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805d1990-074b-4140-aa92-98551ca48b16 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:57:54.885375 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805d1990-074b-4140-aa92-98551ca48b16 service cinder] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:57:54.895741 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1291/2563] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Sep 16 07:57:54 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 07:57:56.418674 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf165338-830f-4fee-a4a9-530927105091 None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:57:56.419161 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf165338-830f-4fee-a4a9-530927105091 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:57:56.419249 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf165338-830f-4fee-a4a9-530927105091 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:57:56.438649 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-cf165338-830f-4fee-a4a9-530927105091 None None] MFA Rules not processed for user `56eb9bbabb65436bb095952159df184c`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:57:56.439834 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-cf165338-830f-4fee-a4a9-530927105091 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:57:56.486135 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805d1990-074b-4140-aa92-98551ca48b16 service cinder] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:57:56.487929 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-805d1990-074b-4140-aa92-98551ca48b16 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:57:56.489517 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:57:56.500000 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1273/2564] 10.222.0.57 () {58 vars in 1009 bytes} [Fri Sep 16 07:57:56 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 07:57:56.501689 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805d1990-074b-4140-aa92-98551ca48b16 service cinder] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:57:56.505625 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925d6fc1-c9b0-447b-9663-8ebe13a98bd6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544bf6be4c24454a013ca110c43cef2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4735f453c0c24cc4a1c14e9ac84a0b46', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:57:56.506411 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925d6fc1-c9b0-447b-9663-8ebe13a98bd6 service cinder] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:57:56.506696 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925d6fc1-c9b0-447b-9663-8ebe13a98bd6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:57:56.506992 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925d6fc1-c9b0-447b-9663-8ebe13a98bd6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:57:56.514362 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf165338-830f-4fee-a4a9-530927105091 None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:57:56.515739 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-cf165338-830f-4fee-a4a9-530927105091 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:57:56.541897 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:57:56.566861 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925d6fc1-c9b0-447b-9663-8ebe13a98bd6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:57:56.568293 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925d6fc1-c9b0-447b-9663-8ebe13a98bd6 service cinder] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:57:56.577592 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1292/2565] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Sep 16 07:57:56 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 16 07:57:56.589109 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf165338-830f-4fee-a4a9-530927105091 None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:57:56.594555 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae911ef8-f45d-4a62-9280-54a9e49fe44e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38abb0283b41449d8183b88912f2574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4735f453c0c24cc4a1c14e9ac84a0b46', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:57:56.595158 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae911ef8-f45d-4a62-9280-54a9e49fe44e service swift] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:57:56.595433 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae911ef8-f45d-4a62-9280-54a9e49fe44e service swift] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:57:56.595699 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae911ef8-f45d-4a62-9280-54a9e49fe44e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:57:56.603827 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae911ef8-f45d-4a62-9280-54a9e49fe44e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:57:56.605563 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae911ef8-f45d-4a62-9280-54a9e49fe44e service swift] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:57:56.614473 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1274/2566] 10.222.0.57 () {60 vars in 1384 bytes} [Fri Sep 16 07:57:56 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 16 07:57:57.163789 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925d6fc1-c9b0-447b-9663-8ebe13a98bd6 service cinder] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:57:57.173315 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925d6fc1-c9b0-447b-9663-8ebe13a98bd6 service cinder] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:57:57.177654 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e2ccf9-2fba-458d-9c90-b01aff25f08f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544bf6be4c24454a013ca110c43cef2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4735f453c0c24cc4a1c14e9ac84a0b46', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:57:57.178333 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e2ccf9-2fba-458d-9c90-b01aff25f08f service cinder] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:57:57.178578 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e2ccf9-2fba-458d-9c90-b01aff25f08f service cinder] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:57:57.178824 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e2ccf9-2fba-458d-9c90-b01aff25f08f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:57:57.185120 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc07329-5cb1-48a8-b7fe-2a02c209d3e5 None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:57:57.185668 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc07329-5cb1-48a8-b7fe-2a02c209d3e5 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:57:57.185903 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc07329-5cb1-48a8-b7fe-2a02c209d3e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:57:57.188798 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e2ccf9-2fba-458d-9c90-b01aff25f08f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:57:57.190266 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e2ccf9-2fba-458d-9c90-b01aff25f08f service cinder] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:57:57.200006 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1293/2567] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Sep 16 07:57:57 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 07:57:57.206377 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-1bc07329-5cb1-48a8-b7fe-2a02c209d3e5 None None] MFA Rules not processed for user `56eb9bbabb65436bb095952159df184c`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:57:57.207578 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-1bc07329-5cb1-48a8-b7fe-2a02c209d3e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:57:57.214954 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1275/2568] 10.222.0.57 () {58 vars in 967 bytes} [Fri Sep 16 07:57:57 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 16 07:57:57.228228 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e2ccf9-2fba-458d-9c90-b01aff25f08f service cinder] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:57:57.241067 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e2ccf9-2fba-458d-9c90-b01aff25f08f service cinder] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:57:57.246136 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304efba5-1232-4365-a243-266a67cb15db service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38abb0283b41449d8183b88912f2574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4735f453c0c24cc4a1c14e9ac84a0b46', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:57:57.246766 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304efba5-1232-4365-a243-266a67cb15db service swift] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:57:57.247072 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304efba5-1232-4365-a243-266a67cb15db service swift] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:57:57.247464 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304efba5-1232-4365-a243-266a67cb15db service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:57:57.260103 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304efba5-1232-4365-a243-266a67cb15db service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:57:57.261674 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304efba5-1232-4365-a243-266a67cb15db service swift] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:57:57.270290 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1294/2569] 10.222.0.57 () {60 vars in 1384 bytes} [Fri Sep 16 07:57:57 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 16 07:57:57.508319 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7aeefd-2f02-472a-8675-3d6524cbf46d None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:57:57.508776 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7aeefd-2f02-472a-8675-3d6524cbf46d None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:57:57.508885 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7aeefd-2f02-472a-8675-3d6524cbf46d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:57:57.528261 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-db7aeefd-2f02-472a-8675-3d6524cbf46d None None] MFA Rules not processed for user `56eb9bbabb65436bb095952159df184c`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:57:57.530709 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-db7aeefd-2f02-472a-8675-3d6524cbf46d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:57:57.537769 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1276/2570] 10.222.0.57 () {58 vars in 1009 bytes} [Fri Sep 16 07:57:57 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 07:57:57.549819 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304efba5-1232-4365-a243-266a67cb15db service swift] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:57:57.560357 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304efba5-1232-4365-a243-266a67cb15db service swift] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:57:57.565229 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4341754e-e01b-4a04-b5d3-ef215132ad03 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38abb0283b41449d8183b88912f2574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4735f453c0c24cc4a1c14e9ac84a0b46', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:57:57.565844 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4341754e-e01b-4a04-b5d3-ef215132ad03 service swift] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:57:57.566125 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4341754e-e01b-4a04-b5d3-ef215132ad03 service swift] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:57:57.566391 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4341754e-e01b-4a04-b5d3-ef215132ad03 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:57:57.578712 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4341754e-e01b-4a04-b5d3-ef215132ad03 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:57:57.580281 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4341754e-e01b-4a04-b5d3-ef215132ad03 service swift] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:57:57.588214 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1295/2571] 10.222.0.57 () {60 vars in 1384 bytes} [Fri Sep 16 07:57:57 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 16 07:57:57.909938 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3928b87a-2e13-4734-b6a7-5bd367c24992 None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:57:57.910233 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3928b87a-2e13-4734-b6a7-5bd367c24992 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:57:57.910514 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3928b87a-2e13-4734-b6a7-5bd367c24992 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:57:57.929609 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-3928b87a-2e13-4734-b6a7-5bd367c24992 None None] MFA Rules not processed for user `56eb9bbabb65436bb095952159df184c`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:57:57.930880 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-3928b87a-2e13-4734-b6a7-5bd367c24992 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:57:57.938564 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1277/2572] 10.222.0.57 () {58 vars in 967 bytes} [Fri Sep 16 07:57:57 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 07:57:57.951266 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4341754e-e01b-4a04-b5d3-ef215132ad03 service swift] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:57:57.961500 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4341754e-e01b-4a04-b5d3-ef215132ad03 service swift] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:57:57.966429 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5dcb7b3-3c18-4bb6-8325-71bac38458de service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38abb0283b41449d8183b88912f2574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4735f453c0c24cc4a1c14e9ac84a0b46', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:57:57.967006 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dcb7b3-3c18-4bb6-8325-71bac38458de service swift] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:57:57.967275 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dcb7b3-3c18-4bb6-8325-71bac38458de service swift] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:57:57.967540 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dcb7b3-3c18-4bb6-8325-71bac38458de service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:57:57.975264 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5dcb7b3-3c18-4bb6-8325-71bac38458de service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:57:57.976790 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5dcb7b3-3c18-4bb6-8325-71bac38458de service swift] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:57:57.984543 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1296/2573] 10.222.0.57 () {60 vars in 1384 bytes} [Fri Sep 16 07:57:57 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 16 07:58:00.085221 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3928b87a-2e13-4734-b6a7-5bd367c24992 None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:58:00.086633 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-3928b87a-2e13-4734-b6a7-5bd367c24992 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:58:00.155969 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3928b87a-2e13-4734-b6a7-5bd367c24992 None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:58:00.160451 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b96bf7-6786-47a1-8edf-00e5af1c133c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:58:00.161079 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b96bf7-6786-47a1-8edf-00e5af1c133c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:58:00.161357 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b96bf7-6786-47a1-8edf-00e5af1c133c admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:58:00.161626 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b96bf7-6786-47a1-8edf-00e5af1c133c admin admin] PATH_INFO: `/v3/users/fe7d50c001dc441c841357d3e9e6294b` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:58:00.162768 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b96bf7-6786-47a1-8edf-00e5af1c133c admin admin] RBAC: Authorizing `identity:delete_user(user_id=fe7d50c001dc441c841357d3e9e6294b)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:58:00.164775 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b96bf7-6786-47a1-8edf-00e5af1c133c admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:58:00.209591 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-13b96bf7-6786-47a1-8edf-00e5af1c133c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fe7d50c001dc441c841357d3e9e6294b'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:58:00.210280 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-13b96bf7-6786-47a1-8edf-00e5af1c133c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fe7d50c001dc441c841357d3e9e6294b'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:58:00.217788 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-13b96bf7-6786-47a1-8edf-00e5af1c133c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fe7d50c001dc441c841357d3e9e6294b'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:58:00.229552 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-13b96bf7-6786-47a1-8edf-00e5af1c133c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fe7d50c001dc441c841357d3e9e6294b'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:58:00.230742 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:58:00.239230 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-13b96bf7-6786-47a1-8edf-00e5af1c133c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fe7d50c001dc441c841357d3e9e6294b'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:58:00.245583 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1278/2574] 10.222.0.57 () {58 vars in 1224 bytes} [Fri Sep 16 07:58:00 2022] DELETE /identity/v3/users/fe7d50c001dc441c841357d3e9e6294b => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 16 07:58:00.250059 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b9b4c4-1dfb-4414-8c2c-a021ae206b69 None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:58:00.250537 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b9b4c4-1dfb-4414-8c2c-a021ae206b69 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:58:00.250657 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b9b4c4-1dfb-4414-8c2c-a021ae206b69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:58:00.269022 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-d4b9b4c4-1dfb-4414-8c2c-a021ae206b69 None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:58:00.270242 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-d4b9b4c4-1dfb-4414-8c2c-a021ae206b69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:58:00.328017 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1297/2575] 10.222.0.57 () {58 vars in 958 bytes} [Fri Sep 16 07:58:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 07:58:00.337624 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b96bf7-6786-47a1-8edf-00e5af1c133c admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:58:00.339138 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-13b96bf7-6786-47a1-8edf-00e5af1c133c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:58:00.398094 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b96bf7-6786-47a1-8edf-00e5af1c133c admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:58:00.401698 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0eb88e-ff6b-43bb-9486-2babf29bd74e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1062e457207a41e4ba4f0a0c4bf36f1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4735f453c0c24cc4a1c14e9ac84a0b46', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:58:00.402335 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0eb88e-ff6b-43bb-9486-2babf29bd74e service neutron] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:58:00.402614 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0eb88e-ff6b-43bb-9486-2babf29bd74e service neutron] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:58:00.402883 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0eb88e-ff6b-43bb-9486-2babf29bd74e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:58:00.412732 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0eb88e-ff6b-43bb-9486-2babf29bd74e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:58:00.414189 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0eb88e-ff6b-43bb-9486-2babf29bd74e service neutron] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:58:00.424295 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1279/2576] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Sep 16 07:58:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 07:58:00.592856 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b9b4c4-1dfb-4414-8c2c-a021ae206b69 None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:58:00.594295 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-d4b9b4c4-1dfb-4414-8c2c-a021ae206b69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:58:00.615330 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b9b4c4-1dfb-4414-8c2c-a021ae206b69 None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:58:00.619996 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942a0d9d-a7f1-4934-a1af-ba19c4740369 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:58:00.620628 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942a0d9d-a7f1-4934-a1af-ba19c4740369 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:58:00.620901 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942a0d9d-a7f1-4934-a1af-ba19c4740369 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:58:00.621194 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942a0d9d-a7f1-4934-a1af-ba19c4740369 admin admin] PATH_INFO: `/v3/projects/c71b9d9cf8ef428297a0212201e7e6d9` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:58:00.622349 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942a0d9d-a7f1-4934-a1af-ba19c4740369 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c71b9d9cf8ef428297a0212201e7e6d9)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:58:00.624328 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942a0d9d-a7f1-4934-a1af-ba19c4740369 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:58:00.672369 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-942a0d9d-a7f1-4934-a1af-ba19c4740369 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c71b9d9cf8ef428297a0212201e7e6d9', 'request_id': 'req-942a0d9d-a7f1-4934-a1af-ba19c4740369'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:58:00.678467 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-942a0d9d-a7f1-4934-a1af-ba19c4740369 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c71b9d9cf8ef428297a0212201e7e6d9', 'request_id': 'req-942a0d9d-a7f1-4934-a1af-ba19c4740369'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:58:00.685890 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-942a0d9d-a7f1-4934-a1af-ba19c4740369 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c71b9d9cf8ef428297a0212201e7e6d9', 'request_id': 'req-942a0d9d-a7f1-4934-a1af-ba19c4740369'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:58:00.696283 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-942a0d9d-a7f1-4934-a1af-ba19c4740369 admin admin] The token cache is being invalidate because project c71b9d9cf8ef428297a0212201e7e6d9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81431) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 07:58:00.696565 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-942a0d9d-a7f1-4934-a1af-ba19c4740369 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:58:00.697224 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-942a0d9d-a7f1-4934-a1af-ba19c4740369 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:58:00.698717 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1298/2577] 10.222.0.57 () {58 vars in 1233 bytes} [Fri Sep 16 07:58:00 2022] DELETE /identity/v3/projects/c71b9d9cf8ef428297a0212201e7e6d9 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 07:58:01.093787 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0eb88e-ff6b-43bb-9486-2babf29bd74e service neutron] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:58:01.095219 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-cd0eb88e-ff6b-43bb-9486-2babf29bd74e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:58:01.107825 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0eb88e-ff6b-43bb-9486-2babf29bd74e service neutron] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:58:01.163763 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622af596-4d14-4b79-a8a1-94af2cd853b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:58:01.164391 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622af596-4d14-4b79-a8a1-94af2cd853b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:58:01.164672 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622af596-4d14-4b79-a8a1-94af2cd853b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:58:01.164946 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622af596-4d14-4b79-a8a1-94af2cd853b6 admin admin] PATH_INFO: `/v3/users/7f864048d6c44819837de0a00cda53ff` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:58:01.166100 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622af596-4d14-4b79-a8a1-94af2cd853b6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7f864048d6c44819837de0a00cda53ff)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:58:01.168035 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622af596-4d14-4b79-a8a1-94af2cd853b6 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:58:01.213870 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-622af596-4d14-4b79-a8a1-94af2cd853b6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7f864048d6c44819837de0a00cda53ff'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:58:01.214651 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-622af596-4d14-4b79-a8a1-94af2cd853b6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7f864048d6c44819837de0a00cda53ff'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:58:01.222324 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-622af596-4d14-4b79-a8a1-94af2cd853b6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7f864048d6c44819837de0a00cda53ff'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:58:01.235021 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-622af596-4d14-4b79-a8a1-94af2cd853b6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7f864048d6c44819837de0a00cda53ff'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:58:01.242096 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-622af596-4d14-4b79-a8a1-94af2cd853b6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7f864048d6c44819837de0a00cda53ff'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:58:01.248555 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1280/2578] 10.222.0.57 () {58 vars in 1224 bytes} [Fri Sep 16 07:58:01 2022] DELETE /identity/v3/users/7f864048d6c44819837de0a00cda53ff => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 07:58:01.253109 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b8f3c7-83b3-417d-932e-c39e0299a943 None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:58:01.253563 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b8f3c7-83b3-417d-932e-c39e0299a943 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:58:01.253681 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b8f3c7-83b3-417d-932e-c39e0299a943 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:58:01.268694 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:58:01.274513 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-90b8f3c7-83b3-417d-932e-c39e0299a943 None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:58:01.276221 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-90b8f3c7-83b3-417d-932e-c39e0299a943 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:58:01.337250 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1299/2579] 10.222.0.57 () {58 vars in 958 bytes} [Fri Sep 16 07:58:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 16 07:58:01.347138 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622af596-4d14-4b79-a8a1-94af2cd853b6 admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:58:01.348553 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-622af596-4d14-4b79-a8a1-94af2cd853b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:58:01.363402 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:58:01.408570 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622af596-4d14-4b79-a8a1-94af2cd853b6 admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:58:01.412229 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7296bcab-73b7-48f4-95b4-37998fad598e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1062e457207a41e4ba4f0a0c4bf36f1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4735f453c0c24cc4a1c14e9ac84a0b46', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:58:01.412825 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7296bcab-73b7-48f4-95b4-37998fad598e service neutron] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:58:01.413106 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7296bcab-73b7-48f4-95b4-37998fad598e service neutron] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:58:01.413379 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7296bcab-73b7-48f4-95b4-37998fad598e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:58:01.422798 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7296bcab-73b7-48f4-95b4-37998fad598e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:58:01.424221 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7296bcab-73b7-48f4-95b4-37998fad598e service neutron] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:58:01.433530 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1281/2580] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Sep 16 07:58:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 07:58:01.704127 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b8f3c7-83b3-417d-932e-c39e0299a943 None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:58:01.705742 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-90b8f3c7-83b3-417d-932e-c39e0299a943 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:58:01.719234 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b8f3c7-83b3-417d-932e-c39e0299a943 None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:58:01.723912 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e6480f-63e0-439c-a4e9-077216616144 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:58:01.724677 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e6480f-63e0-439c-a4e9-077216616144 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:58:01.724960 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e6480f-63e0-439c-a4e9-077216616144 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:58:01.725235 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e6480f-63e0-439c-a4e9-077216616144 admin admin] PATH_INFO: `/v3/projects/84083c4f861d4c94af817177c596bf6d` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:58:01.726400 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e6480f-63e0-439c-a4e9-077216616144 admin admin] RBAC: Authorizing `identity:delete_project(project_id=84083c4f861d4c94af817177c596bf6d)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:58:01.728365 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e6480f-63e0-439c-a4e9-077216616144 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:58:01.775102 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-11e6480f-63e0-439c-a4e9-077216616144 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '84083c4f861d4c94af817177c596bf6d', 'request_id': 'req-11e6480f-63e0-439c-a4e9-077216616144'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:58:01.782046 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-11e6480f-63e0-439c-a4e9-077216616144 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '84083c4f861d4c94af817177c596bf6d', 'request_id': 'req-11e6480f-63e0-439c-a4e9-077216616144'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:58:01.789525 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-11e6480f-63e0-439c-a4e9-077216616144 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '84083c4f861d4c94af817177c596bf6d', 'request_id': 'req-11e6480f-63e0-439c-a4e9-077216616144'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:58:01.801327 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-11e6480f-63e0-439c-a4e9-077216616144 admin admin] The token cache is being invalidate because project 84083c4f861d4c94af817177c596bf6d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81431) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 07:58:01.801610 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-11e6480f-63e0-439c-a4e9-077216616144 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:58:01.802263 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-11e6480f-63e0-439c-a4e9-077216616144 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:58:01.803744 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1300/2581] 10.222.0.57 () {58 vars in 1233 bytes} [Fri Sep 16 07:58:01 2022] DELETE /identity/v3/projects/84083c4f861d4c94af817177c596bf6d => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 07:58:01.807893 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7296bcab-73b7-48f4-95b4-37998fad598e service neutron] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:58:01.817808 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7296bcab-73b7-48f4-95b4-37998fad598e service neutron] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:58:01.875565 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ff0e26-39a0-49e6-a1da-654de057401e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:58:01.876108 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ff0e26-39a0-49e6-a1da-654de057401e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:58:01.876382 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ff0e26-39a0-49e6-a1da-654de057401e admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:58:01.876656 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ff0e26-39a0-49e6-a1da-654de057401e admin admin] PATH_INFO: `/v3/users/30a7ed6279f84a698deef582b7fa834e` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:58:01.877774 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ff0e26-39a0-49e6-a1da-654de057401e admin admin] RBAC: Authorizing `identity:delete_user(user_id=30a7ed6279f84a698deef582b7fa834e)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:58:01.879947 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ff0e26-39a0-49e6-a1da-654de057401e admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:58:01.925357 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-97ff0e26-39a0-49e6-a1da-654de057401e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '30a7ed6279f84a698deef582b7fa834e'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:58:01.926016 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-97ff0e26-39a0-49e6-a1da-654de057401e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '30a7ed6279f84a698deef582b7fa834e'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:58:01.932985 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-97ff0e26-39a0-49e6-a1da-654de057401e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '30a7ed6279f84a698deef582b7fa834e'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:58:01.945473 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-97ff0e26-39a0-49e6-a1da-654de057401e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '30a7ed6279f84a698deef582b7fa834e'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:58:01.952977 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-97ff0e26-39a0-49e6-a1da-654de057401e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '30a7ed6279f84a698deef582b7fa834e'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:58:01.958879 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1282/2582] 10.222.0.57 () {58 vars in 1224 bytes} [Fri Sep 16 07:58:01 2022] DELETE /identity/v3/users/30a7ed6279f84a698deef582b7fa834e => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 07:58:02.229399 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e6480f-63e0-439c-a4e9-077216616144 admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:58:02.230951 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-11e6480f-63e0-439c-a4e9-077216616144 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:58:02.245166 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e6480f-63e0-439c-a4e9-077216616144 admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:58:02.302539 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a070e1a0-ca52-42df-b018-9f8933fbc449 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:58:02.303163 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a070e1a0-ca52-42df-b018-9f8933fbc449 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:58:02.303427 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a070e1a0-ca52-42df-b018-9f8933fbc449 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:58:02.303695 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a070e1a0-ca52-42df-b018-9f8933fbc449 admin admin] PATH_INFO: `/v3/projects/f6c95b835b134461a5dfcb55ca585d52` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:58:02.304940 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a070e1a0-ca52-42df-b018-9f8933fbc449 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f6c95b835b134461a5dfcb55ca585d52)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:58:02.306861 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a070e1a0-ca52-42df-b018-9f8933fbc449 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:58:02.341073 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:58:02.354336 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-a070e1a0-ca52-42df-b018-9f8933fbc449 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f6c95b835b134461a5dfcb55ca585d52', 'request_id': 'req-a070e1a0-ca52-42df-b018-9f8933fbc449'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:58:02.360647 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-a070e1a0-ca52-42df-b018-9f8933fbc449 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f6c95b835b134461a5dfcb55ca585d52', 'request_id': 'req-a070e1a0-ca52-42df-b018-9f8933fbc449'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:58:02.367568 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-a070e1a0-ca52-42df-b018-9f8933fbc449 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f6c95b835b134461a5dfcb55ca585d52', 'request_id': 'req-a070e1a0-ca52-42df-b018-9f8933fbc449'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:58:02.378474 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-a070e1a0-ca52-42df-b018-9f8933fbc449 admin admin] The token cache is being invalidate because project f6c95b835b134461a5dfcb55ca585d52 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81431) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 07:58:02.378759 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-a070e1a0-ca52-42df-b018-9f8933fbc449 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:58:02.379397 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-a070e1a0-ca52-42df-b018-9f8933fbc449 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:58:02.380950 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1301/2583] 10.222.0.57 () {58 vars in 1233 bytes} [Fri Sep 16 07:58:02 2022] DELETE /identity/v3/projects/f6c95b835b134461a5dfcb55ca585d52 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 07:58:02.384769 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ff0e26-39a0-49e6-a1da-654de057401e admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:58:02.386289 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-97ff0e26-39a0-49e6-a1da-654de057401e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:58:02.399643 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ff0e26-39a0-49e6-a1da-654de057401e admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:58:02.429671 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:58:02.458227 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838b2c96-e31b-48f1-95b3-9b448b5c60ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:58:02.458851 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838b2c96-e31b-48f1-95b3-9b448b5c60ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:58:02.459129 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838b2c96-e31b-48f1-95b3-9b448b5c60ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:58:02.459401 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838b2c96-e31b-48f1-95b3-9b448b5c60ef admin admin] PATH_INFO: `/v3/users/3cf63faed71d4e98902e0011fd7781bc` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:58:02.460501 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838b2c96-e31b-48f1-95b3-9b448b5c60ef admin admin] RBAC: Authorizing `identity:delete_user(user_id=3cf63faed71d4e98902e0011fd7781bc)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:58:02.462450 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838b2c96-e31b-48f1-95b3-9b448b5c60ef admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:58:02.508806 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-838b2c96-e31b-48f1-95b3-9b448b5c60ef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3cf63faed71d4e98902e0011fd7781bc'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:58:02.509451 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-838b2c96-e31b-48f1-95b3-9b448b5c60ef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3cf63faed71d4e98902e0011fd7781bc'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:58:02.517522 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-838b2c96-e31b-48f1-95b3-9b448b5c60ef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3cf63faed71d4e98902e0011fd7781bc'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:58:02.529674 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-838b2c96-e31b-48f1-95b3-9b448b5c60ef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3cf63faed71d4e98902e0011fd7781bc'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:58:02.536461 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-838b2c96-e31b-48f1-95b3-9b448b5c60ef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3cf63faed71d4e98902e0011fd7781bc'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:58:02.542209 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1283/2584] 10.222.0.57 () {58 vars in 1224 bytes} [Fri Sep 16 07:58:02 2022] DELETE /identity/v3/users/3cf63faed71d4e98902e0011fd7781bc => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 07:58:02.815537 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a070e1a0-ca52-42df-b018-9f8933fbc449 admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:58:02.817127 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-a070e1a0-ca52-42df-b018-9f8933fbc449 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:58:02.830388 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a070e1a0-ca52-42df-b018-9f8933fbc449 admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:58:02.887442 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127efe32-8eef-4324-a75f-2dc237a26e3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:58:02.888094 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127efe32-8eef-4324-a75f-2dc237a26e3a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:58:02.888376 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127efe32-8eef-4324-a75f-2dc237a26e3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:58:02.888645 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127efe32-8eef-4324-a75f-2dc237a26e3a admin admin] PATH_INFO: `/v3/projects/6cea269627974ec2a65d4846b101feae` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:58:02.889775 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127efe32-8eef-4324-a75f-2dc237a26e3a admin admin] RBAC: Authorizing `identity:delete_project(project_id=6cea269627974ec2a65d4846b101feae)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:58:02.891674 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127efe32-8eef-4324-a75f-2dc237a26e3a admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:58:02.939903 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-127efe32-8eef-4324-a75f-2dc237a26e3a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6cea269627974ec2a65d4846b101feae', 'request_id': 'req-127efe32-8eef-4324-a75f-2dc237a26e3a'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:58:02.946116 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-127efe32-8eef-4324-a75f-2dc237a26e3a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6cea269627974ec2a65d4846b101feae', 'request_id': 'req-127efe32-8eef-4324-a75f-2dc237a26e3a'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:58:02.953611 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-127efe32-8eef-4324-a75f-2dc237a26e3a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6cea269627974ec2a65d4846b101feae', 'request_id': 'req-127efe32-8eef-4324-a75f-2dc237a26e3a'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:58:02.963764 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-127efe32-8eef-4324-a75f-2dc237a26e3a admin admin] The token cache is being invalidate because project 6cea269627974ec2a65d4846b101feae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81431) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 07:58:02.964047 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-127efe32-8eef-4324-a75f-2dc237a26e3a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:58:02.964666 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-127efe32-8eef-4324-a75f-2dc237a26e3a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:58:02.966328 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1302/2585] 10.222.0.57 () {58 vars in 1233 bytes} [Fri Sep 16 07:58:02 2022] DELETE /identity/v3/projects/6cea269627974ec2a65d4846b101feae => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 07:58:12.538904 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=38,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:58:12.960743 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=63,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:58:13.562319 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838b2c96-e31b-48f1-95b3-9b448b5c60ef admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:58:13.563765 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-838b2c96-e31b-48f1-95b3-9b448b5c60ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:58:13.646536 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838b2c96-e31b-48f1-95b3-9b448b5c60ef admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:58:13.713164 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ee2f54-286e-4b67-90f4-e2313143b54c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7d4ccdd6ef9400ba9e344df0964da1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4735f453c0c24cc4a1c14e9ac84a0b46', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:58:13.713810 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ee2f54-286e-4b67-90f4-e2313143b54c service placement] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:58:13.714143 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ee2f54-286e-4b67-90f4-e2313143b54c service placement] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:58:13.714340 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ee2f54-286e-4b67-90f4-e2313143b54c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:58:13.716621 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-34ee2f54-286e-4b67-90f4-e2313143b54c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:58:13.730162 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ee2f54-286e-4b67-90f4-e2313143b54c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:58:13.732003 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ee2f54-286e-4b67-90f4-e2313143b54c service placement] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:58:13.743722 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1284/2586] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Sep 16 07:58:13 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 07:58:23.738881 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=58 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:58:34.098245 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd3cc6e-3e2c-4958-a72d-650b96877c4d None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:58:34.098791 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd3cc6e-3e2c-4958-a72d-650b96877c4d None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:58:34.098791 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd3cc6e-3e2c-4958-a72d-650b96877c4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:58:34.124301 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-efd3cc6e-3e2c-4958-a72d-650b96877c4d None None] MFA Rules not processed for user `bb5935d098a241679b2957e8c4742168`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:58:34.125586 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-efd3cc6e-3e2c-4958-a72d-650b96877c4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:58:34.201758 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1303/2587] 10.222.0.57 () {58 vars in 958 bytes} [Fri Sep 16 07:58:34 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 07:58:43.891128 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00eb13ee-ee56-4ab2-8b9c-684764884cb0 None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:58:43.891730 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00eb13ee-ee56-4ab2-8b9c-684764884cb0 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:58:43.891730 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00eb13ee-ee56-4ab2-8b9c-684764884cb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:58:43.915270 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-00eb13ee-ee56-4ab2-8b9c-684764884cb0 None None] MFA Rules not processed for user `c0bb5e7b0e664b3ebbce9f6317b83778`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:58:43.916503 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-00eb13ee-ee56-4ab2-8b9c-684764884cb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:58:43.972596 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1285/2588] 10.222.0.57 () {58 vars in 958 bytes} [Fri Sep 16 07:58:43 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 07:58:44.188677 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=25 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:58:53.965991 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=25 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:59:43.960845 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd3cc6e-3e2c-4958-a72d-650b96877c4d None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:59:43.962434 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-efd3cc6e-3e2c-4958-a72d-650b96877c4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:59:44.037601 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd3cc6e-3e2c-4958-a72d-650b96877c4d None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:59:44.042115 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94319e14-f5b6-436f-a6de-bb86ccaffe3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:59:44.042746 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94319e14-f5b6-436f-a6de-bb86ccaffe3c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:59:44.043020 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94319e14-f5b6-436f-a6de-bb86ccaffe3c admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:59:44.043284 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94319e14-f5b6-436f-a6de-bb86ccaffe3c admin admin] PATH_INFO: `/v3/users/c0bb5e7b0e664b3ebbce9f6317b83778` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:59:44.045014 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94319e14-f5b6-436f-a6de-bb86ccaffe3c admin admin] RBAC: Authorizing `identity:delete_user(user_id=c0bb5e7b0e664b3ebbce9f6317b83778)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:59:44.046981 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94319e14-f5b6-436f-a6de-bb86ccaffe3c admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:59:44.097290 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-94319e14-f5b6-436f-a6de-bb86ccaffe3c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c0bb5e7b0e664b3ebbce9f6317b83778'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:59:44.112645 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-94319e14-f5b6-436f-a6de-bb86ccaffe3c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c0bb5e7b0e664b3ebbce9f6317b83778'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:59:44.113368 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-94319e14-f5b6-436f-a6de-bb86ccaffe3c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c0bb5e7b0e664b3ebbce9f6317b83778'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:59:44.122394 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-94319e14-f5b6-436f-a6de-bb86ccaffe3c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c0bb5e7b0e664b3ebbce9f6317b83778'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:59:44.129599 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-94319e14-f5b6-436f-a6de-bb86ccaffe3c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c0bb5e7b0e664b3ebbce9f6317b83778'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:59:44.135485 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1304/2589] 10.222.0.57 () {58 vars in 1224 bytes} [Fri Sep 16 07:59:43 2022] DELETE /identity/v3/users/c0bb5e7b0e664b3ebbce9f6317b83778 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 07:59:44.317624 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00eb13ee-ee56-4ab2-8b9c-684764884cb0 None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:59:44.330644 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00eb13ee-ee56-4ab2-8b9c-684764884cb0 None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:59:44.411459 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3a1352-8d86-40dc-b99b-1141c9a969ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:59:44.412091 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3a1352-8d86-40dc-b99b-1141c9a969ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:59:44.412369 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3a1352-8d86-40dc-b99b-1141c9a969ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:59:44.412640 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3a1352-8d86-40dc-b99b-1141c9a969ae admin admin] PATH_INFO: `/v3/projects/fee071c93f134d5eb969aed6c2952e90` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:59:44.413874 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3a1352-8d86-40dc-b99b-1141c9a969ae admin admin] RBAC: Authorizing `identity:delete_project(project_id=fee071c93f134d5eb969aed6c2952e90)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:59:44.415885 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3a1352-8d86-40dc-b99b-1141c9a969ae admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:59:44.463588 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-ca3a1352-8d86-40dc-b99b-1141c9a969ae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fee071c93f134d5eb969aed6c2952e90', 'request_id': 'req-ca3a1352-8d86-40dc-b99b-1141c9a969ae'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:59:44.472544 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-ca3a1352-8d86-40dc-b99b-1141c9a969ae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fee071c93f134d5eb969aed6c2952e90', 'request_id': 'req-ca3a1352-8d86-40dc-b99b-1141c9a969ae'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:59:44.478503 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-ca3a1352-8d86-40dc-b99b-1141c9a969ae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fee071c93f134d5eb969aed6c2952e90', 'request_id': 'req-ca3a1352-8d86-40dc-b99b-1141c9a969ae'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:59:44.490965 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-ca3a1352-8d86-40dc-b99b-1141c9a969ae admin admin] The token cache is being invalidate because project fee071c93f134d5eb969aed6c2952e90 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81430) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 07:59:44.491254 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-ca3a1352-8d86-40dc-b99b-1141c9a969ae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:59:44.491910 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-ca3a1352-8d86-40dc-b99b-1141c9a969ae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 07:59:44.493486 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1286/2590] 10.222.0.57 () {58 vars in 1233 bytes} [Fri Sep 16 07:59:44 2022] DELETE /identity/v3/projects/fee071c93f134d5eb969aed6c2952e90 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 07:59:44.498650 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba53a31-dbbd-455b-bdb8-36e86c6305a2 None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:59:44.498936 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba53a31-dbbd-455b-bdb8-36e86c6305a2 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:59:44.499210 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba53a31-dbbd-455b-bdb8-36e86c6305a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:59:44.529703 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-1ba53a31-dbbd-455b-bdb8-36e86c6305a2 None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:59:44.532734 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-1ba53a31-dbbd-455b-bdb8-36e86c6305a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:59:44.601882 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1305/2591] 10.222.0.57 () {58 vars in 958 bytes} [Fri Sep 16 07:59:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 16 07:59:44.606914 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fab0dd-8de8-4500-a1ab-65656dbb38d9 None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:59:44.607208 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fab0dd-8de8-4500-a1ab-65656dbb38d9 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:59:44.607744 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fab0dd-8de8-4500-a1ab-65656dbb38d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:59:44.629106 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-a6fab0dd-8de8-4500-a1ab-65656dbb38d9 None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:59:44.630681 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-a6fab0dd-8de8-4500-a1ab-65656dbb38d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:59:44.642386 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1287/2592] 10.222.0.57 () {58 vars in 958 bytes} [Fri Sep 16 07:59:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 07:59:44.646557 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba53a31-dbbd-455b-bdb8-36e86c6305a2 None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:59:44.657320 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba53a31-dbbd-455b-bdb8-36e86c6305a2 None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:59:44.661973 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387d0d30-08e3-4222-8dd0-7a037fe94378 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:59:44.662572 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387d0d30-08e3-4222-8dd0-7a037fe94378 admin admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:59:44.662846 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387d0d30-08e3-4222-8dd0-7a037fe94378 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:59:44.663139 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387d0d30-08e3-4222-8dd0-7a037fe94378 admin admin] PATH_INFO: `/v3/domains` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:59:44.663769 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387d0d30-08e3-4222-8dd0-7a037fe94378 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 07:59:44.664064 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387d0d30-08e3-4222-8dd0-7a037fe94378 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:59:44.665747 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387d0d30-08e3-4222-8dd0-7a037fe94378 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:59:44.677539 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1306/2593] 10.222.0.57 () {58 vars in 1153 bytes} [Fri Sep 16 07:59:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 07:59:44.681919 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fab0dd-8de8-4500-a1ab-65656dbb38d9 None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:59:44.691678 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fab0dd-8de8-4500-a1ab-65656dbb38d9 None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:59:44.696440 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930379c4-d0c4-4125-96d3-3c85db47188d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:59:44.697042 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930379c4-d0c4-4125-96d3-3c85db47188d admin admin] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:59:44.697323 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930379c4-d0c4-4125-96d3-3c85db47188d admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:59:44.697669 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930379c4-d0c4-4125-96d3-3c85db47188d admin admin] PATH_INFO: `/v3/projects` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:59:44.698355 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930379c4-d0c4-4125-96d3-3c85db47188d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:59:44.700916 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930379c4-d0c4-4125-96d3-3c85db47188d admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:59:44.728547 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1288/2594] 10.222.0.57 () {60 vars in 1153 bytes} [Fri Sep 16 07:59:44 2022] POST /identity/v3/projects => generated 377 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 07:59:44.732284 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387d0d30-08e3-4222-8dd0-7a037fe94378 admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:59:44.742568 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387d0d30-08e3-4222-8dd0-7a037fe94378 admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:59:44.746010 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:59:44.803895 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbec3ad-4683-462a-a097-dcf1892de005 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:59:44.804503 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbec3ad-4683-462a-a097-dcf1892de005 admin admin] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:59:44.804782 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbec3ad-4683-462a-a097-dcf1892de005 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:59:44.805054 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbec3ad-4683-462a-a097-dcf1892de005 admin admin] PATH_INFO: `/v3/users` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:59:44.805685 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbec3ad-4683-462a-a097-dcf1892de005 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:59:44.807642 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbec3ad-4683-462a-a097-dcf1892de005 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:59:44.829925 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1307/2595] 10.222.0.57 () {60 vars in 1144 bytes} [Fri Sep 16 07:59:44 2022] POST /identity/v3/users => generated 289 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 07:59:44.834399 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930379c4-d0c4-4125-96d3-3c85db47188d admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:59:44.846920 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930379c4-d0c4-4125-96d3-3c85db47188d admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:59:44.851716 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b912837-8d39-4aa2-93b3-e79e950ec214 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:59:44.852381 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b912837-8d39-4aa2-93b3-e79e950ec214 admin admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:59:44.852607 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b912837-8d39-4aa2-93b3-e79e950ec214 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:59:44.852910 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b912837-8d39-4aa2-93b3-e79e950ec214 admin admin] PATH_INFO: `/v3/roles` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:59:44.853641 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b912837-8d39-4aa2-93b3-e79e950ec214 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:59:44.855647 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b912837-8d39-4aa2-93b3-e79e950ec214 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:59:44.868011 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1289/2596] 10.222.0.57 () {58 vars in 1122 bytes} [Fri Sep 16 07:59:44 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 07:59:44.872093 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbec3ad-4683-462a-a097-dcf1892de005 admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:59:44.883106 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbec3ad-4683-462a-a097-dcf1892de005 admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:59:44.889104 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefaacf1-1b49-49e3-8e19-32b38986efd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:59:44.889710 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefaacf1-1b49-49e3-8e19-32b38986efd0 admin admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:59:44.890023 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefaacf1-1b49-49e3-8e19-32b38986efd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:59:44.890295 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefaacf1-1b49-49e3-8e19-32b38986efd0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:59:44.891049 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cefaacf1-1b49-49e3-8e19-32b38986efd0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:59:44.892631 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cefaacf1-1b49-49e3-8e19-32b38986efd0 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:59:44.904022 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1308/2597] 10.222.0.57 () {58 vars in 1122 bytes} [Fri Sep 16 07:59:44 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 07:59:44.908256 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b912837-8d39-4aa2-93b3-e79e950ec214 admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:59:44.918692 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b912837-8d39-4aa2-93b3-e79e950ec214 admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:59:44.923738 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9e15e5-6e1a-4bfc-94fd-baa01d3ee3d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:59:44.924378 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9e15e5-6e1a-4bfc-94fd-baa01d3ee3d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:59:44.924659 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9e15e5-6e1a-4bfc-94fd-baa01d3ee3d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:59:44.924929 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9e15e5-6e1a-4bfc-94fd-baa01d3ee3d6 admin admin] PATH_INFO: `/v3/projects/20fd0dabcd434370b3b38bf4f2ed82ce/users/1776184047fd445aae14f8589d9634be/roles/4818d38cf2564825b312e66c9eb24762` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:59:44.939845 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9e15e5-6e1a-4bfc-94fd-baa01d3ee3d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=20fd0dabcd434370b3b38bf4f2ed82ce, user_id=1776184047fd445aae14f8589d9634be, role_id=4818d38cf2564825b312e66c9eb24762)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:59:44.942496 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9e15e5-6e1a-4bfc-94fd-baa01d3ee3d6 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:59:44.956764 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1290/2598] 10.222.0.57 () {60 vars in 1483 bytes} [Fri Sep 16 07:59:44 2022] PUT /identity/v3/projects/20fd0dabcd434370b3b38bf4f2ed82ce/users/1776184047fd445aae14f8589d9634be/roles/4818d38cf2564825b312e66c9eb24762 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 16 07:59:44.961841 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac9978a-b20d-4ad0-b756-32dd2215b97f None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:59:44.962322 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac9978a-b20d-4ad0-b756-32dd2215b97f None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:59:44.962420 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac9978a-b20d-4ad0-b756-32dd2215b97f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:59:44.981347 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-dac9978a-b20d-4ad0-b756-32dd2215b97f None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:59:44.982580 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-dac9978a-b20d-4ad0-b756-32dd2215b97f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:59:45.040228 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1309/2599] 10.222.0.57 () {58 vars in 958 bytes} [Fri Sep 16 07:59:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 16 07:59:45.050245 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9e15e5-6e1a-4bfc-94fd-baa01d3ee3d6 admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:59:45.051937 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-db9e15e5-6e1a-4bfc-94fd-baa01d3ee3d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:59:45.083286 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:59:45.111748 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9e15e5-6e1a-4bfc-94fd-baa01d3ee3d6 admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:59:45.115692 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d39b4a-1d3f-4a25-817d-73eea34abaaa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1062e457207a41e4ba4f0a0c4bf36f1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4735f453c0c24cc4a1c14e9ac84a0b46', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:59:45.116328 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d39b4a-1d3f-4a25-817d-73eea34abaaa service neutron] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:59:45.116610 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d39b4a-1d3f-4a25-817d-73eea34abaaa service neutron] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:59:45.116885 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d39b4a-1d3f-4a25-817d-73eea34abaaa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:59:45.126444 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d39b4a-1d3f-4a25-817d-73eea34abaaa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:59:45.127864 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d39b4a-1d3f-4a25-817d-73eea34abaaa service neutron] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:59:45.138105 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1291/2600] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Sep 16 07:59:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 07:59:46.502030 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c80ead-c8c2-4a2c-a73e-9df3559306d0 None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:59:46.502582 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c80ead-c8c2-4a2c-a73e-9df3559306d0 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:59:46.502788 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c80ead-c8c2-4a2c-a73e-9df3559306d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:59:46.524798 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-03c80ead-c8c2-4a2c-a73e-9df3559306d0 None None] MFA Rules not processed for user `56eb9bbabb65436bb095952159df184c`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:59:46.526419 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-03c80ead-c8c2-4a2c-a73e-9df3559306d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:59:46.592214 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1310/2601] 10.222.0.57 () {58 vars in 1009 bytes} [Fri Sep 16 07:59:46 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 07:59:46.664696 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d39b4a-1d3f-4a25-817d-73eea34abaaa service neutron] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:59:46.666516 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-76d39b4a-1d3f-4a25-817d-73eea34abaaa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:59:46.757656 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d39b4a-1d3f-4a25-817d-73eea34abaaa service neutron] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:59:46.766292 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2515a575-34e7-4340-b084-7b6ec182ea6f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38abb0283b41449d8183b88912f2574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4735f453c0c24cc4a1c14e9ac84a0b46', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:59:46.767148 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2515a575-34e7-4340-b084-7b6ec182ea6f service swift] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:59:46.767620 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2515a575-34e7-4340-b084-7b6ec182ea6f service swift] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:59:46.767949 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2515a575-34e7-4340-b084-7b6ec182ea6f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:59:46.782062 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2515a575-34e7-4340-b084-7b6ec182ea6f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:59:46.783701 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2515a575-34e7-4340-b084-7b6ec182ea6f service swift] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:59:46.797552 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1292/2602] 10.222.0.57 () {60 vars in 1384 bytes} [Fri Sep 16 07:59:46 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 16 07:59:47.671708 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0fca36-4448-441c-a473-4ee056fe7952 None None] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:59:47.672810 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0fca36-4448-441c-a473-4ee056fe7952 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:59:47.673348 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0fca36-4448-441c-a473-4ee056fe7952 None None] PATH_INFO: `/` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:59:47.675846 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1311/2603] 10.222.0.57 () {54 vars in 921 bytes} [Fri Sep 16 07:59:47 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 07:59:47.684096 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd77657f-b857-4d69-82c0-bca4f0bd1177 None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:59:47.684626 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd77657f-b857-4d69-82c0-bca4f0bd1177 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:59:47.684626 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd77657f-b857-4d69-82c0-bca4f0bd1177 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:59:47.707511 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-bd77657f-b857-4d69-82c0-bca4f0bd1177 None None] MFA Rules not processed for user `1062e457207a41e4ba4f0a0c4bf36f1d`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:59:47.709249 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-bd77657f-b857-4d69-82c0-bca4f0bd1177 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:59:47.724998 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1293/2604] 10.222.0.57 () {58 vars in 1018 bytes} [Fri Sep 16 07:59:47 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 07:59:47.752286 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0fca36-4448-441c-a473-4ee056fe7952 None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:59:47.761499 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-7c0fca36-4448-441c-a473-4ee056fe7952 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:59:47.799759 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0fca36-4448-441c-a473-4ee056fe7952 None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:59:47.810528 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3846a9-c303-49f2-a3f9-6b0e3032633c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1062e457207a41e4ba4f0a0c4bf36f1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4735f453c0c24cc4a1c14e9ac84a0b46', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:59:47.811297 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3846a9-c303-49f2-a3f9-6b0e3032633c service neutron] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:59:47.811670 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3846a9-c303-49f2-a3f9-6b0e3032633c service neutron] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:59:47.812058 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3846a9-c303-49f2-a3f9-6b0e3032633c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:59:47.842994 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3846a9-c303-49f2-a3f9-6b0e3032633c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:59:47.844868 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3846a9-c303-49f2-a3f9-6b0e3032633c service neutron] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:59:47.858730 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1312/2605] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Sep 16 07:59:47 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 07:59:48.117606 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c67b86c-5f77-4026-b985-aa401519f12f None None] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:59:48.117916 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c67b86c-5f77-4026-b985-aa401519f12f None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:59:48.118200 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c67b86c-5f77-4026-b985-aa401519f12f None None] PATH_INFO: `/` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:59:48.120408 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1294/2606] 10.222.0.57 () {54 vars in 921 bytes} [Fri Sep 16 07:59:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 07:59:48.126288 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e688ce-6134-420f-b0b9-50a503be24bf None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:59:48.126824 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e688ce-6134-420f-b0b9-50a503be24bf None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:59:48.127290 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e688ce-6134-420f-b0b9-50a503be24bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:59:48.164062 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-68e688ce-6134-420f-b0b9-50a503be24bf None None] MFA Rules not processed for user `9bec4d9b08514461a1bf63c6b88f53b2`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:59:48.166175 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-68e688ce-6134-420f-b0b9-50a503be24bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:59:48.196470 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:59:48.292966 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1313/2607] 10.222.0.57 () {58 vars in 1018 bytes} [Fri Sep 16 07:59:48 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 16 07:59:48.305145 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c67b86c-5f77-4026-b985-aa401519f12f None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:59:48.331711 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c67b86c-5f77-4026-b985-aa401519f12f None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:59:48.336059 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d87d52-a4d9-4ef3-b803-fbb70171a5a0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1062e457207a41e4ba4f0a0c4bf36f1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4735f453c0c24cc4a1c14e9ac84a0b46', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:59:48.336670 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d87d52-a4d9-4ef3-b803-fbb70171a5a0 service neutron] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:59:48.336951 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d87d52-a4d9-4ef3-b803-fbb70171a5a0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:59:48.337223 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d87d52-a4d9-4ef3-b803-fbb70171a5a0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:59:48.364210 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d87d52-a4d9-4ef3-b803-fbb70171a5a0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:59:48.366623 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d87d52-a4d9-4ef3-b803-fbb70171a5a0 service neutron] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:59:48.401674 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1295/2608] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Sep 16 07:59:48 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 07:59:50.944753 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8858ce0c-87e7-428c-abf1-aa38681508ed None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:59:50.945762 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8858ce0c-87e7-428c-abf1-aa38681508ed None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:59:50.946270 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8858ce0c-87e7-428c-abf1-aa38681508ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:59:51.000407 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-8858ce0c-87e7-428c-abf1-aa38681508ed None None] MFA Rules not processed for user `1776184047fd445aae14f8589d9634be`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:59:51.002142 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-8858ce0c-87e7-428c-abf1-aa38681508ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:59:51.110655 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1314/2609] 10.222.0.57 () {58 vars in 958 bytes} [Fri Sep 16 07:59:50 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 07:59:51.125050 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d87d52-a4d9-4ef3-b803-fbb70171a5a0 service neutron] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 07:59:51.126832 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-e5d87d52-a4d9-4ef3-b803-fbb70171a5a0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:59:51.154697 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d87d52-a4d9-4ef3-b803-fbb70171a5a0 service neutron] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 07:59:51.167275 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ec61d5-293a-418e-be47-7c34d030522b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bec4d9b08514461a1bf63c6b88f53b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4735f453c0c24cc4a1c14e9ac84a0b46', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 07:59:51.167894 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ec61d5-293a-418e-be47-7c34d030522b service nova] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:59:51.168964 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ec61d5-293a-418e-be47-7c34d030522b service nova] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:59:51.169249 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ec61d5-293a-418e-be47-7c34d030522b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:59:51.187444 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ec61d5-293a-418e-be47-7c34d030522b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 07:59:51.189999 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ec61d5-293a-418e-be47-7c34d030522b service nova] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 07:59:51.202815 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1296/2610] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Sep 16 07:59:51 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 07:59:53.302962 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4d7ea3-6508-4e8e-b4f5-8b0f88a88a45 None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 07:59:53.303416 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4d7ea3-6508-4e8e-b4f5-8b0f88a88a45 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 07:59:53.304175 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4d7ea3-6508-4e8e-b4f5-8b0f88a88a45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 07:59:53.333151 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-0f4d7ea3-6508-4e8e-b4f5-8b0f88a88a45 None None] MFA Rules not processed for user `1776184047fd445aae14f8589d9634be`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 07:59:53.334714 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-0f4d7ea3-6508-4e8e-b4f5-8b0f88a88a45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 07:59:53.345499 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1315/2611] 10.222.0.57 () {58 vars in 958 bytes} [Fri Sep 16 07:59:53 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 08:00:01.196952 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=61 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 08:00:03.326636 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=58 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 08:00:05.346395 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3ade16-43a5-47f5-b575-865ae502b90b None None] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 08:00:05.346964 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3ade16-43a5-47f5-b575-865ae502b90b None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 08:00:05.347203 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3ade16-43a5-47f5-b575-865ae502b90b None None] PATH_INFO: `/` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 08:00:05.348628 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1297/2612] 10.222.0.57 () {54 vars in 921 bytes} [Fri Sep 16 08:00:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 08:00:05.354461 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9aaed1-f471-4208-ad0a-5f3fc5835fb1 None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 08:00:05.354938 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9aaed1-f471-4208-ad0a-5f3fc5835fb1 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 08:00:05.355203 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9aaed1-f471-4208-ad0a-5f3fc5835fb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 08:00:05.376934 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-4f9aaed1-f471-4208-ad0a-5f3fc5835fb1 None None] MFA Rules not processed for user `9bec4d9b08514461a1bf63c6b88f53b2`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 08:00:05.378295 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-4f9aaed1-f471-4208-ad0a-5f3fc5835fb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 08:00:05.388890 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1316/2613] 10.222.0.57 () {58 vars in 1018 bytes} [Fri Sep 16 08:00:05 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 08:00:05.401031 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3ade16-43a5-47f5-b575-865ae502b90b None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 08:00:05.403987 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-fc3ade16-43a5-47f5-b575-865ae502b90b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 08:00:05.467025 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3ade16-43a5-47f5-b575-865ae502b90b None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 08:00:05.470730 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549b974c-133a-401c-ae17-8395b2ebd9a7 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceecb2c2fe9842e3b228848e00fd11ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4735f453c0c24cc4a1c14e9ac84a0b46', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 08:00:05.471341 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549b974c-133a-401c-ae17-8395b2ebd9a7 service glance] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 08:00:05.471706 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549b974c-133a-401c-ae17-8395b2ebd9a7 service glance] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 08:00:05.471984 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549b974c-133a-401c-ae17-8395b2ebd9a7 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 08:00:05.483112 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549b974c-133a-401c-ae17-8395b2ebd9a7 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 08:00:05.484538 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549b974c-133a-401c-ae17-8395b2ebd9a7 service glance] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 08:00:05.496011 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1298/2614] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Sep 16 08:00:05 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 16 08:00:07.473881 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107c241a-e3f7-4f8e-8691-97d2c5578622 None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 08:00:07.474355 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107c241a-e3f7-4f8e-8691-97d2c5578622 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 08:00:07.474453 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107c241a-e3f7-4f8e-8691-97d2c5578622 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 08:00:07.494554 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-107c241a-e3f7-4f8e-8691-97d2c5578622 None None] MFA Rules not processed for user `56eb9bbabb65436bb095952159df184c`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 08:00:07.495750 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-107c241a-e3f7-4f8e-8691-97d2c5578622 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 08:00:07.504228 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1317/2615] 10.222.0.57 () {58 vars in 1009 bytes} [Fri Sep 16 08:00:07 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 08:00:07.521440 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549b974c-133a-401c-ae17-8395b2ebd9a7 service glance] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 08:00:07.533576 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549b974c-133a-401c-ae17-8395b2ebd9a7 service glance] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 08:00:07.538531 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e28e40-cd1f-4263-b194-efcbcc7a8169 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38abb0283b41449d8183b88912f2574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4735f453c0c24cc4a1c14e9ac84a0b46', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 08:00:07.539154 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e28e40-cd1f-4263-b194-efcbcc7a8169 service swift] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 08:00:07.539569 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e28e40-cd1f-4263-b194-efcbcc7a8169 service swift] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 08:00:07.539845 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e28e40-cd1f-4263-b194-efcbcc7a8169 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 08:00:07.548256 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e28e40-cd1f-4263-b194-efcbcc7a8169 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 08:00:07.549893 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e28e40-cd1f-4263-b194-efcbcc7a8169 service swift] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 08:00:07.559207 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1299/2616] 10.222.0.57 () {60 vars in 1384 bytes} [Fri Sep 16 08:00:07 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 16 08:00:08.040839 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107c241a-e3f7-4f8e-8691-97d2c5578622 None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 08:00:08.055260 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107c241a-e3f7-4f8e-8691-97d2c5578622 None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 08:00:08.060444 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa00dcd-83f8-4583-8bae-17d38961ea63 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1062e457207a41e4ba4f0a0c4bf36f1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4735f453c0c24cc4a1c14e9ac84a0b46', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 08:00:08.061405 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa00dcd-83f8-4583-8bae-17d38961ea63 service neutron] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 08:00:08.062010 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa00dcd-83f8-4583-8bae-17d38961ea63 service neutron] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 08:00:08.062491 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa00dcd-83f8-4583-8bae-17d38961ea63 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 08:00:08.064650 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-9aa00dcd-83f8-4583-8bae-17d38961ea63 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 08:00:08.087982 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa00dcd-83f8-4583-8bae-17d38961ea63 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 08:00:08.090016 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa00dcd-83f8-4583-8bae-17d38961ea63 service neutron] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 08:00:08.104543 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1318/2617] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Sep 16 08:00:08 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 08:00:09.271807 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e28e40-cd1f-4263-b194-efcbcc7a8169 service swift] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 08:00:09.283450 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e28e40-cd1f-4263-b194-efcbcc7a8169 service swift] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 08:00:09.287413 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a507b7f1-ef5b-4d6b-ba51-0536cec32ef2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1062e457207a41e4ba4f0a0c4bf36f1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4735f453c0c24cc4a1c14e9ac84a0b46', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 08:00:09.288286 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a507b7f1-ef5b-4d6b-ba51-0536cec32ef2 service neutron] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 08:00:09.288840 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a507b7f1-ef5b-4d6b-ba51-0536cec32ef2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 08:00:09.289323 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a507b7f1-ef5b-4d6b-ba51-0536cec32ef2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 08:00:09.291406 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-a507b7f1-ef5b-4d6b-ba51-0536cec32ef2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 08:00:09.306510 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a507b7f1-ef5b-4d6b-ba51-0536cec32ef2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 08:00:09.308084 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a507b7f1-ef5b-4d6b-ba51-0536cec32ef2 service neutron] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 08:00:09.321065 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1300/2618] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Sep 16 08:00:09 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 08:00:15.240278 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa00dcd-83f8-4583-8bae-17d38961ea63 service neutron] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 08:00:15.252376 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa00dcd-83f8-4583-8bae-17d38961ea63 service neutron] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 08:00:15.258091 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127c8798-6797-44bc-b5c4-a1b57f53805a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bec4d9b08514461a1bf63c6b88f53b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4735f453c0c24cc4a1c14e9ac84a0b46', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 08:00:15.258696 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127c8798-6797-44bc-b5c4-a1b57f53805a service nova] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 08:00:15.258971 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127c8798-6797-44bc-b5c4-a1b57f53805a service nova] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 08:00:15.259245 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127c8798-6797-44bc-b5c4-a1b57f53805a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 08:00:15.261019 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-127c8798-6797-44bc-b5c4-a1b57f53805a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 08:00:15.338691 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127c8798-6797-44bc-b5c4-a1b57f53805a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 08:00:15.340347 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127c8798-6797-44bc-b5c4-a1b57f53805a service nova] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 08:00:15.350884 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1319/2619] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Sep 16 08:00:15 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 08:00:19.315968 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=38 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 08:00:23.487338 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addad1a3-7b05-4518-b1df-92e7f27c2ffc None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 08:00:23.487907 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addad1a3-7b05-4518-b1df-92e7f27c2ffc None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 08:00:23.487907 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addad1a3-7b05-4518-b1df-92e7f27c2ffc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 08:00:23.507525 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-addad1a3-7b05-4518-b1df-92e7f27c2ffc None None] MFA Rules not processed for user `56eb9bbabb65436bb095952159df184c`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 08:00:23.508713 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-addad1a3-7b05-4518-b1df-92e7f27c2ffc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 08:00:23.515770 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1301/2620] 10.222.0.57 () {58 vars in 967 bytes} [Fri Sep 16 08:00:23 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 08:00:23.528102 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127c8798-6797-44bc-b5c4-a1b57f53805a service nova] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 08:00:23.539107 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127c8798-6797-44bc-b5c4-a1b57f53805a service nova] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 08:00:23.544500 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8035437-f948-4314-8a00-bf60aa0c8ce1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38abb0283b41449d8183b88912f2574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4735f453c0c24cc4a1c14e9ac84a0b46', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 08:00:23.545086 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8035437-f948-4314-8a00-bf60aa0c8ce1 service swift] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 08:00:23.545364 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8035437-f948-4314-8a00-bf60aa0c8ce1 service swift] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 08:00:23.545634 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8035437-f948-4314-8a00-bf60aa0c8ce1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 08:00:23.553360 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8035437-f948-4314-8a00-bf60aa0c8ce1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 08:00:23.555008 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8035437-f948-4314-8a00-bf60aa0c8ce1 service swift] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 08:00:23.562903 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1320/2621] 10.222.0.57 () {60 vars in 1384 bytes} [Fri Sep 16 08:00:23 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 16 08:00:33.502666 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=3 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 08:00:33.559723 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=46 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 08:01:00.208158 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addad1a3-7b05-4518-b1df-92e7f27c2ffc None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 08:01:00.241136 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addad1a3-7b05-4518-b1df-92e7f27c2ffc None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 08:01:00.250067 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ade2f1-86be-48c2-b656-a1a263eb3a46 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bec4d9b08514461a1bf63c6b88f53b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4735f453c0c24cc4a1c14e9ac84a0b46', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 08:01:00.252710 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ade2f1-86be-48c2-b656-a1a263eb3a46 service nova] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 08:01:00.255932 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ade2f1-86be-48c2-b656-a1a263eb3a46 service nova] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 08:01:00.256407 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ade2f1-86be-48c2-b656-a1a263eb3a46 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 08:01:00.259868 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-67ade2f1-86be-48c2-b656-a1a263eb3a46 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 08:01:00.290685 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ade2f1-86be-48c2-b656-a1a263eb3a46 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 08:01:00.293434 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ade2f1-86be-48c2-b656-a1a263eb3a46 service nova] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 08:01:00.312876 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1302/2622] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Sep 16 08:01:00 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 08:01:04.701047 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8035437-f948-4314-8a00-bf60aa0c8ce1 service swift] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 08:01:04.710818 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8035437-f948-4314-8a00-bf60aa0c8ce1 service swift] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 08:01:04.714375 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a092ff-61a0-4892-823e-098b8c2033ea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1062e457207a41e4ba4f0a0c4bf36f1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4735f453c0c24cc4a1c14e9ac84a0b46', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 08:01:04.714995 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a092ff-61a0-4892-823e-098b8c2033ea service neutron] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 08:01:04.715238 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a092ff-61a0-4892-823e-098b8c2033ea service neutron] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 08:01:04.715693 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a092ff-61a0-4892-823e-098b8c2033ea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 08:01:04.717757 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-a1a092ff-61a0-4892-823e-098b8c2033ea service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 08:01:04.727916 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a092ff-61a0-4892-823e-098b8c2033ea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 08:01:04.729332 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a092ff-61a0-4892-823e-098b8c2033ea service neutron] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 08:01:04.740636 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1321/2623] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Sep 16 08:01:04 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 08:01:04.795801 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ade2f1-86be-48c2-b656-a1a263eb3a46 service nova] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 08:01:04.805910 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ade2f1-86be-48c2-b656-a1a263eb3a46 service nova] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 08:01:04.809506 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3a96f7-5426-47f9-8f94-dfd515006652 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1062e457207a41e4ba4f0a0c4bf36f1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4735f453c0c24cc4a1c14e9ac84a0b46', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 08:01:04.810129 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3a96f7-5426-47f9-8f94-dfd515006652 service neutron] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 08:01:04.810410 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3a96f7-5426-47f9-8f94-dfd515006652 service neutron] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 08:01:04.810683 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3a96f7-5426-47f9-8f94-dfd515006652 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 08:01:04.812389 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-4e3a96f7-5426-47f9-8f94-dfd515006652 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 08:01:04.825053 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3a96f7-5426-47f9-8f94-dfd515006652 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 08:01:04.827747 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3a96f7-5426-47f9-8f94-dfd515006652 service neutron] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 08:01:04.837978 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1303/2624] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Sep 16 08:01:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 08:01:08.321360 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a092ff-61a0-4892-823e-098b8c2033ea service neutron] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 08:01:08.322969 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-a1a092ff-61a0-4892-823e-098b8c2033ea service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 08:01:08.343400 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a092ff-61a0-4892-823e-098b8c2033ea service neutron] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 08:01:08.348673 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f51dff-388e-4e77-9f69-ee5c506eb296 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 08:01:08.349304 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f51dff-388e-4e77-9f69-ee5c506eb296 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 08:01:08.349579 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f51dff-388e-4e77-9f69-ee5c506eb296 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 08:01:08.349879 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f51dff-388e-4e77-9f69-ee5c506eb296 admin admin] PATH_INFO: `/v3/users/bb5935d098a241679b2957e8c4742168` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 08:01:08.351016 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f51dff-388e-4e77-9f69-ee5c506eb296 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bb5935d098a241679b2957e8c4742168)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 08:01:08.352981 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f51dff-388e-4e77-9f69-ee5c506eb296 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 08:01:08.400639 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-15f51dff-388e-4e77-9f69-ee5c506eb296 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bb5935d098a241679b2957e8c4742168'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 08:01:08.413220 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-15f51dff-388e-4e77-9f69-ee5c506eb296 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bb5935d098a241679b2957e8c4742168'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 08:01:08.413968 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-15f51dff-388e-4e77-9f69-ee5c506eb296 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bb5935d098a241679b2957e8c4742168'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 08:01:08.423129 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-15f51dff-388e-4e77-9f69-ee5c506eb296 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bb5935d098a241679b2957e8c4742168'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 08:01:08.430197 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-15f51dff-388e-4e77-9f69-ee5c506eb296 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bb5935d098a241679b2957e8c4742168'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 08:01:08.435994 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1322/2625] 10.222.0.57 () {58 vars in 1224 bytes} [Fri Sep 16 08:01:08 2022] DELETE /identity/v3/users/bb5935d098a241679b2957e8c4742168 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 08:01:08.606600 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3a96f7-5426-47f9-8f94-dfd515006652 service neutron] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 08:01:08.621806 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3a96f7-5426-47f9-8f94-dfd515006652 service neutron] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 08:01:08.683041 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eaaaf6a-8b8b-45f0-8834-e087f2331a7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 08:01:08.683672 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eaaaf6a-8b8b-45f0-8834-e087f2331a7e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 08:01:08.683954 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eaaaf6a-8b8b-45f0-8834-e087f2331a7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 08:01:08.684236 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eaaaf6a-8b8b-45f0-8834-e087f2331a7e admin admin] PATH_INFO: `/v3/projects/6d0a119c290f48b4b23a50366c36246f` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 08:01:08.685354 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eaaaf6a-8b8b-45f0-8834-e087f2331a7e admin admin] RBAC: Authorizing `identity:delete_project(project_id=6d0a119c290f48b4b23a50366c36246f)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 08:01:08.687285 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eaaaf6a-8b8b-45f0-8834-e087f2331a7e admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 08:01:08.734731 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-9eaaaf6a-8b8b-45f0-8834-e087f2331a7e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6d0a119c290f48b4b23a50366c36246f', 'request_id': 'req-9eaaaf6a-8b8b-45f0-8834-e087f2331a7e'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 08:01:08.743269 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-9eaaaf6a-8b8b-45f0-8834-e087f2331a7e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6d0a119c290f48b4b23a50366c36246f', 'request_id': 'req-9eaaaf6a-8b8b-45f0-8834-e087f2331a7e'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 08:01:08.749127 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-9eaaaf6a-8b8b-45f0-8834-e087f2331a7e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6d0a119c290f48b4b23a50366c36246f', 'request_id': 'req-9eaaaf6a-8b8b-45f0-8834-e087f2331a7e'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 08:01:08.761105 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-9eaaaf6a-8b8b-45f0-8834-e087f2331a7e admin admin] The token cache is being invalidate because project 6d0a119c290f48b4b23a50366c36246f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81430) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 08:01:08.761386 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-9eaaaf6a-8b8b-45f0-8834-e087f2331a7e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 08:01:08.762084 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-9eaaaf6a-8b8b-45f0-8834-e087f2331a7e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 08:01:08.763562 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1304/2626] 10.222.0.57 () {58 vars in 1233 bytes} [Fri Sep 16 08:01:08 2022] DELETE /identity/v3/projects/6d0a119c290f48b4b23a50366c36246f => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 08:01:08.769514 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c3c7ae-173f-4081-85a5-01a6517a01cd None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 08:01:08.769866 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c3c7ae-173f-4081-85a5-01a6517a01cd None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 08:01:08.770196 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c3c7ae-173f-4081-85a5-01a6517a01cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 08:01:08.789892 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-e8c3c7ae-173f-4081-85a5-01a6517a01cd None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 08:01:08.791031 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-e8c3c7ae-173f-4081-85a5-01a6517a01cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 08:01:08.850496 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1323/2627] 10.222.0.57 () {58 vars in 958 bytes} [Fri Sep 16 08:01:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 08:01:08.859758 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46944d2f-dda6-4bd0-bfa2-4de6d05805c7 None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 08:01:08.860043 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46944d2f-dda6-4bd0-bfa2-4de6d05805c7 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 08:01:08.860318 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46944d2f-dda6-4bd0-bfa2-4de6d05805c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 08:01:08.884187 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-46944d2f-dda6-4bd0-bfa2-4de6d05805c7 None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 08:01:08.885649 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-46944d2f-dda6-4bd0-bfa2-4de6d05805c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 08:01:08.894934 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1305/2628] 10.222.0.57 () {58 vars in 958 bytes} [Fri Sep 16 08:01:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 08:01:08.899024 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c3c7ae-173f-4081-85a5-01a6517a01cd None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 08:01:08.908833 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c3c7ae-173f-4081-85a5-01a6517a01cd None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 08:01:08.913508 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047cb2b7-dfc3-41ce-a2d0-fa1bd326154b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 08:01:08.914198 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047cb2b7-dfc3-41ce-a2d0-fa1bd326154b admin admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 08:01:08.914604 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047cb2b7-dfc3-41ce-a2d0-fa1bd326154b admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 08:01:08.914866 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047cb2b7-dfc3-41ce-a2d0-fa1bd326154b admin admin] PATH_INFO: `/v3/domains` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 08:01:08.915610 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047cb2b7-dfc3-41ce-a2d0-fa1bd326154b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 08:01:08.915805 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047cb2b7-dfc3-41ce-a2d0-fa1bd326154b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 08:01:08.917395 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047cb2b7-dfc3-41ce-a2d0-fa1bd326154b admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 08:01:08.929165 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1324/2629] 10.222.0.57 () {58 vars in 1153 bytes} [Fri Sep 16 08:01:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 08:01:08.933855 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46944d2f-dda6-4bd0-bfa2-4de6d05805c7 None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 08:01:08.944054 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46944d2f-dda6-4bd0-bfa2-4de6d05805c7 None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 08:01:08.948711 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c394abf1-008c-44d8-a24d-c613d6a08070 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 08:01:08.949399 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c394abf1-008c-44d8-a24d-c613d6a08070 admin admin] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 08:01:08.949770 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c394abf1-008c-44d8-a24d-c613d6a08070 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 08:01:08.950051 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c394abf1-008c-44d8-a24d-c613d6a08070 admin admin] PATH_INFO: `/v3/projects` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 08:01:08.950686 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c394abf1-008c-44d8-a24d-c613d6a08070 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 08:01:08.952561 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c394abf1-008c-44d8-a24d-c613d6a08070 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 08:01:08.981035 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1306/2630] 10.222.0.57 () {60 vars in 1153 bytes} [Fri Sep 16 08:01:08 2022] POST /identity/v3/projects => generated 375 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 08:01:08.985444 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047cb2b7-dfc3-41ce-a2d0-fa1bd326154b admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 08:01:08.995882 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047cb2b7-dfc3-41ce-a2d0-fa1bd326154b admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 08:01:09.043010 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 08:01:09.058733 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf8d7da-5673-4f76-81ba-297077482503 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 08:01:09.059331 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf8d7da-5673-4f76-81ba-297077482503 admin admin] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 08:01:09.059608 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf8d7da-5673-4f76-81ba-297077482503 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 08:01:09.059876 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf8d7da-5673-4f76-81ba-297077482503 admin admin] PATH_INFO: `/v3/users` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 08:01:09.060508 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf8d7da-5673-4f76-81ba-297077482503 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 08:01:09.062447 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf8d7da-5673-4f76-81ba-297077482503 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 08:01:09.083690 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1325/2631] 10.222.0.57 () {60 vars in 1144 bytes} [Fri Sep 16 08:01:08 2022] POST /identity/v3/users => generated 288 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 08:01:09.087995 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c394abf1-008c-44d8-a24d-c613d6a08070 admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 08:01:09.098683 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c394abf1-008c-44d8-a24d-c613d6a08070 admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 08:01:09.103350 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12187030-3d23-463b-8859-473a1056f6a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 08:01:09.103961 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12187030-3d23-463b-8859-473a1056f6a6 admin admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 08:01:09.104243 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12187030-3d23-463b-8859-473a1056f6a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 08:01:09.104572 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12187030-3d23-463b-8859-473a1056f6a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 08:01:09.105287 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12187030-3d23-463b-8859-473a1056f6a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 08:01:09.107213 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12187030-3d23-463b-8859-473a1056f6a6 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 08:01:09.118689 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1307/2632] 10.222.0.57 () {58 vars in 1122 bytes} [Fri Sep 16 08:01:09 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 16 08:01:09.122672 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf8d7da-5673-4f76-81ba-297077482503 admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 08:01:09.133583 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf8d7da-5673-4f76-81ba-297077482503 admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 08:01:09.138254 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb0e4ff-b778-4853-b46e-407fb6fb7eff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 08:01:09.138847 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb0e4ff-b778-4853-b46e-407fb6fb7eff admin admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 08:01:09.139128 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb0e4ff-b778-4853-b46e-407fb6fb7eff admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 08:01:09.139400 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb0e4ff-b778-4853-b46e-407fb6fb7eff admin admin] PATH_INFO: `/v3/roles` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 08:01:09.140060 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb0e4ff-b778-4853-b46e-407fb6fb7eff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 08:01:09.141641 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb0e4ff-b778-4853-b46e-407fb6fb7eff admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 08:01:09.152421 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1326/2633] 10.222.0.57 () {58 vars in 1122 bytes} [Fri Sep 16 08:01:09 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 08:01:09.156471 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12187030-3d23-463b-8859-473a1056f6a6 admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 08:01:09.166351 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12187030-3d23-463b-8859-473a1056f6a6 admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 08:01:09.170939 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be576b66-b0b2-44a9-8e60-b2fe49c55067 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 08:01:09.171584 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be576b66-b0b2-44a9-8e60-b2fe49c55067 admin admin] REQUEST_METHOD: `PUT` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 08:01:09.171863 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be576b66-b0b2-44a9-8e60-b2fe49c55067 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 08:01:09.172137 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be576b66-b0b2-44a9-8e60-b2fe49c55067 admin admin] PATH_INFO: `/v3/projects/8650b5220dfb4651a22e2fd639802688/users/8ff6dad47b94495f8adcb13da9665c87/roles/4818d38cf2564825b312e66c9eb24762` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 08:01:09.187245 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be576b66-b0b2-44a9-8e60-b2fe49c55067 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8650b5220dfb4651a22e2fd639802688, user_id=8ff6dad47b94495f8adcb13da9665c87, role_id=4818d38cf2564825b312e66c9eb24762)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 08:01:09.190009 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be576b66-b0b2-44a9-8e60-b2fe49c55067 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 08:01:09.199212 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 08:01:09.205010 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1308/2634] 10.222.0.57 () {60 vars in 1483 bytes} [Fri Sep 16 08:01:09 2022] PUT /identity/v3/projects/8650b5220dfb4651a22e2fd639802688/users/8ff6dad47b94495f8adcb13da9665c87/roles/4818d38cf2564825b312e66c9eb24762 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 08:01:09.215587 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e41e32-c398-489b-9df6-61a91648208a None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 08:01:09.215874 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e41e32-c398-489b-9df6-61a91648208a None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 08:01:09.216144 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e41e32-c398-489b-9df6-61a91648208a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 08:01:09.244035 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-e8e41e32-c398-489b-9df6-61a91648208a None None] MFA Rules not processed for user `8ff6dad47b94495f8adcb13da9665c87`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 08:01:09.245240 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-e8e41e32-c398-489b-9df6-61a91648208a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 08:01:09.307572 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1327/2635] 10.222.0.57 () {58 vars in 958 bytes} [Fri Sep 16 08:01:09 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 08:01:09.334456 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be576b66-b0b2-44a9-8e60-b2fe49c55067 admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 08:01:09.336290 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-be576b66-b0b2-44a9-8e60-b2fe49c55067 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 08:01:09.409892 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be576b66-b0b2-44a9-8e60-b2fe49c55067 admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 08:01:09.415466 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440d7c99-3928-4171-8591-79b8e86ee71f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bec4d9b08514461a1bf63c6b88f53b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4735f453c0c24cc4a1c14e9ac84a0b46', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 08:01:09.416085 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440d7c99-3928-4171-8591-79b8e86ee71f service nova] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 08:01:09.416371 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440d7c99-3928-4171-8591-79b8e86ee71f service nova] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 08:01:09.416650 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440d7c99-3928-4171-8591-79b8e86ee71f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 08:01:09.425269 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440d7c99-3928-4171-8591-79b8e86ee71f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 08:01:09.426868 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440d7c99-3928-4171-8591-79b8e86ee71f service nova] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 08:01:09.435652 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1309/2636] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Sep 16 08:01:09 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 08:01:09.648924 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e41e32-c398-489b-9df6-61a91648208a None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 08:01:09.709901 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e41e32-c398-489b-9df6-61a91648208a None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 08:01:09.714359 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a554716e-6c48-4d36-9f60-080f83479150 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 08:01:09.714975 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a554716e-6c48-4d36-9f60-080f83479150 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 08:01:09.715252 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a554716e-6c48-4d36-9f60-080f83479150 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 08:01:09.715522 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a554716e-6c48-4d36-9f60-080f83479150 admin admin] PATH_INFO: `/v3/users/8ff6dad47b94495f8adcb13da9665c87` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 08:01:09.716623 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a554716e-6c48-4d36-9f60-080f83479150 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8ff6dad47b94495f8adcb13da9665c87)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 08:01:09.718561 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a554716e-6c48-4d36-9f60-080f83479150 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 08:01:09.764614 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-a554716e-6c48-4d36-9f60-080f83479150 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8ff6dad47b94495f8adcb13da9665c87'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 08:01:09.771980 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=89,keystone:INSERT=3,keystone:DELETE=8 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 08:01:09.778956 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-a554716e-6c48-4d36-9f60-080f83479150 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8ff6dad47b94495f8adcb13da9665c87'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 08:01:09.779776 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-a554716e-6c48-4d36-9f60-080f83479150 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8ff6dad47b94495f8adcb13da9665c87'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 08:01:09.787986 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-a554716e-6c48-4d36-9f60-080f83479150 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8ff6dad47b94495f8adcb13da9665c87'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 08:01:09.794881 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-a554716e-6c48-4d36-9f60-080f83479150 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8ff6dad47b94495f8adcb13da9665c87'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 08:01:09.801373 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1328/2637] 10.222.0.57 () {58 vars in 1224 bytes} [Fri Sep 16 08:01:09 2022] DELETE /identity/v3/users/8ff6dad47b94495f8adcb13da9665c87 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 08:01:09.805909 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316fbb8a-a19f-4b0a-8833-308c6ee5466e None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 08:01:09.806395 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316fbb8a-a19f-4b0a-8833-308c6ee5466e None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 08:01:09.806506 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316fbb8a-a19f-4b0a-8833-308c6ee5466e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 08:01:09.825085 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-316fbb8a-a19f-4b0a-8833-308c6ee5466e None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 08:01:09.826238 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-316fbb8a-a19f-4b0a-8833-308c6ee5466e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 08:01:09.886826 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1310/2638] 10.222.0.57 () {58 vars in 958 bytes} [Fri Sep 16 08:01:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 08:01:09.897066 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a554716e-6c48-4d36-9f60-080f83479150 admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 08:01:09.898467 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-a554716e-6c48-4d36-9f60-080f83479150 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 08:01:09.957849 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a554716e-6c48-4d36-9f60-080f83479150 admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 08:01:09.961503 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e25d24-c023-497f-83d9-de33409b5f86 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1062e457207a41e4ba4f0a0c4bf36f1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4735f453c0c24cc4a1c14e9ac84a0b46', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 08:01:09.962151 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e25d24-c023-497f-83d9-de33409b5f86 service neutron] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 08:01:09.962427 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e25d24-c023-497f-83d9-de33409b5f86 service neutron] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 08:01:09.962696 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e25d24-c023-497f-83d9-de33409b5f86 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 08:01:09.972723 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e25d24-c023-497f-83d9-de33409b5f86 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 08:01:09.974191 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e25d24-c023-497f-83d9-de33409b5f86 service neutron] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 08:01:09.983673 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1329/2639] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Sep 16 08:01:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 08:01:10.247201 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316fbb8a-a19f-4b0a-8833-308c6ee5466e None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 08:01:10.248630 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-316fbb8a-a19f-4b0a-8833-308c6ee5466e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 08:01:10.262325 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316fbb8a-a19f-4b0a-8833-308c6ee5466e None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 08:01:10.266962 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a03f4d2-3a75-45e4-b13f-575cbd5bbba5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 08:01:10.267597 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a03f4d2-3a75-45e4-b13f-575cbd5bbba5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 08:01:10.267904 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a03f4d2-3a75-45e4-b13f-575cbd5bbba5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 08:01:10.268767 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a03f4d2-3a75-45e4-b13f-575cbd5bbba5 admin admin] PATH_INFO: `/v3/projects/8650b5220dfb4651a22e2fd639802688` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 08:01:10.270022 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a03f4d2-3a75-45e4-b13f-575cbd5bbba5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8650b5220dfb4651a22e2fd639802688)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 08:01:10.272035 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a03f4d2-3a75-45e4-b13f-575cbd5bbba5 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 08:01:10.320250 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-3a03f4d2-3a75-45e4-b13f-575cbd5bbba5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8650b5220dfb4651a22e2fd639802688', 'request_id': 'req-3a03f4d2-3a75-45e4-b13f-575cbd5bbba5'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 08:01:10.327868 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-3a03f4d2-3a75-45e4-b13f-575cbd5bbba5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8650b5220dfb4651a22e2fd639802688', 'request_id': 'req-3a03f4d2-3a75-45e4-b13f-575cbd5bbba5'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 08:01:10.334520 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-3a03f4d2-3a75-45e4-b13f-575cbd5bbba5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8650b5220dfb4651a22e2fd639802688', 'request_id': 'req-3a03f4d2-3a75-45e4-b13f-575cbd5bbba5'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 08:01:10.345416 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-3a03f4d2-3a75-45e4-b13f-575cbd5bbba5 admin admin] The token cache is being invalidate because project 8650b5220dfb4651a22e2fd639802688 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81430) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 08:01:10.345745 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-3a03f4d2-3a75-45e4-b13f-575cbd5bbba5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 08:01:10.347100 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-3a03f4d2-3a75-45e4-b13f-575cbd5bbba5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 08:01:10.348759 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1311/2640] 10.222.0.57 () {58 vars in 1233 bytes} [Fri Sep 16 08:01:10 2022] DELETE /identity/v3/projects/8650b5220dfb4651a22e2fd639802688 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 08:01:10.353621 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2f7d08-afdf-44a9-810d-b4d7a9bed5d2 None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 08:01:10.353934 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2f7d08-afdf-44a9-810d-b4d7a9bed5d2 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 08:01:10.354210 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2f7d08-afdf-44a9-810d-b4d7a9bed5d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 08:01:10.374881 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-be2f7d08-afdf-44a9-810d-b4d7a9bed5d2 None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 08:01:10.376067 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-be2f7d08-afdf-44a9-810d-b4d7a9bed5d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 08:01:10.437542 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1330/2641] 10.222.0.57 () {58 vars in 958 bytes} [Fri Sep 16 08:01:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 08:01:10.445541 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe9769a-0816-4480-9f45-28ebcaf6b183 None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 08:01:10.445890 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe9769a-0816-4480-9f45-28ebcaf6b183 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 08:01:10.446147 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe9769a-0816-4480-9f45-28ebcaf6b183 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 08:01:10.465611 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-dbe9769a-0816-4480-9f45-28ebcaf6b183 None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 08:01:10.466836 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-dbe9769a-0816-4480-9f45-28ebcaf6b183 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 08:01:10.475165 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1312/2642] 10.222.0.57 () {58 vars in 958 bytes} [Fri Sep 16 08:01:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 08:01:10.479301 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2f7d08-afdf-44a9-810d-b4d7a9bed5d2 None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 08:01:10.491505 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2f7d08-afdf-44a9-810d-b4d7a9bed5d2 None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 08:01:10.496046 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61dc53c-366d-45f7-9c40-d4fccfc7f982 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 08:01:10.496616 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61dc53c-366d-45f7-9c40-d4fccfc7f982 admin admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 08:01:10.496891 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61dc53c-366d-45f7-9c40-d4fccfc7f982 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 08:01:10.497157 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61dc53c-366d-45f7-9c40-d4fccfc7f982 admin admin] PATH_INFO: `/v3/domains` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 08:01:10.497821 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61dc53c-366d-45f7-9c40-d4fccfc7f982 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 08:01:10.498118 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61dc53c-366d-45f7-9c40-d4fccfc7f982 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 08:01:10.499693 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61dc53c-366d-45f7-9c40-d4fccfc7f982 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 08:01:10.511359 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1331/2643] 10.222.0.57 () {58 vars in 1153 bytes} [Fri Sep 16 08:01:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 08:01:10.515840 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe9769a-0816-4480-9f45-28ebcaf6b183 None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 08:01:10.520847 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 08:01:10.527165 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe9769a-0816-4480-9f45-28ebcaf6b183 None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 08:01:10.532629 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71565d5d-34ca-47b7-b868-b3ce55ec5d16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 08:01:10.533249 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71565d5d-34ca-47b7-b868-b3ce55ec5d16 admin admin] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 08:01:10.533523 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71565d5d-34ca-47b7-b868-b3ce55ec5d16 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 08:01:10.534553 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71565d5d-34ca-47b7-b868-b3ce55ec5d16 admin admin] PATH_INFO: `/v3/projects` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 08:01:10.535227 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71565d5d-34ca-47b7-b868-b3ce55ec5d16 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 08:01:10.537102 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71565d5d-34ca-47b7-b868-b3ce55ec5d16 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 08:01:10.563352 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1313/2644] 10.222.0.57 () {60 vars in 1153 bytes} [Fri Sep 16 08:01:10 2022] POST /identity/v3/projects => generated 363 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 08:01:10.567667 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61dc53c-366d-45f7-9c40-d4fccfc7f982 admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 08:01:10.577538 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61dc53c-366d-45f7-9c40-d4fccfc7f982 admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 08:01:10.632238 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fd802a-d5b1-46e5-87a4-d33d84d63ff8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 08:01:10.632835 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fd802a-d5b1-46e5-87a4-d33d84d63ff8 admin admin] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 08:01:10.633110 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fd802a-d5b1-46e5-87a4-d33d84d63ff8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 08:01:10.633379 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fd802a-d5b1-46e5-87a4-d33d84d63ff8 admin admin] PATH_INFO: `/v3/users` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 08:01:10.634033 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63fd802a-d5b1-46e5-87a4-d33d84d63ff8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 08:01:10.635948 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63fd802a-d5b1-46e5-87a4-d33d84d63ff8 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 08:01:10.646288 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 08:01:10.658344 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1332/2645] 10.222.0.57 () {60 vars in 1144 bytes} [Fri Sep 16 08:01:10 2022] POST /identity/v3/users => generated 282 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 16 08:01:10.663024 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71565d5d-34ca-47b7-b868-b3ce55ec5d16 admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 08:01:10.673342 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71565d5d-34ca-47b7-b868-b3ce55ec5d16 admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 08:01:10.678146 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446669f8-0738-4fa4-ac82-593065ac9f5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 08:01:10.678737 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446669f8-0738-4fa4-ac82-593065ac9f5b admin admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 08:01:10.679034 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446669f8-0738-4fa4-ac82-593065ac9f5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 08:01:10.679306 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446669f8-0738-4fa4-ac82-593065ac9f5b admin admin] PATH_INFO: `/v3/roles` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 08:01:10.679975 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446669f8-0738-4fa4-ac82-593065ac9f5b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 08:01:10.681553 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446669f8-0738-4fa4-ac82-593065ac9f5b admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 08:01:10.691445 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1314/2646] 10.222.0.57 () {58 vars in 1122 bytes} [Fri Sep 16 08:01:10 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 08:01:10.695108 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fd802a-d5b1-46e5-87a4-d33d84d63ff8 admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 08:01:10.704922 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fd802a-d5b1-46e5-87a4-d33d84d63ff8 admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 08:01:10.710057 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a875b6-bd53-43f3-aeb7-71b5ef4189e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 08:01:10.710640 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a875b6-bd53-43f3-aeb7-71b5ef4189e3 admin admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 08:01:10.710915 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a875b6-bd53-43f3-aeb7-71b5ef4189e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 08:01:10.711182 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a875b6-bd53-43f3-aeb7-71b5ef4189e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 08:01:10.711803 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a875b6-bd53-43f3-aeb7-71b5ef4189e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 08:01:10.713400 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a875b6-bd53-43f3-aeb7-71b5ef4189e3 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 08:01:10.724285 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1333/2647] 10.222.0.57 () {58 vars in 1122 bytes} [Fri Sep 16 08:01:10 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 08:01:10.728380 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446669f8-0738-4fa4-ac82-593065ac9f5b admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 08:01:10.738717 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446669f8-0738-4fa4-ac82-593065ac9f5b admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 08:01:10.743314 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b3017e-5d93-4323-b19d-c694ad472246 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 08:01:10.743954 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b3017e-5d93-4323-b19d-c694ad472246 admin admin] REQUEST_METHOD: `PUT` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 08:01:10.744237 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b3017e-5d93-4323-b19d-c694ad472246 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 08:01:10.744544 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b3017e-5d93-4323-b19d-c694ad472246 admin admin] PATH_INFO: `/v3/projects/b3a14fdcdd7e419fb1ce41cf20c72a10/users/7d413bc6b1f840efad1ba0518b466f92/roles/4818d38cf2564825b312e66c9eb24762` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 08:01:10.759166 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b3017e-5d93-4323-b19d-c694ad472246 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b3a14fdcdd7e419fb1ce41cf20c72a10, user_id=7d413bc6b1f840efad1ba0518b466f92, role_id=4818d38cf2564825b312e66c9eb24762)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 08:01:10.761838 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b3017e-5d93-4323-b19d-c694ad472246 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 08:01:10.775001 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1315/2648] 10.222.0.57 () {60 vars in 1483 bytes} [Fri Sep 16 08:01:10 2022] PUT /identity/v3/projects/b3a14fdcdd7e419fb1ce41cf20c72a10/users/7d413bc6b1f840efad1ba0518b466f92/roles/4818d38cf2564825b312e66c9eb24762 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 08:01:10.787007 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a5033c-a186-4eaf-9798-ac1d803b2d7e None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 08:01:10.787297 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a5033c-a186-4eaf-9798-ac1d803b2d7e None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 08:01:10.787599 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a5033c-a186-4eaf-9798-ac1d803b2d7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 08:01:10.816199 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-b7a5033c-a186-4eaf-9798-ac1d803b2d7e None None] MFA Rules not processed for user `7d413bc6b1f840efad1ba0518b466f92`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 08:01:10.817411 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-b7a5033c-a186-4eaf-9798-ac1d803b2d7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 08:01:10.883914 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1334/2649] 10.222.0.57 () {58 vars in 958 bytes} [Fri Sep 16 08:01:10 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 08:01:10.888338 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b3017e-5d93-4323-b19d-c694ad472246 admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 08:01:10.949714 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b3017e-5d93-4323-b19d-c694ad472246 admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 08:01:10.954296 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6bca55-5171-4116-b1c6-51db006b8e27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 08:01:10.954890 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6bca55-5171-4116-b1c6-51db006b8e27 admin admin] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 08:01:10.955165 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6bca55-5171-4116-b1c6-51db006b8e27 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 08:01:10.955461 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6bca55-5171-4116-b1c6-51db006b8e27 admin admin] PATH_INFO: `/v3/projects` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 08:01:10.956750 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6bca55-5171-4116-b1c6-51db006b8e27 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 08:01:10.958678 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6bca55-5171-4116-b1c6-51db006b8e27 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 08:01:10.984806 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1316/2650] 10.222.0.57 () {60 vars in 1153 bytes} [Fri Sep 16 08:01:10 2022] POST /identity/v3/projects => generated 363 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 08:01:10.989031 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a5033c-a186-4eaf-9798-ac1d803b2d7e None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 08:01:11.000188 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a5033c-a186-4eaf-9798-ac1d803b2d7e None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 08:01:11.055614 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8730a7a4-1d8a-4b63-9ae0-0c767c29a36a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 08:01:11.056209 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8730a7a4-1d8a-4b63-9ae0-0c767c29a36a admin admin] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 08:01:11.056481 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8730a7a4-1d8a-4b63-9ae0-0c767c29a36a admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 08:01:11.056748 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8730a7a4-1d8a-4b63-9ae0-0c767c29a36a admin admin] PATH_INFO: `/v3/users` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 08:01:11.057370 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8730a7a4-1d8a-4b63-9ae0-0c767c29a36a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 08:01:11.059287 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8730a7a4-1d8a-4b63-9ae0-0c767c29a36a admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 08:01:11.085355 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1335/2651] 10.222.0.57 () {60 vars in 1144 bytes} [Fri Sep 16 08:01:10 2022] POST /identity/v3/users => generated 288 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 16 08:01:11.086415 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6bca55-5171-4116-b1c6-51db006b8e27 admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 08:01:11.096864 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6bca55-5171-4116-b1c6-51db006b8e27 admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 08:01:11.102117 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0dabb52-dfd2-45e4-a5b4-e2f14a542496 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 08:01:11.102708 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dabb52-dfd2-45e4-a5b4-e2f14a542496 admin admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 08:01:11.102984 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dabb52-dfd2-45e4-a5b4-e2f14a542496 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 08:01:11.103250 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dabb52-dfd2-45e4-a5b4-e2f14a542496 admin admin] PATH_INFO: `/v3/roles` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 08:01:11.103882 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0dabb52-dfd2-45e4-a5b4-e2f14a542496 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 08:01:11.105453 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0dabb52-dfd2-45e4-a5b4-e2f14a542496 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 08:01:11.116636 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1317/2652] 10.222.0.57 () {58 vars in 1122 bytes} [Fri Sep 16 08:01:11 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 08:01:11.120877 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8730a7a4-1d8a-4b63-9ae0-0c767c29a36a admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 08:01:11.131277 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8730a7a4-1d8a-4b63-9ae0-0c767c29a36a admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 08:01:11.136045 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2ce8d9-44b7-4a35-ac6c-2bd6c6877d42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 08:01:11.136633 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2ce8d9-44b7-4a35-ac6c-2bd6c6877d42 admin admin] REQUEST_METHOD: `PUT` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 08:01:11.136909 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2ce8d9-44b7-4a35-ac6c-2bd6c6877d42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 08:01:11.137182 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2ce8d9-44b7-4a35-ac6c-2bd6c6877d42 admin admin] PATH_INFO: `/v3/projects/b2028a1669184642b3adb8efb7ca9ee3/users/e5de8296275b4e31be7c2e5a3d7cc6b9/roles/567db03c91854ad9af1e9a87ec1bd275` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 08:01:11.152179 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2ce8d9-44b7-4a35-ac6c-2bd6c6877d42 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b2028a1669184642b3adb8efb7ca9ee3, user_id=e5de8296275b4e31be7c2e5a3d7cc6b9, role_id=567db03c91854ad9af1e9a87ec1bd275)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 08:01:11.154865 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2ce8d9-44b7-4a35-ac6c-2bd6c6877d42 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 08:01:11.168125 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1336/2653] 10.222.0.57 () {60 vars in 1483 bytes} [Fri Sep 16 08:01:11 2022] PUT /identity/v3/projects/b2028a1669184642b3adb8efb7ca9ee3/users/e5de8296275b4e31be7c2e5a3d7cc6b9/roles/567db03c91854ad9af1e9a87ec1bd275 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 16 08:01:11.172072 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0dabb52-dfd2-45e4-a5b4-e2f14a542496 admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 08:01:11.181978 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0dabb52-dfd2-45e4-a5b4-e2f14a542496 admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 08:01:11.237662 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f5c8d4-f2db-427f-afde-311d4837078c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 08:01:11.238284 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f5c8d4-f2db-427f-afde-311d4837078c admin admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 08:01:11.238563 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f5c8d4-f2db-427f-afde-311d4837078c admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 08:01:11.238834 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f5c8d4-f2db-427f-afde-311d4837078c admin admin] PATH_INFO: `/v3/roles` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 08:01:11.239465 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f5c8d4-f2db-427f-afde-311d4837078c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 08:01:11.241056 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f5c8d4-f2db-427f-afde-311d4837078c admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 08:01:11.250559 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1318/2654] 10.222.0.57 () {58 vars in 1122 bytes} [Fri Sep 16 08:01:11 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 08:01:11.255270 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2ce8d9-44b7-4a35-ac6c-2bd6c6877d42 admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 08:01:11.265330 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2ce8d9-44b7-4a35-ac6c-2bd6c6877d42 admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 08:01:11.270512 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1061ef3-a675-448f-b9f7-1587da23cc1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 08:01:11.271148 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1061ef3-a675-448f-b9f7-1587da23cc1a admin admin] REQUEST_METHOD: `PUT` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 08:01:11.271421 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1061ef3-a675-448f-b9f7-1587da23cc1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 08:01:11.271685 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1061ef3-a675-448f-b9f7-1587da23cc1a admin admin] PATH_INFO: `/v3/projects/b2028a1669184642b3adb8efb7ca9ee3/users/e5de8296275b4e31be7c2e5a3d7cc6b9/roles/567db03c91854ad9af1e9a87ec1bd275` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 08:01:11.273540 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1061ef3-a675-448f-b9f7-1587da23cc1a admin admin] RBAC: Authorizing `identity:create_grant(project_id=b2028a1669184642b3adb8efb7ca9ee3, user_id=e5de8296275b4e31be7c2e5a3d7cc6b9, role_id=567db03c91854ad9af1e9a87ec1bd275)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 08:01:11.276199 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1061ef3-a675-448f-b9f7-1587da23cc1a admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 08:01:11.286182 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1337/2655] 10.222.0.57 () {60 vars in 1483 bytes} [Fri Sep 16 08:01:11 2022] PUT /identity/v3/projects/b2028a1669184642b3adb8efb7ca9ee3/users/e5de8296275b4e31be7c2e5a3d7cc6b9/roles/567db03c91854ad9af1e9a87ec1bd275 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 08:01:11.295964 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682183e7-bc73-4295-8e90-a8555bbdc14d None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 08:01:11.296256 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682183e7-bc73-4295-8e90-a8555bbdc14d None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 08:01:11.296558 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682183e7-bc73-4295-8e90-a8555bbdc14d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 08:01:11.325122 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-682183e7-bc73-4295-8e90-a8555bbdc14d None None] MFA Rules not processed for user `e5de8296275b4e31be7c2e5a3d7cc6b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 08:01:11.326359 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-682183e7-bc73-4295-8e90-a8555bbdc14d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 08:01:11.330279 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 08:01:11.396246 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1319/2656] 10.222.0.57 () {58 vars in 958 bytes} [Fri Sep 16 08:01:11 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 08:01:11.407629 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1061ef3-a675-448f-b9f7-1587da23cc1a admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 08:01:11.409360 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-c1061ef3-a675-448f-b9f7-1587da23cc1a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 08:01:11.436648 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:INSERT=6,keystone:SELECT=94 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 08:01:11.467061 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1061ef3-a675-448f-b9f7-1587da23cc1a admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 08:01:11.470661 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ac3dd1-23d0-4e22-8af5-56de11bc4823 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544bf6be4c24454a013ca110c43cef2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4735f453c0c24cc4a1c14e9ac84a0b46', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 08:01:11.471457 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ac3dd1-23d0-4e22-8af5-56de11bc4823 service cinder] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 08:01:11.471799 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ac3dd1-23d0-4e22-8af5-56de11bc4823 service cinder] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 08:01:11.472070 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ac3dd1-23d0-4e22-8af5-56de11bc4823 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 08:01:11.480872 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ac3dd1-23d0-4e22-8af5-56de11bc4823 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 08:01:11.482313 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ac3dd1-23d0-4e22-8af5-56de11bc4823 service cinder] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 08:01:11.492302 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1338/2657] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Sep 16 08:01:11 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 08:01:11.896578 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682183e7-bc73-4295-8e90-a8555bbdc14d None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 08:01:11.958467 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682183e7-bc73-4295-8e90-a8555bbdc14d None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 08:01:11.962900 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d5e4a3-74ff-443a-8068-98fbbcdf3d9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 08:01:11.963526 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d5e4a3-74ff-443a-8068-98fbbcdf3d9e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 08:01:11.963808 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d5e4a3-74ff-443a-8068-98fbbcdf3d9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 08:01:11.964084 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d5e4a3-74ff-443a-8068-98fbbcdf3d9e admin admin] PATH_INFO: `/v3/users/7d413bc6b1f840efad1ba0518b466f92` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 08:01:11.965197 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d5e4a3-74ff-443a-8068-98fbbcdf3d9e admin admin] RBAC: Authorizing `identity:delete_user(user_id=7d413bc6b1f840efad1ba0518b466f92)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 08:01:11.967141 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d5e4a3-74ff-443a-8068-98fbbcdf3d9e admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 08:01:12.015014 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-b0d5e4a3-74ff-443a-8068-98fbbcdf3d9e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7d413bc6b1f840efad1ba0518b466f92'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 08:01:12.015707 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-b0d5e4a3-74ff-443a-8068-98fbbcdf3d9e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7d413bc6b1f840efad1ba0518b466f92'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 08:01:12.023051 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-b0d5e4a3-74ff-443a-8068-98fbbcdf3d9e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7d413bc6b1f840efad1ba0518b466f92'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 08:01:12.035664 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-b0d5e4a3-74ff-443a-8068-98fbbcdf3d9e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7d413bc6b1f840efad1ba0518b466f92'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 08:01:12.042429 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-b0d5e4a3-74ff-443a-8068-98fbbcdf3d9e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7d413bc6b1f840efad1ba0518b466f92'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 08:01:12.048261 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1320/2658] 10.222.0.57 () {58 vars in 1224 bytes} [Fri Sep 16 08:01:11 2022] DELETE /identity/v3/users/7d413bc6b1f840efad1ba0518b466f92 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 08:01:12.052674 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69a0beb-823b-49ff-9b52-b756997f281f None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 08:01:12.053168 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69a0beb-823b-49ff-9b52-b756997f281f None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 08:01:12.053270 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69a0beb-823b-49ff-9b52-b756997f281f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 08:01:12.071364 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-a69a0beb-823b-49ff-9b52-b756997f281f None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 08:01:12.072547 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-a69a0beb-823b-49ff-9b52-b756997f281f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 08:01:12.132168 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1339/2659] 10.222.0.57 () {58 vars in 958 bytes} [Fri Sep 16 08:01:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 08:01:12.142201 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d5e4a3-74ff-443a-8068-98fbbcdf3d9e admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 08:01:12.144473 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-b0d5e4a3-74ff-443a-8068-98fbbcdf3d9e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 08:01:12.167245 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 08:01:12.204926 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d5e4a3-74ff-443a-8068-98fbbcdf3d9e admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 08:01:12.209382 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea45c80-ac21-434a-be70-63ed9751e059 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1062e457207a41e4ba4f0a0c4bf36f1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4735f453c0c24cc4a1c14e9ac84a0b46', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 08:01:12.210032 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea45c80-ac21-434a-be70-63ed9751e059 service neutron] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 08:01:12.210321 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea45c80-ac21-434a-be70-63ed9751e059 service neutron] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 08:01:12.210596 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea45c80-ac21-434a-be70-63ed9751e059 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 08:01:12.219444 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea45c80-ac21-434a-be70-63ed9751e059 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 08:01:12.220870 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea45c80-ac21-434a-be70-63ed9751e059 service neutron] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 08:01:12.231560 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1321/2660] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Sep 16 08:01:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 08:01:12.525416 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69a0beb-823b-49ff-9b52-b756997f281f None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 08:01:12.526897 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-a69a0beb-823b-49ff-9b52-b756997f281f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 08:01:12.540649 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69a0beb-823b-49ff-9b52-b756997f281f None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 08:01:12.545175 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474d4832-3eff-4f0b-869f-9efb8431b76d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 08:01:12.545839 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474d4832-3eff-4f0b-869f-9efb8431b76d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 08:01:12.546123 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474d4832-3eff-4f0b-869f-9efb8431b76d admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 08:01:12.546393 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474d4832-3eff-4f0b-869f-9efb8431b76d admin admin] PATH_INFO: `/v3/projects/b3a14fdcdd7e419fb1ce41cf20c72a10` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 08:01:12.547507 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474d4832-3eff-4f0b-869f-9efb8431b76d admin admin] RBAC: Authorizing `identity:delete_project(project_id=b3a14fdcdd7e419fb1ce41cf20c72a10)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 08:01:12.549475 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474d4832-3eff-4f0b-869f-9efb8431b76d admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 08:01:12.596868 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-474d4832-3eff-4f0b-869f-9efb8431b76d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b3a14fdcdd7e419fb1ce41cf20c72a10', 'request_id': 'req-474d4832-3eff-4f0b-869f-9efb8431b76d'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 08:01:12.603321 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-474d4832-3eff-4f0b-869f-9efb8431b76d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b3a14fdcdd7e419fb1ce41cf20c72a10', 'request_id': 'req-474d4832-3eff-4f0b-869f-9efb8431b76d'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 08:01:12.610902 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-474d4832-3eff-4f0b-869f-9efb8431b76d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b3a14fdcdd7e419fb1ce41cf20c72a10', 'request_id': 'req-474d4832-3eff-4f0b-869f-9efb8431b76d'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 08:01:12.621553 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-474d4832-3eff-4f0b-869f-9efb8431b76d admin admin] The token cache is being invalidate because project b3a14fdcdd7e419fb1ce41cf20c72a10 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81431) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 08:01:12.621874 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-474d4832-3eff-4f0b-869f-9efb8431b76d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 08:01:12.622501 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-474d4832-3eff-4f0b-869f-9efb8431b76d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 08:01:12.623945 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1340/2661] 10.222.0.57 () {58 vars in 1233 bytes} [Fri Sep 16 08:01:12 2022] DELETE /identity/v3/projects/b3a14fdcdd7e419fb1ce41cf20c72a10 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 08:01:12.628493 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea45c80-ac21-434a-be70-63ed9751e059 service neutron] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 08:01:12.640715 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea45c80-ac21-434a-be70-63ed9751e059 service neutron] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 08:01:12.704679 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c68d32-e74e-49c0-be28-8115a315b603 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 08:01:12.705348 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c68d32-e74e-49c0-be28-8115a315b603 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 08:01:12.706301 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c68d32-e74e-49c0-be28-8115a315b603 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 08:01:12.706700 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c68d32-e74e-49c0-be28-8115a315b603 admin admin] PATH_INFO: `/v3/users/e5de8296275b4e31be7c2e5a3d7cc6b9` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 08:01:12.707855 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c68d32-e74e-49c0-be28-8115a315b603 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e5de8296275b4e31be7c2e5a3d7cc6b9)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 08:01:12.709846 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c68d32-e74e-49c0-be28-8115a315b603 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 08:01:12.753044 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-c8c68d32-e74e-49c0-be28-8115a315b603 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e5de8296275b4e31be7c2e5a3d7cc6b9'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 08:01:12.753615 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-c8c68d32-e74e-49c0-be28-8115a315b603 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e5de8296275b4e31be7c2e5a3d7cc6b9'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 08:01:12.760469 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-c8c68d32-e74e-49c0-be28-8115a315b603 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e5de8296275b4e31be7c2e5a3d7cc6b9'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 08:01:12.773117 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-c8c68d32-e74e-49c0-be28-8115a315b603 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e5de8296275b4e31be7c2e5a3d7cc6b9'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 08:01:12.779944 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-c8c68d32-e74e-49c0-be28-8115a315b603 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e5de8296275b4e31be7c2e5a3d7cc6b9'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 08:01:12.785984 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1322/2662] 10.222.0.57 () {58 vars in 1224 bytes} [Fri Sep 16 08:01:12 2022] DELETE /identity/v3/users/e5de8296275b4e31be7c2e5a3d7cc6b9 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 08:01:13.056178 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474d4832-3eff-4f0b-869f-9efb8431b76d admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 08:01:13.057605 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-474d4832-3eff-4f0b-869f-9efb8431b76d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 08:01:13.072649 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474d4832-3eff-4f0b-869f-9efb8431b76d admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 08:01:13.122871 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 08:01:13.134958 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448709e6-da7d-4632-9b15-20917ab3f936 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 08:01:13.135588 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448709e6-da7d-4632-9b15-20917ab3f936 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 08:01:13.135865 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448709e6-da7d-4632-9b15-20917ab3f936 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 08:01:13.136135 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448709e6-da7d-4632-9b15-20917ab3f936 admin admin] PATH_INFO: `/v3/projects/b2028a1669184642b3adb8efb7ca9ee3` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 08:01:13.137229 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448709e6-da7d-4632-9b15-20917ab3f936 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b2028a1669184642b3adb8efb7ca9ee3)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 08:01:13.139176 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448709e6-da7d-4632-9b15-20917ab3f936 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 08:01:13.185132 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-448709e6-da7d-4632-9b15-20917ab3f936 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b2028a1669184642b3adb8efb7ca9ee3', 'request_id': 'req-448709e6-da7d-4632-9b15-20917ab3f936'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 08:01:13.191535 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-448709e6-da7d-4632-9b15-20917ab3f936 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b2028a1669184642b3adb8efb7ca9ee3', 'request_id': 'req-448709e6-da7d-4632-9b15-20917ab3f936'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 08:01:13.199429 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-448709e6-da7d-4632-9b15-20917ab3f936 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b2028a1669184642b3adb8efb7ca9ee3', 'request_id': 'req-448709e6-da7d-4632-9b15-20917ab3f936'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 08:01:13.210622 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-448709e6-da7d-4632-9b15-20917ab3f936 admin admin] The token cache is being invalidate because project b2028a1669184642b3adb8efb7ca9ee3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81431) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 08:01:13.210904 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-448709e6-da7d-4632-9b15-20917ab3f936 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 08:01:13.211518 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-448709e6-da7d-4632-9b15-20917ab3f936 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 08:01:13.212990 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1341/2663] 10.222.0.57 () {58 vars in 1233 bytes} [Fri Sep 16 08:01:13 2022] DELETE /identity/v3/projects/b2028a1669184642b3adb8efb7ca9ee3 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 08:01:13.218846 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6de7723-87dd-4cfb-b5d3-0fd9589bbdbc None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 08:01:13.219321 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6de7723-87dd-4cfb-b5d3-0fd9589bbdbc None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 08:01:13.219438 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6de7723-87dd-4cfb-b5d3-0fd9589bbdbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 08:01:13.240222 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-d6de7723-87dd-4cfb-b5d3-0fd9589bbdbc None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 08:01:13.241407 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-d6de7723-87dd-4cfb-b5d3-0fd9589bbdbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 08:01:13.278275 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 08:01:13.301806 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1323/2664] 10.222.0.57 () {58 vars in 958 bytes} [Fri Sep 16 08:01:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 08:01:13.309630 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a73a81d-b81e-4f03-8776-4635a2ee8afa None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 08:01:13.309932 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a73a81d-b81e-4f03-8776-4635a2ee8afa None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 08:01:13.310225 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a73a81d-b81e-4f03-8776-4635a2ee8afa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 08:01:13.329475 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-6a73a81d-b81e-4f03-8776-4635a2ee8afa None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 08:01:13.330751 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-6a73a81d-b81e-4f03-8776-4635a2ee8afa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 08:01:13.338354 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1342/2665] 10.222.0.57 () {58 vars in 958 bytes} [Fri Sep 16 08:01:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 08:01:13.342483 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6de7723-87dd-4cfb-b5d3-0fd9589bbdbc None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 08:01:13.352612 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6de7723-87dd-4cfb-b5d3-0fd9589bbdbc None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 08:01:13.357165 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373e6ea5-9671-4298-9dbb-e7346cccec89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 08:01:13.357786 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373e6ea5-9671-4298-9dbb-e7346cccec89 admin admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 08:01:13.358071 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373e6ea5-9671-4298-9dbb-e7346cccec89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 08:01:13.358344 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373e6ea5-9671-4298-9dbb-e7346cccec89 admin admin] PATH_INFO: `/v3/domains` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 08:01:13.358986 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373e6ea5-9671-4298-9dbb-e7346cccec89 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 08:01:13.359558 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373e6ea5-9671-4298-9dbb-e7346cccec89 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 08:01:13.361146 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373e6ea5-9671-4298-9dbb-e7346cccec89 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 08:01:13.373070 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1324/2666] 10.222.0.57 () {58 vars in 1153 bytes} [Fri Sep 16 08:01:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 08:01:13.377250 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a73a81d-b81e-4f03-8776-4635a2ee8afa None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 08:01:13.386363 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a73a81d-b81e-4f03-8776-4635a2ee8afa None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 08:01:13.390882 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c72e50e-6c61-4178-81dc-ff725c8814d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 08:01:13.391461 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c72e50e-6c61-4178-81dc-ff725c8814d8 admin admin] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 08:01:13.391734 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c72e50e-6c61-4178-81dc-ff725c8814d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 08:01:13.392000 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c72e50e-6c61-4178-81dc-ff725c8814d8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 08:01:13.392609 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c72e50e-6c61-4178-81dc-ff725c8814d8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 08:01:13.394889 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c72e50e-6c61-4178-81dc-ff725c8814d8 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 08:01:13.421237 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1343/2667] 10.222.0.57 () {60 vars in 1153 bytes} [Fri Sep 16 08:01:13 2022] POST /identity/v3/projects => generated 379 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 08:01:13.426170 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373e6ea5-9671-4298-9dbb-e7346cccec89 admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 08:01:13.435950 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373e6ea5-9671-4298-9dbb-e7346cccec89 admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 08:01:13.492649 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020639a6-066a-4f1e-a906-67729da5cfe5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 08:01:13.493245 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020639a6-066a-4f1e-a906-67729da5cfe5 admin admin] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 08:01:13.493524 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020639a6-066a-4f1e-a906-67729da5cfe5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 08:01:13.493825 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020639a6-066a-4f1e-a906-67729da5cfe5 admin admin] PATH_INFO: `/v3/users` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 08:01:13.494442 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020639a6-066a-4f1e-a906-67729da5cfe5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 08:01:13.496343 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020639a6-066a-4f1e-a906-67729da5cfe5 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 08:01:13.516677 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1325/2668] 10.222.0.57 () {60 vars in 1144 bytes} [Fri Sep 16 08:01:13 2022] POST /identity/v3/users => generated 290 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 08:01:13.521478 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c72e50e-6c61-4178-81dc-ff725c8814d8 admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 08:01:13.531751 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c72e50e-6c61-4178-81dc-ff725c8814d8 admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 08:01:13.536929 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fab5ad-16ce-4800-bc31-18bc1387802b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 08:01:13.537516 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fab5ad-16ce-4800-bc31-18bc1387802b admin admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 08:01:13.537829 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fab5ad-16ce-4800-bc31-18bc1387802b admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 08:01:13.538103 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fab5ad-16ce-4800-bc31-18bc1387802b admin admin] PATH_INFO: `/v3/roles` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 08:01:13.538734 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4fab5ad-16ce-4800-bc31-18bc1387802b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 08:01:13.540304 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4fab5ad-16ce-4800-bc31-18bc1387802b admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 08:01:13.550052 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1344/2669] 10.222.0.57 () {58 vars in 1122 bytes} [Fri Sep 16 08:01:13 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 08:01:13.553913 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020639a6-066a-4f1e-a906-67729da5cfe5 admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 08:01:13.563720 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020639a6-066a-4f1e-a906-67729da5cfe5 admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 08:01:13.568245 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45198c7b-635b-4c04-a8ad-ad30aa286bc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 08:01:13.568821 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45198c7b-635b-4c04-a8ad-ad30aa286bc3 admin admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 08:01:13.569098 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45198c7b-635b-4c04-a8ad-ad30aa286bc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 08:01:13.569369 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45198c7b-635b-4c04-a8ad-ad30aa286bc3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 08:01:13.570045 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45198c7b-635b-4c04-a8ad-ad30aa286bc3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 08:01:13.571620 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45198c7b-635b-4c04-a8ad-ad30aa286bc3 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 08:01:13.582376 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1326/2670] 10.222.0.57 () {58 vars in 1122 bytes} [Fri Sep 16 08:01:13 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 08:01:13.586296 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fab5ad-16ce-4800-bc31-18bc1387802b admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 08:01:13.596629 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fab5ad-16ce-4800-bc31-18bc1387802b admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 08:01:13.601272 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba9c375-838a-4647-89cc-c8c709ea3a86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 08:01:13.601954 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba9c375-838a-4647-89cc-c8c709ea3a86 admin admin] REQUEST_METHOD: `PUT` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 08:01:13.602235 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba9c375-838a-4647-89cc-c8c709ea3a86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 08:01:13.602511 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba9c375-838a-4647-89cc-c8c709ea3a86 admin admin] PATH_INFO: `/v3/projects/ad81638be9af42b09fafb7da9777e3a9/users/d785c98339da4c9eb4c3bc6dcfec2649/roles/4818d38cf2564825b312e66c9eb24762` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 08:01:13.617527 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba9c375-838a-4647-89cc-c8c709ea3a86 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ad81638be9af42b09fafb7da9777e3a9, user_id=d785c98339da4c9eb4c3bc6dcfec2649, role_id=4818d38cf2564825b312e66c9eb24762)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 08:01:13.624305 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba9c375-838a-4647-89cc-c8c709ea3a86 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 08:01:13.637090 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1345/2671] 10.222.0.57 () {60 vars in 1483 bytes} [Fri Sep 16 08:01:13 2022] PUT /identity/v3/projects/ad81638be9af42b09fafb7da9777e3a9/users/d785c98339da4c9eb4c3bc6dcfec2649/roles/4818d38cf2564825b312e66c9eb24762 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 08:01:13.649189 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c2219b-73a3-47a4-8a0e-b61fd873e40f None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 08:01:13.649499 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c2219b-73a3-47a4-8a0e-b61fd873e40f None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 08:01:13.649815 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c2219b-73a3-47a4-8a0e-b61fd873e40f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 08:01:13.677511 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-a6c2219b-73a3-47a4-8a0e-b61fd873e40f None None] MFA Rules not processed for user `d785c98339da4c9eb4c3bc6dcfec2649`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 08:01:13.678760 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-a6c2219b-73a3-47a4-8a0e-b61fd873e40f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 08:01:13.743668 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1327/2672] 10.222.0.57 () {58 vars in 958 bytes} [Fri Sep 16 08:01:13 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 08:01:13.748183 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba9c375-838a-4647-89cc-c8c709ea3a86 admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 08:01:13.809511 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba9c375-838a-4647-89cc-c8c709ea3a86 admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 08:01:13.814086 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f7d178-d017-4b59-8aad-63296d4cc239 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 08:01:13.814681 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f7d178-d017-4b59-8aad-63296d4cc239 admin admin] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 08:01:13.814952 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f7d178-d017-4b59-8aad-63296d4cc239 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 08:01:13.815226 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f7d178-d017-4b59-8aad-63296d4cc239 admin admin] PATH_INFO: `/v3/projects` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 08:01:13.815875 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f7d178-d017-4b59-8aad-63296d4cc239 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 08:01:13.817774 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f7d178-d017-4b59-8aad-63296d4cc239 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 08:01:13.843843 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1346/2673] 10.222.0.57 () {60 vars in 1153 bytes} [Fri Sep 16 08:01:13 2022] POST /identity/v3/projects => generated 379 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 08:01:13.848992 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c2219b-73a3-47a4-8a0e-b61fd873e40f None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 08:01:13.859895 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c2219b-73a3-47a4-8a0e-b61fd873e40f None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 08:01:13.895893 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 08:01:13.919148 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d791e7-e296-402a-964b-318a1900670a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 08:01:13.919785 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d791e7-e296-402a-964b-318a1900670a admin admin] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 08:01:13.920064 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d791e7-e296-402a-964b-318a1900670a admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 08:01:13.920341 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d791e7-e296-402a-964b-318a1900670a admin admin] PATH_INFO: `/v3/users` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 08:01:13.920974 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d791e7-e296-402a-964b-318a1900670a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 08:01:13.922902 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d791e7-e296-402a-964b-318a1900670a admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 08:01:13.944270 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1328/2674] 10.222.0.57 () {60 vars in 1144 bytes} [Fri Sep 16 08:01:13 2022] POST /identity/v3/users => generated 296 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 08:01:13.948318 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f7d178-d017-4b59-8aad-63296d4cc239 admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 08:01:13.953683 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 08:01:13.960264 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f7d178-d017-4b59-8aad-63296d4cc239 admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 08:01:13.965620 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8bd3af-20d0-4ce7-866b-3eee2eb6fd6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 08:01:13.966296 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8bd3af-20d0-4ce7-866b-3eee2eb6fd6b admin admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 08:01:13.966573 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8bd3af-20d0-4ce7-866b-3eee2eb6fd6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 08:01:13.966843 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8bd3af-20d0-4ce7-866b-3eee2eb6fd6b admin admin] PATH_INFO: `/v3/roles` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 08:01:13.967470 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8bd3af-20d0-4ce7-866b-3eee2eb6fd6b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 08:01:13.969053 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8bd3af-20d0-4ce7-866b-3eee2eb6fd6b admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 08:01:13.979582 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1347/2675] 10.222.0.57 () {58 vars in 1122 bytes} [Fri Sep 16 08:01:13 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 08:01:13.983691 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d791e7-e296-402a-964b-318a1900670a admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 08:01:13.993807 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d791e7-e296-402a-964b-318a1900670a admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 08:01:13.998462 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b2d81a-b113-4675-a192-19f099553ef4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 08:01:13.999105 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b2d81a-b113-4675-a192-19f099553ef4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 08:01:13.999386 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b2d81a-b113-4675-a192-19f099553ef4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 08:01:13.999660 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b2d81a-b113-4675-a192-19f099553ef4 admin admin] PATH_INFO: `/v3/projects/087d6f83497e4b679d6e0ae2a8c3adde/users/e7148bb86d5143c8a2e3fa637da7a96e/roles/567db03c91854ad9af1e9a87ec1bd275` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 08:01:14.014838 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b2d81a-b113-4675-a192-19f099553ef4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=087d6f83497e4b679d6e0ae2a8c3adde, user_id=e7148bb86d5143c8a2e3fa637da7a96e, role_id=567db03c91854ad9af1e9a87ec1bd275)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 08:01:14.017499 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b2d81a-b113-4675-a192-19f099553ef4 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 08:01:14.030205 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1329/2676] 10.222.0.57 () {60 vars in 1483 bytes} [Fri Sep 16 08:01:13 2022] PUT /identity/v3/projects/087d6f83497e4b679d6e0ae2a8c3adde/users/e7148bb86d5143c8a2e3fa637da7a96e/roles/567db03c91854ad9af1e9a87ec1bd275 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 08:01:14.034187 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8bd3af-20d0-4ce7-866b-3eee2eb6fd6b admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 08:01:14.043994 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8bd3af-20d0-4ce7-866b-3eee2eb6fd6b admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 08:01:14.099139 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10a9480-1789-4d4b-81cb-94beb1ee707b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 08:01:14.099723 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10a9480-1789-4d4b-81cb-94beb1ee707b admin admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 08:01:14.099996 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10a9480-1789-4d4b-81cb-94beb1ee707b admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 08:01:14.100287 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10a9480-1789-4d4b-81cb-94beb1ee707b admin admin] PATH_INFO: `/v3/roles` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 08:01:14.100963 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10a9480-1789-4d4b-81cb-94beb1ee707b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 08:01:14.102603 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10a9480-1789-4d4b-81cb-94beb1ee707b admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 08:01:14.112457 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1348/2677] 10.222.0.57 () {58 vars in 1122 bytes} [Fri Sep 16 08:01:14 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 08:01:14.116882 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b2d81a-b113-4675-a192-19f099553ef4 admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 08:01:14.128167 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b2d81a-b113-4675-a192-19f099553ef4 admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 08:01:14.132807 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8bf7eb-ddf0-4904-8766-2336a4cfbcec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 08:01:14.133463 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8bf7eb-ddf0-4904-8766-2336a4cfbcec admin admin] REQUEST_METHOD: `PUT` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 08:01:14.133761 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8bf7eb-ddf0-4904-8766-2336a4cfbcec admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 08:01:14.134116 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8bf7eb-ddf0-4904-8766-2336a4cfbcec admin admin] PATH_INFO: `/v3/projects/087d6f83497e4b679d6e0ae2a8c3adde/users/e7148bb86d5143c8a2e3fa637da7a96e/roles/567db03c91854ad9af1e9a87ec1bd275` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 08:01:14.137358 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8bf7eb-ddf0-4904-8766-2336a4cfbcec admin admin] RBAC: Authorizing `identity:create_grant(project_id=087d6f83497e4b679d6e0ae2a8c3adde, user_id=e7148bb86d5143c8a2e3fa637da7a96e, role_id=567db03c91854ad9af1e9a87ec1bd275)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 08:01:14.142700 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8bf7eb-ddf0-4904-8766-2336a4cfbcec admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 08:01:14.154436 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1330/2678] 10.222.0.57 () {60 vars in 1483 bytes} [Fri Sep 16 08:01:14 2022] PUT /identity/v3/projects/087d6f83497e4b679d6e0ae2a8c3adde/users/e7148bb86d5143c8a2e3fa637da7a96e/roles/567db03c91854ad9af1e9a87ec1bd275 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 08:01:14.165063 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eefc7e7-fd12-43e2-a77f-ebcf26995589 None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 08:01:14.165349 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eefc7e7-fd12-43e2-a77f-ebcf26995589 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 08:01:14.165620 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eefc7e7-fd12-43e2-a77f-ebcf26995589 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 08:01:14.193129 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-3eefc7e7-fd12-43e2-a77f-ebcf26995589 None None] MFA Rules not processed for user `e7148bb86d5143c8a2e3fa637da7a96e`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 08:01:14.194483 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-3eefc7e7-fd12-43e2-a77f-ebcf26995589 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 08:01:14.261473 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1349/2679] 10.222.0.57 () {58 vars in 958 bytes} [Fri Sep 16 08:01:14 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 16 08:01:14.272959 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8bf7eb-ddf0-4904-8766-2336a4cfbcec admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 08:01:14.274784 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-aa8bf7eb-ddf0-4904-8766-2336a4cfbcec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 08:01:14.332174 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8bf7eb-ddf0-4904-8766-2336a4cfbcec admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 08:01:14.335742 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a24d268-325b-4c4a-87bb-331069f758cf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544bf6be4c24454a013ca110c43cef2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4735f453c0c24cc4a1c14e9ac84a0b46', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 08:01:14.336331 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a24d268-325b-4c4a-87bb-331069f758cf service cinder] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 08:01:14.336608 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a24d268-325b-4c4a-87bb-331069f758cf service cinder] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 08:01:14.336878 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a24d268-325b-4c4a-87bb-331069f758cf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 08:01:14.345638 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a24d268-325b-4c4a-87bb-331069f758cf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 08:01:14.347215 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a24d268-325b-4c4a-87bb-331069f758cf service cinder] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 08:01:14.356430 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1331/2680] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Sep 16 08:01:14 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 08:01:14.725132 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eefc7e7-fd12-43e2-a77f-ebcf26995589 None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 08:01:14.794691 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eefc7e7-fd12-43e2-a77f-ebcf26995589 None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 08:01:14.799983 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8593f1bd-32fc-46b9-9c3e-279f26aa3d52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 08:01:14.800614 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8593f1bd-32fc-46b9-9c3e-279f26aa3d52 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 08:01:14.800887 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8593f1bd-32fc-46b9-9c3e-279f26aa3d52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 08:01:14.801162 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8593f1bd-32fc-46b9-9c3e-279f26aa3d52 admin admin] PATH_INFO: `/v3/users/d785c98339da4c9eb4c3bc6dcfec2649` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 08:01:14.802305 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8593f1bd-32fc-46b9-9c3e-279f26aa3d52 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d785c98339da4c9eb4c3bc6dcfec2649)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 08:01:14.804229 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8593f1bd-32fc-46b9-9c3e-279f26aa3d52 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 08:01:14.818373 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 08:01:14.852461 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-8593f1bd-32fc-46b9-9c3e-279f26aa3d52 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd785c98339da4c9eb4c3bc6dcfec2649'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 08:01:14.865420 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-8593f1bd-32fc-46b9-9c3e-279f26aa3d52 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd785c98339da4c9eb4c3bc6dcfec2649'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 08:01:14.866125 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-8593f1bd-32fc-46b9-9c3e-279f26aa3d52 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd785c98339da4c9eb4c3bc6dcfec2649'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 08:01:14.873520 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-8593f1bd-32fc-46b9-9c3e-279f26aa3d52 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd785c98339da4c9eb4c3bc6dcfec2649'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 08:01:14.880926 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-8593f1bd-32fc-46b9-9c3e-279f26aa3d52 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd785c98339da4c9eb4c3bc6dcfec2649'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 08:01:14.886772 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1350/2681] 10.222.0.57 () {58 vars in 1224 bytes} [Fri Sep 16 08:01:14 2022] DELETE /identity/v3/users/d785c98339da4c9eb4c3bc6dcfec2649 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 08:01:14.891342 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77efe9b7-6fe0-453b-afea-a42d8e2c4512 None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 08:01:14.891627 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77efe9b7-6fe0-453b-afea-a42d8e2c4512 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 08:01:14.891901 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77efe9b7-6fe0-453b-afea-a42d8e2c4512 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 08:01:14.911067 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-77efe9b7-6fe0-453b-afea-a42d8e2c4512 None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 08:01:14.912269 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-77efe9b7-6fe0-453b-afea-a42d8e2c4512 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 08:01:14.969779 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1332/2682] 10.222.0.57 () {58 vars in 958 bytes} [Fri Sep 16 08:01:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 08:01:14.979925 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8593f1bd-32fc-46b9-9c3e-279f26aa3d52 admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 08:01:14.981338 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-8593f1bd-32fc-46b9-9c3e-279f26aa3d52 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 08:01:15.038617 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8593f1bd-32fc-46b9-9c3e-279f26aa3d52 admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 08:01:15.042250 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297ddc5b-2f05-40ca-b2d6-e4ff7c4138e5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1062e457207a41e4ba4f0a0c4bf36f1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4735f453c0c24cc4a1c14e9ac84a0b46', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 08:01:15.042842 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297ddc5b-2f05-40ca-b2d6-e4ff7c4138e5 service neutron] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 08:01:15.043117 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297ddc5b-2f05-40ca-b2d6-e4ff7c4138e5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 08:01:15.043386 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297ddc5b-2f05-40ca-b2d6-e4ff7c4138e5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 08:01:15.052485 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297ddc5b-2f05-40ca-b2d6-e4ff7c4138e5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 08:01:15.053956 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297ddc5b-2f05-40ca-b2d6-e4ff7c4138e5 service neutron] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 08:01:15.063558 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1351/2683] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Sep 16 08:01:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 08:01:15.337765 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77efe9b7-6fe0-453b-afea-a42d8e2c4512 None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 08:01:15.339272 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-77efe9b7-6fe0-453b-afea-a42d8e2c4512 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 08:01:15.356591 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77efe9b7-6fe0-453b-afea-a42d8e2c4512 None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 08:01:15.361625 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c164b65-6b5b-46a4-bd1c-6bcdd18aee85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 08:01:15.362295 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c164b65-6b5b-46a4-bd1c-6bcdd18aee85 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 08:01:15.362550 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c164b65-6b5b-46a4-bd1c-6bcdd18aee85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 08:01:15.362835 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c164b65-6b5b-46a4-bd1c-6bcdd18aee85 admin admin] PATH_INFO: `/v3/projects/ad81638be9af42b09fafb7da9777e3a9` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 08:01:15.363921 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c164b65-6b5b-46a4-bd1c-6bcdd18aee85 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ad81638be9af42b09fafb7da9777e3a9)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 08:01:15.366058 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c164b65-6b5b-46a4-bd1c-6bcdd18aee85 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 08:01:15.398149 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=93,keystone:INSERT=5,keystone:DELETE=2 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 08:01:15.414877 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-7c164b65-6b5b-46a4-bd1c-6bcdd18aee85 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ad81638be9af42b09fafb7da9777e3a9', 'request_id': 'req-7c164b65-6b5b-46a4-bd1c-6bcdd18aee85'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 08:01:15.421681 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-7c164b65-6b5b-46a4-bd1c-6bcdd18aee85 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ad81638be9af42b09fafb7da9777e3a9', 'request_id': 'req-7c164b65-6b5b-46a4-bd1c-6bcdd18aee85'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 08:01:15.427473 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-7c164b65-6b5b-46a4-bd1c-6bcdd18aee85 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ad81638be9af42b09fafb7da9777e3a9', 'request_id': 'req-7c164b65-6b5b-46a4-bd1c-6bcdd18aee85'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 08:01:15.438635 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-7c164b65-6b5b-46a4-bd1c-6bcdd18aee85 admin admin] The token cache is being invalidate because project ad81638be9af42b09fafb7da9777e3a9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81430) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 08:01:15.438924 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-7c164b65-6b5b-46a4-bd1c-6bcdd18aee85 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 08:01:15.439557 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-7c164b65-6b5b-46a4-bd1c-6bcdd18aee85 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 08:01:15.441819 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1333/2684] 10.222.0.57 () {58 vars in 1233 bytes} [Fri Sep 16 08:01:15 2022] DELETE /identity/v3/projects/ad81638be9af42b09fafb7da9777e3a9 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 08:01:15.445657 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297ddc5b-2f05-40ca-b2d6-e4ff7c4138e5 service neutron] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 08:01:15.455083 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297ddc5b-2f05-40ca-b2d6-e4ff7c4138e5 service neutron] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 08:01:15.510589 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d837bea-2648-45a1-bf9b-ec5c5812becb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 08:01:15.511205 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d837bea-2648-45a1-bf9b-ec5c5812becb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 08:01:15.511484 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d837bea-2648-45a1-bf9b-ec5c5812becb admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 08:01:15.511756 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d837bea-2648-45a1-bf9b-ec5c5812becb admin admin] PATH_INFO: `/v3/users/e7148bb86d5143c8a2e3fa637da7a96e` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 08:01:15.512852 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d837bea-2648-45a1-bf9b-ec5c5812becb admin admin] RBAC: Authorizing `identity:delete_user(user_id=e7148bb86d5143c8a2e3fa637da7a96e)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 08:01:15.514883 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d837bea-2648-45a1-bf9b-ec5c5812becb admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 08:01:15.551978 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 08:01:15.561354 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-2d837bea-2648-45a1-bf9b-ec5c5812becb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e7148bb86d5143c8a2e3fa637da7a96e'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 08:01:15.573822 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-2d837bea-2648-45a1-bf9b-ec5c5812becb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e7148bb86d5143c8a2e3fa637da7a96e'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 08:01:15.574521 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-2d837bea-2648-45a1-bf9b-ec5c5812becb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e7148bb86d5143c8a2e3fa637da7a96e'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 08:01:15.582120 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-2d837bea-2648-45a1-bf9b-ec5c5812becb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e7148bb86d5143c8a2e3fa637da7a96e'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 08:01:15.589158 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-2d837bea-2648-45a1-bf9b-ec5c5812becb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e7148bb86d5143c8a2e3fa637da7a96e'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 08:01:15.594921 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1352/2685] 10.222.0.57 () {58 vars in 1224 bytes} [Fri Sep 16 08:01:15 2022] DELETE /identity/v3/users/e7148bb86d5143c8a2e3fa637da7a96e => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 08:01:15.875955 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c164b65-6b5b-46a4-bd1c-6bcdd18aee85 admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 08:01:15.878083 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-7c164b65-6b5b-46a4-bd1c-6bcdd18aee85 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 08:01:15.891055 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c164b65-6b5b-46a4-bd1c-6bcdd18aee85 admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 08:01:15.947529 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35620753-1ed5-4353-976b-21a86ebba237 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 08:01:15.948187 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35620753-1ed5-4353-976b-21a86ebba237 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 08:01:15.948467 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35620753-1ed5-4353-976b-21a86ebba237 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 08:01:15.948773 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35620753-1ed5-4353-976b-21a86ebba237 admin admin] PATH_INFO: `/v3/projects/087d6f83497e4b679d6e0ae2a8c3adde` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 08:01:15.949910 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35620753-1ed5-4353-976b-21a86ebba237 admin admin] RBAC: Authorizing `identity:delete_project(project_id=087d6f83497e4b679d6e0ae2a8c3adde)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 08:01:15.951822 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35620753-1ed5-4353-976b-21a86ebba237 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 08:01:15.997930 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-35620753-1ed5-4353-976b-21a86ebba237 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '087d6f83497e4b679d6e0ae2a8c3adde', 'request_id': 'req-35620753-1ed5-4353-976b-21a86ebba237'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 08:01:16.006013 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-35620753-1ed5-4353-976b-21a86ebba237 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '087d6f83497e4b679d6e0ae2a8c3adde', 'request_id': 'req-35620753-1ed5-4353-976b-21a86ebba237'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 08:01:16.011451 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-35620753-1ed5-4353-976b-21a86ebba237 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '087d6f83497e4b679d6e0ae2a8c3adde', 'request_id': 'req-35620753-1ed5-4353-976b-21a86ebba237'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 08:01:16.023306 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-35620753-1ed5-4353-976b-21a86ebba237 admin admin] The token cache is being invalidate because project 087d6f83497e4b679d6e0ae2a8c3adde was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81430) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 08:01:16.023594 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-35620753-1ed5-4353-976b-21a86ebba237 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 08:01:16.024228 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-35620753-1ed5-4353-976b-21a86ebba237 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 08:01:16.025686 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1334/2686] 10.222.0.57 () {58 vars in 1233 bytes} [Fri Sep 16 08:01:15 2022] DELETE /identity/v3/projects/087d6f83497e4b679d6e0ae2a8c3adde => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 08:01:16.030555 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9b77d4-9ba9-40d5-9419-361bf37ba587 None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 08:01:16.030844 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9b77d4-9ba9-40d5-9419-361bf37ba587 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 08:01:16.031115 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9b77d4-9ba9-40d5-9419-361bf37ba587 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 08:01:16.050938 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-cf9b77d4-9ba9-40d5-9419-361bf37ba587 None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 08:01:16.052128 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-cf9b77d4-9ba9-40d5-9419-361bf37ba587 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 08:01:16.110065 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1353/2687] 10.222.0.57 () {58 vars in 958 bytes} [Fri Sep 16 08:01:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 08:01:16.119058 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4345b256-db04-487d-b80f-3484a2dc4a1f None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 08:01:16.119275 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4345b256-db04-487d-b80f-3484a2dc4a1f None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 08:01:16.119546 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4345b256-db04-487d-b80f-3484a2dc4a1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 08:01:16.139728 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-4345b256-db04-487d-b80f-3484a2dc4a1f None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 08:01:16.140955 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-4345b256-db04-487d-b80f-3484a2dc4a1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 08:01:16.155202 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1335/2688] 10.222.0.57 () {58 vars in 958 bytes} [Fri Sep 16 08:01:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 08:01:16.160351 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9b77d4-9ba9-40d5-9419-361bf37ba587 None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 08:01:16.170135 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9b77d4-9ba9-40d5-9419-361bf37ba587 None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 08:01:16.175153 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70f126f-809f-4aec-94e1-eadad5bc8f1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 08:01:16.175750 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70f126f-809f-4aec-94e1-eadad5bc8f1f admin admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 08:01:16.176028 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70f126f-809f-4aec-94e1-eadad5bc8f1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 08:01:16.176300 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70f126f-809f-4aec-94e1-eadad5bc8f1f admin admin] PATH_INFO: `/v3/domains` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 08:01:16.176992 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70f126f-809f-4aec-94e1-eadad5bc8f1f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 08:01:16.177293 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70f126f-809f-4aec-94e1-eadad5bc8f1f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 08:01:16.178934 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70f126f-809f-4aec-94e1-eadad5bc8f1f admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 08:01:16.191115 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1354/2689] 10.222.0.57 () {58 vars in 1153 bytes} [Fri Sep 16 08:01:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 08:01:16.195372 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4345b256-db04-487d-b80f-3484a2dc4a1f None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 08:01:16.204674 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4345b256-db04-487d-b80f-3484a2dc4a1f None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 08:01:16.210358 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad10d60d-3f4a-43bc-9e41-02ec25ab30fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 08:01:16.210950 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad10d60d-3f4a-43bc-9e41-02ec25ab30fb admin admin] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 08:01:16.211227 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad10d60d-3f4a-43bc-9e41-02ec25ab30fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 08:01:16.211499 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad10d60d-3f4a-43bc-9e41-02ec25ab30fb admin admin] PATH_INFO: `/v3/projects` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 08:01:16.212135 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad10d60d-3f4a-43bc-9e41-02ec25ab30fb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 08:01:16.214039 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad10d60d-3f4a-43bc-9e41-02ec25ab30fb admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 08:01:16.244516 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1336/2690] 10.222.0.57 () {60 vars in 1153 bytes} [Fri Sep 16 08:01:16 2022] POST /identity/v3/projects => generated 373 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 08:01:16.245684 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70f126f-809f-4aec-94e1-eadad5bc8f1f admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 08:01:16.256251 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70f126f-809f-4aec-94e1-eadad5bc8f1f admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 08:01:16.311214 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ab9151-c3e1-4644-9cc1-3bffca410921 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 08:01:16.311837 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ab9151-c3e1-4644-9cc1-3bffca410921 admin admin] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 08:01:16.312102 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ab9151-c3e1-4644-9cc1-3bffca410921 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 08:01:16.312373 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ab9151-c3e1-4644-9cc1-3bffca410921 admin admin] PATH_INFO: `/v3/users` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 08:01:16.313002 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ab9151-c3e1-4644-9cc1-3bffca410921 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 08:01:16.315472 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ab9151-c3e1-4644-9cc1-3bffca410921 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 08:01:16.336719 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1355/2691] 10.222.0.57 () {60 vars in 1144 bytes} [Fri Sep 16 08:01:16 2022] POST /identity/v3/users => generated 287 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 16 08:01:16.340853 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad10d60d-3f4a-43bc-9e41-02ec25ab30fb admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 08:01:16.351208 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad10d60d-3f4a-43bc-9e41-02ec25ab30fb admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 08:01:16.355910 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801a75d4-c8f9-4952-b9b5-341802f6d90a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 08:01:16.356500 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801a75d4-c8f9-4952-b9b5-341802f6d90a admin admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 08:01:16.356781 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801a75d4-c8f9-4952-b9b5-341802f6d90a admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 08:01:16.357057 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801a75d4-c8f9-4952-b9b5-341802f6d90a admin admin] PATH_INFO: `/v3/roles` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 08:01:16.357698 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801a75d4-c8f9-4952-b9b5-341802f6d90a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 08:01:16.359564 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801a75d4-c8f9-4952-b9b5-341802f6d90a admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 08:01:16.369682 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1337/2692] 10.222.0.57 () {58 vars in 1122 bytes} [Fri Sep 16 08:01:16 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 08:01:16.373397 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ab9151-c3e1-4644-9cc1-3bffca410921 admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 08:01:16.383930 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ab9151-c3e1-4644-9cc1-3bffca410921 admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 08:01:16.388512 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903839bb-8d60-4ccd-9c3f-25d3ba2206e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 08:01:16.389100 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903839bb-8d60-4ccd-9c3f-25d3ba2206e5 admin admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 08:01:16.389379 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903839bb-8d60-4ccd-9c3f-25d3ba2206e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 08:01:16.389648 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903839bb-8d60-4ccd-9c3f-25d3ba2206e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 08:01:16.390316 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903839bb-8d60-4ccd-9c3f-25d3ba2206e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 08:01:16.391896 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903839bb-8d60-4ccd-9c3f-25d3ba2206e5 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 08:01:16.403054 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1356/2693] 10.222.0.57 () {58 vars in 1122 bytes} [Fri Sep 16 08:01:16 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 08:01:16.407280 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801a75d4-c8f9-4952-b9b5-341802f6d90a admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 08:01:16.417292 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801a75d4-c8f9-4952-b9b5-341802f6d90a admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 08:01:16.421982 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d110e769-a91f-4094-8253-f8b33a69a7b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 08:01:16.422682 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d110e769-a91f-4094-8253-f8b33a69a7b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 08:01:16.422964 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d110e769-a91f-4094-8253-f8b33a69a7b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 08:01:16.423268 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d110e769-a91f-4094-8253-f8b33a69a7b9 admin admin] PATH_INFO: `/v3/projects/9d517aa5e91d403783b39546cb2cde3b/users/ee4ba804be3140adbc760bcf80c299c9/roles/4818d38cf2564825b312e66c9eb24762` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 08:01:16.425639 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 08:01:16.440752 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d110e769-a91f-4094-8253-f8b33a69a7b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d517aa5e91d403783b39546cb2cde3b, user_id=ee4ba804be3140adbc760bcf80c299c9, role_id=4818d38cf2564825b312e66c9eb24762)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 08:01:16.443448 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d110e769-a91f-4094-8253-f8b33a69a7b9 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 08:01:16.458310 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1338/2694] 10.222.0.57 () {60 vars in 1483 bytes} [Fri Sep 16 08:01:16 2022] PUT /identity/v3/projects/9d517aa5e91d403783b39546cb2cde3b/users/ee4ba804be3140adbc760bcf80c299c9/roles/4818d38cf2564825b312e66c9eb24762 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 16 08:01:16.468772 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eec0b2d-7eef-458e-8218-10d6f5f93d5a None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 08:01:16.469229 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eec0b2d-7eef-458e-8218-10d6f5f93d5a None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 08:01:16.469326 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eec0b2d-7eef-458e-8218-10d6f5f93d5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 08:01:16.496704 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-0eec0b2d-7eef-458e-8218-10d6f5f93d5a None None] MFA Rules not processed for user `ee4ba804be3140adbc760bcf80c299c9`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 08:01:16.497927 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-0eec0b2d-7eef-458e-8218-10d6f5f93d5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 08:01:16.506460 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 08:01:16.565670 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1357/2695] 10.222.0.57 () {58 vars in 958 bytes} [Fri Sep 16 08:01:16 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 08:01:16.570129 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d110e769-a91f-4094-8253-f8b33a69a7b9 admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 08:01:16.630168 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d110e769-a91f-4094-8253-f8b33a69a7b9 admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 08:01:16.634657 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35547b1f-5acc-4926-aad3-e95514460960 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 08:01:16.635244 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35547b1f-5acc-4926-aad3-e95514460960 admin admin] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 08:01:16.635598 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35547b1f-5acc-4926-aad3-e95514460960 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 08:01:16.635866 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35547b1f-5acc-4926-aad3-e95514460960 admin admin] PATH_INFO: `/v3/projects` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 08:01:16.636493 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35547b1f-5acc-4926-aad3-e95514460960 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 08:01:16.638403 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35547b1f-5acc-4926-aad3-e95514460960 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 08:01:16.664598 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1339/2696] 10.222.0.57 () {60 vars in 1153 bytes} [Fri Sep 16 08:01:16 2022] POST /identity/v3/projects => generated 373 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 08:01:16.668743 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eec0b2d-7eef-458e-8218-10d6f5f93d5a None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 08:01:16.679970 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eec0b2d-7eef-458e-8218-10d6f5f93d5a None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 08:01:16.735880 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d972a71b-8d59-49fe-9c3f-cc6e23bfa68b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 08:01:16.737054 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d972a71b-8d59-49fe-9c3f-cc6e23bfa68b admin admin] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 08:01:16.737333 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d972a71b-8d59-49fe-9c3f-cc6e23bfa68b admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 08:01:16.737602 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d972a71b-8d59-49fe-9c3f-cc6e23bfa68b admin admin] PATH_INFO: `/v3/users` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 08:01:16.738335 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d972a71b-8d59-49fe-9c3f-cc6e23bfa68b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 08:01:16.740920 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d972a71b-8d59-49fe-9c3f-cc6e23bfa68b admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 08:01:16.764214 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1358/2697] 10.222.0.57 () {60 vars in 1144 bytes} [Fri Sep 16 08:01:16 2022] POST /identity/v3/users => generated 293 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 16 08:01:16.768181 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35547b1f-5acc-4926-aad3-e95514460960 admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 08:01:16.778318 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35547b1f-5acc-4926-aad3-e95514460960 admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 08:01:16.782874 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a550b6-fec0-4801-b5ae-e5cb0ab61c98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 08:01:16.783489 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a550b6-fec0-4801-b5ae-e5cb0ab61c98 admin admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 08:01:16.783773 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a550b6-fec0-4801-b5ae-e5cb0ab61c98 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 08:01:16.784032 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a550b6-fec0-4801-b5ae-e5cb0ab61c98 admin admin] PATH_INFO: `/v3/roles` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 08:01:16.784663 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a550b6-fec0-4801-b5ae-e5cb0ab61c98 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 08:01:16.786269 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a550b6-fec0-4801-b5ae-e5cb0ab61c98 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 08:01:16.796904 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1340/2698] 10.222.0.57 () {58 vars in 1122 bytes} [Fri Sep 16 08:01:16 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 08:01:16.801270 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d972a71b-8d59-49fe-9c3f-cc6e23bfa68b admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 08:01:16.811812 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d972a71b-8d59-49fe-9c3f-cc6e23bfa68b admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 08:01:16.817476 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08789f1d-8f8c-4d52-9cd1-86c2ddd9a505 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 08:01:16.818175 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08789f1d-8f8c-4d52-9cd1-86c2ddd9a505 admin admin] REQUEST_METHOD: `PUT` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 08:01:16.818476 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08789f1d-8f8c-4d52-9cd1-86c2ddd9a505 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 08:01:16.818747 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08789f1d-8f8c-4d52-9cd1-86c2ddd9a505 admin admin] PATH_INFO: `/v3/projects/68137b9cac2c4822b20cd8c63bfa7081/users/aa1e0deb4b4b4433a4465b02564d81ce/roles/567db03c91854ad9af1e9a87ec1bd275` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 08:01:16.834756 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08789f1d-8f8c-4d52-9cd1-86c2ddd9a505 admin admin] RBAC: Authorizing `identity:create_grant(project_id=68137b9cac2c4822b20cd8c63bfa7081, user_id=aa1e0deb4b4b4433a4465b02564d81ce, role_id=567db03c91854ad9af1e9a87ec1bd275)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 08:01:16.837382 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08789f1d-8f8c-4d52-9cd1-86c2ddd9a505 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 08:01:16.851253 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1359/2699] 10.222.0.57 () {60 vars in 1483 bytes} [Fri Sep 16 08:01:16 2022] PUT /identity/v3/projects/68137b9cac2c4822b20cd8c63bfa7081/users/aa1e0deb4b4b4433a4465b02564d81ce/roles/567db03c91854ad9af1e9a87ec1bd275 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 08:01:16.855407 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a550b6-fec0-4801-b5ae-e5cb0ab61c98 admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 08:01:16.867029 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a550b6-fec0-4801-b5ae-e5cb0ab61c98 admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 08:01:16.928261 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506dc02f-fc1c-4c29-860a-9f8b73e342c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 08:01:16.928781 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506dc02f-fc1c-4c29-860a-9f8b73e342c9 admin admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 08:01:16.929063 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506dc02f-fc1c-4c29-860a-9f8b73e342c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 08:01:16.929351 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506dc02f-fc1c-4c29-860a-9f8b73e342c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 08:01:16.930001 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506dc02f-fc1c-4c29-860a-9f8b73e342c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 08:01:16.931582 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506dc02f-fc1c-4c29-860a-9f8b73e342c9 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 08:01:16.941202 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1341/2700] 10.222.0.57 () {58 vars in 1122 bytes} [Fri Sep 16 08:01:16 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 08:01:16.945329 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08789f1d-8f8c-4d52-9cd1-86c2ddd9a505 admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 08:01:16.955369 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08789f1d-8f8c-4d52-9cd1-86c2ddd9a505 admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 08:01:16.959998 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc9ae65-b9e9-4ec6-8e05-d242891d7866 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 08:01:16.960633 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc9ae65-b9e9-4ec6-8e05-d242891d7866 admin admin] REQUEST_METHOD: `PUT` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 08:01:16.960927 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc9ae65-b9e9-4ec6-8e05-d242891d7866 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 08:01:16.961178 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc9ae65-b9e9-4ec6-8e05-d242891d7866 admin admin] PATH_INFO: `/v3/projects/68137b9cac2c4822b20cd8c63bfa7081/users/aa1e0deb4b4b4433a4465b02564d81ce/roles/567db03c91854ad9af1e9a87ec1bd275` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 08:01:16.963100 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc9ae65-b9e9-4ec6-8e05-d242891d7866 admin admin] RBAC: Authorizing `identity:create_grant(project_id=68137b9cac2c4822b20cd8c63bfa7081, user_id=aa1e0deb4b4b4433a4465b02564d81ce, role_id=567db03c91854ad9af1e9a87ec1bd275)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 08:01:16.965690 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc9ae65-b9e9-4ec6-8e05-d242891d7866 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 08:01:16.976932 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1360/2701] 10.222.0.57 () {60 vars in 1483 bytes} [Fri Sep 16 08:01:16 2022] PUT /identity/v3/projects/68137b9cac2c4822b20cd8c63bfa7081/users/aa1e0deb4b4b4433a4465b02564d81ce/roles/567db03c91854ad9af1e9a87ec1bd275 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 08:01:16.988034 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ac327f-b08f-45bc-86c7-386fd005cdc9 None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 08:01:16.988319 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ac327f-b08f-45bc-86c7-386fd005cdc9 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 08:01:16.988590 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ac327f-b08f-45bc-86c7-386fd005cdc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 08:01:17.029241 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-b5ac327f-b08f-45bc-86c7-386fd005cdc9 None None] MFA Rules not processed for user `aa1e0deb4b4b4433a4465b02564d81ce`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 08:01:17.030521 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-b5ac327f-b08f-45bc-86c7-386fd005cdc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 08:01:17.074064 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 08:01:17.103971 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1342/2702] 10.222.0.57 () {58 vars in 958 bytes} [Fri Sep 16 08:01:16 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 08:01:17.117144 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc9ae65-b9e9-4ec6-8e05-d242891d7866 admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 08:01:17.119471 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-9cc9ae65-b9e9-4ec6-8e05-d242891d7866 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 08:01:17.189058 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc9ae65-b9e9-4ec6-8e05-d242891d7866 admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 08:01:17.192902 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ebf4d7-94d4-4dab-b8ae-4db2f9e2fbf9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544bf6be4c24454a013ca110c43cef2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4735f453c0c24cc4a1c14e9ac84a0b46', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 08:01:17.194208 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ebf4d7-94d4-4dab-b8ae-4db2f9e2fbf9 service cinder] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 08:01:17.194208 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ebf4d7-94d4-4dab-b8ae-4db2f9e2fbf9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 08:01:17.194208 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ebf4d7-94d4-4dab-b8ae-4db2f9e2fbf9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 08:01:17.211069 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 08:01:17.262301 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ebf4d7-94d4-4dab-b8ae-4db2f9e2fbf9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 08:01:17.263964 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ebf4d7-94d4-4dab-b8ae-4db2f9e2fbf9 service cinder] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 08:01:17.274330 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1361/2703] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Sep 16 08:01:17 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 08:01:19.918256 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ac327f-b08f-45bc-86c7-386fd005cdc9 None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 08:01:19.980569 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ac327f-b08f-45bc-86c7-386fd005cdc9 None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 08:01:19.985163 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b56600-d2c2-4f7d-8345-15f96d9c06e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 08:01:19.985925 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b56600-d2c2-4f7d-8345-15f96d9c06e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 08:01:19.986210 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b56600-d2c2-4f7d-8345-15f96d9c06e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 08:01:19.987117 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b56600-d2c2-4f7d-8345-15f96d9c06e4 admin admin] PATH_INFO: `/v3/users/ee4ba804be3140adbc760bcf80c299c9` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 08:01:19.988220 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b56600-d2c2-4f7d-8345-15f96d9c06e4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ee4ba804be3140adbc760bcf80c299c9)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 08:01:19.990152 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b56600-d2c2-4f7d-8345-15f96d9c06e4 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 08:01:20.035275 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-54b56600-d2c2-4f7d-8345-15f96d9c06e4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ee4ba804be3140adbc760bcf80c299c9'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 08:01:20.036067 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-54b56600-d2c2-4f7d-8345-15f96d9c06e4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ee4ba804be3140adbc760bcf80c299c9'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 08:01:20.043167 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-54b56600-d2c2-4f7d-8345-15f96d9c06e4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ee4ba804be3140adbc760bcf80c299c9'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 08:01:20.056148 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-54b56600-d2c2-4f7d-8345-15f96d9c06e4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ee4ba804be3140adbc760bcf80c299c9'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 08:01:20.062967 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-54b56600-d2c2-4f7d-8345-15f96d9c06e4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ee4ba804be3140adbc760bcf80c299c9'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 08:01:20.072729 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1343/2704] 10.222.0.57 () {58 vars in 1224 bytes} [Fri Sep 16 08:01:19 2022] DELETE /identity/v3/users/ee4ba804be3140adbc760bcf80c299c9 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 08:01:20.077223 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfd1b01-f2f3-4756-a9de-2b62db277029 None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 08:01:20.077749 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfd1b01-f2f3-4756-a9de-2b62db277029 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 08:01:20.077749 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfd1b01-f2f3-4756-a9de-2b62db277029 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 08:01:20.097488 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-fcfd1b01-f2f3-4756-a9de-2b62db277029 None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 08:01:20.098704 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-fcfd1b01-f2f3-4756-a9de-2b62db277029 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 08:01:20.157363 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1362/2705] 10.222.0.57 () {58 vars in 958 bytes} [Fri Sep 16 08:01:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 16 08:01:20.168733 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b56600-d2c2-4f7d-8345-15f96d9c06e4 admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 08:01:20.170176 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-54b56600-d2c2-4f7d-8345-15f96d9c06e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 08:01:20.238752 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b56600-d2c2-4f7d-8345-15f96d9c06e4 admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 08:01:20.242833 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc90096-22c8-4765-a1a3-eb0a5cd5e49e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1062e457207a41e4ba4f0a0c4bf36f1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4735f453c0c24cc4a1c14e9ac84a0b46', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 08:01:20.243791 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc90096-22c8-4765-a1a3-eb0a5cd5e49e service neutron] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 08:01:20.244247 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc90096-22c8-4765-a1a3-eb0a5cd5e49e service neutron] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 08:01:20.244521 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc90096-22c8-4765-a1a3-eb0a5cd5e49e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 08:01:20.255576 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc90096-22c8-4765-a1a3-eb0a5cd5e49e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 08:01:20.257097 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc90096-22c8-4765-a1a3-eb0a5cd5e49e service neutron] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 08:01:20.262785 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 08:01:20.270998 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1344/2706] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Sep 16 08:01:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 08:01:20.701930 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfd1b01-f2f3-4756-a9de-2b62db277029 None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 08:01:20.703426 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-fcfd1b01-f2f3-4756-a9de-2b62db277029 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 08:01:20.726873 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfd1b01-f2f3-4756-a9de-2b62db277029 None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 08:01:20.739270 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc90096-22c8-4765-a1a3-eb0a5cd5e49e service neutron] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 08:01:20.741410 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-8cc90096-22c8-4765-a1a3-eb0a5cd5e49e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 08:01:20.745919 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e16fff-1156-4ce8-b435-0e0c94ff0412 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 08:01:20.746567 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e16fff-1156-4ce8-b435-0e0c94ff0412 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 08:01:20.747266 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e16fff-1156-4ce8-b435-0e0c94ff0412 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 08:01:20.748232 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e16fff-1156-4ce8-b435-0e0c94ff0412 admin admin] PATH_INFO: `/v3/projects/9d517aa5e91d403783b39546cb2cde3b` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 08:01:20.749881 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e16fff-1156-4ce8-b435-0e0c94ff0412 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9d517aa5e91d403783b39546cb2cde3b)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 08:01:20.753138 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e16fff-1156-4ce8-b435-0e0c94ff0412 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 08:01:20.810775 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-25e16fff-1156-4ce8-b435-0e0c94ff0412 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9d517aa5e91d403783b39546cb2cde3b', 'request_id': 'req-25e16fff-1156-4ce8-b435-0e0c94ff0412'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 08:01:20.818948 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-25e16fff-1156-4ce8-b435-0e0c94ff0412 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9d517aa5e91d403783b39546cb2cde3b', 'request_id': 'req-25e16fff-1156-4ce8-b435-0e0c94ff0412'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 08:01:20.827169 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-25e16fff-1156-4ce8-b435-0e0c94ff0412 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9d517aa5e91d403783b39546cb2cde3b', 'request_id': 'req-25e16fff-1156-4ce8-b435-0e0c94ff0412'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 08:01:20.834740 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc90096-22c8-4765-a1a3-eb0a5cd5e49e service neutron] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 08:01:20.849797 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-25e16fff-1156-4ce8-b435-0e0c94ff0412 admin admin] The token cache is being invalidate because project 9d517aa5e91d403783b39546cb2cde3b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81431) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 08:01:20.850014 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-25e16fff-1156-4ce8-b435-0e0c94ff0412 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 08:01:20.850681 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-25e16fff-1156-4ce8-b435-0e0c94ff0412 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 08:01:20.852681 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1363/2707] 10.222.0.57 () {58 vars in 1233 bytes} [Fri Sep 16 08:01:20 2022] DELETE /identity/v3/projects/9d517aa5e91d403783b39546cb2cde3b => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 08:01:20.856748 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e16fff-1156-4ce8-b435-0e0c94ff0412 admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 08:01:20.866011 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-25e16fff-1156-4ce8-b435-0e0c94ff0412 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 08:01:20.914799 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd52a007-4809-4717-98fd-c3c291aee38b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bec4d9b08514461a1bf63c6b88f53b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4735f453c0c24cc4a1c14e9ac84a0b46', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 08:01:20.915449 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd52a007-4809-4717-98fd-c3c291aee38b service nova] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 08:01:20.915702 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd52a007-4809-4717-98fd-c3c291aee38b service nova] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 08:01:20.915971 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd52a007-4809-4717-98fd-c3c291aee38b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 08:01:20.918467 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-cd52a007-4809-4717-98fd-c3c291aee38b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 08:01:20.920686 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 08:01:20.933576 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd52a007-4809-4717-98fd-c3c291aee38b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 08:01:20.935715 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd52a007-4809-4717-98fd-c3c291aee38b service nova] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 08:01:20.945138 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e16fff-1156-4ce8-b435-0e0c94ff0412 admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 08:01:20.949786 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1345/2708] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Sep 16 08:01:20 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 16 08:01:20.950747 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd14992-a355-4311-a4b6-694de56304c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 08:01:20.951385 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd14992-a355-4311-a4b6-694de56304c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 08:01:20.951659 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd14992-a355-4311-a4b6-694de56304c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 08:01:20.951953 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd14992-a355-4311-a4b6-694de56304c0 admin admin] PATH_INFO: `/v3/users/aa1e0deb4b4b4433a4465b02564d81ce` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 08:01:20.953113 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd14992-a355-4311-a4b6-694de56304c0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aa1e0deb4b4b4433a4465b02564d81ce)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 08:01:20.955769 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd14992-a355-4311-a4b6-694de56304c0 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 08:01:21.036991 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-acd14992-a355-4311-a4b6-694de56304c0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aa1e0deb4b4b4433a4465b02564d81ce'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 08:01:21.053981 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-acd14992-a355-4311-a4b6-694de56304c0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aa1e0deb4b4b4433a4465b02564d81ce'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 08:01:21.061769 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-acd14992-a355-4311-a4b6-694de56304c0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aa1e0deb4b4b4433a4465b02564d81ce'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 08:01:21.077788 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-acd14992-a355-4311-a4b6-694de56304c0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aa1e0deb4b4b4433a4465b02564d81ce'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 08:01:21.085830 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-acd14992-a355-4311-a4b6-694de56304c0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aa1e0deb4b4b4433a4465b02564d81ce'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 08:01:21.109785 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1364/2709] 10.222.0.57 () {58 vars in 1224 bytes} [Fri Sep 16 08:01:20 2022] DELETE /identity/v3/users/aa1e0deb4b4b4433a4465b02564d81ce => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 08:01:21.404659 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd52a007-4809-4717-98fd-c3c291aee38b service nova] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 08:01:21.419334 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd52a007-4809-4717-98fd-c3c291aee38b service nova] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 08:01:21.481517 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecd5447-37a4-4d15-84fe-38b7d9fd97b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 08:01:21.482196 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecd5447-37a4-4d15-84fe-38b7d9fd97b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 08:01:21.482477 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecd5447-37a4-4d15-84fe-38b7d9fd97b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 08:01:21.482753 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecd5447-37a4-4d15-84fe-38b7d9fd97b6 admin admin] PATH_INFO: `/v3/projects/68137b9cac2c4822b20cd8c63bfa7081` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 08:01:21.483919 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ecd5447-37a4-4d15-84fe-38b7d9fd97b6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=68137b9cac2c4822b20cd8c63bfa7081)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 08:01:21.486111 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ecd5447-37a4-4d15-84fe-38b7d9fd97b6 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 08:01:21.519620 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 08:01:21.538648 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-6ecd5447-37a4-4d15-84fe-38b7d9fd97b6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '68137b9cac2c4822b20cd8c63bfa7081', 'request_id': 'req-6ecd5447-37a4-4d15-84fe-38b7d9fd97b6'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 08:01:21.545998 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-6ecd5447-37a4-4d15-84fe-38b7d9fd97b6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '68137b9cac2c4822b20cd8c63bfa7081', 'request_id': 'req-6ecd5447-37a4-4d15-84fe-38b7d9fd97b6'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 08:01:21.552098 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-6ecd5447-37a4-4d15-84fe-38b7d9fd97b6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '68137b9cac2c4822b20cd8c63bfa7081', 'request_id': 'req-6ecd5447-37a4-4d15-84fe-38b7d9fd97b6'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 08:01:21.564023 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-6ecd5447-37a4-4d15-84fe-38b7d9fd97b6 admin admin] The token cache is being invalidate because project 68137b9cac2c4822b20cd8c63bfa7081 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81430) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 08:01:21.564839 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-6ecd5447-37a4-4d15-84fe-38b7d9fd97b6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 08:01:21.565873 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-6ecd5447-37a4-4d15-84fe-38b7d9fd97b6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 08:01:21.567501 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1346/2710] 10.222.0.57 () {58 vars in 1233 bytes} [Fri Sep 16 08:01:21 2022] DELETE /identity/v3/projects/68137b9cac2c4822b20cd8c63bfa7081 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 08:01:21.572332 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f7c1b8-50ec-4e76-84a3-112ce4c4578e None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 08:01:21.572635 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f7c1b8-50ec-4e76-84a3-112ce4c4578e None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 08:01:21.572923 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f7c1b8-50ec-4e76-84a3-112ce4c4578e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 08:01:21.593004 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-e8f7c1b8-50ec-4e76-84a3-112ce4c4578e None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 08:01:21.594245 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-e8f7c1b8-50ec-4e76-84a3-112ce4c4578e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 08:01:21.657182 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1365/2711] 10.222.0.57 () {58 vars in 958 bytes} [Fri Sep 16 08:01:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 08:01:21.665206 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00734124-0851-4cfb-a5a9-a323a45145a3 None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 08:01:21.665490 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00734124-0851-4cfb-a5a9-a323a45145a3 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 08:01:21.665790 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00734124-0851-4cfb-a5a9-a323a45145a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 08:01:21.685225 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-00734124-0851-4cfb-a5a9-a323a45145a3 None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 08:01:21.686459 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-00734124-0851-4cfb-a5a9-a323a45145a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 08:01:21.695024 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1347/2712] 10.222.0.57 () {58 vars in 958 bytes} [Fri Sep 16 08:01:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 08:01:21.699148 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f7c1b8-50ec-4e76-84a3-112ce4c4578e None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 08:01:21.709464 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f7c1b8-50ec-4e76-84a3-112ce4c4578e None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 08:01:21.714060 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b930317e-3c28-4329-bddd-3e685379e371 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 08:01:21.714658 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b930317e-3c28-4329-bddd-3e685379e371 admin admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 08:01:21.714940 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b930317e-3c28-4329-bddd-3e685379e371 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 08:01:21.715215 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b930317e-3c28-4329-bddd-3e685379e371 admin admin] PATH_INFO: `/v3/domains` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 08:01:21.715857 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b930317e-3c28-4329-bddd-3e685379e371 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 08:01:21.716162 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b930317e-3c28-4329-bddd-3e685379e371 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 08:01:21.717783 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b930317e-3c28-4329-bddd-3e685379e371 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 08:01:21.729338 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1366/2713] 10.222.0.57 () {58 vars in 1153 bytes} [Fri Sep 16 08:01:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 08:01:21.733631 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00734124-0851-4cfb-a5a9-a323a45145a3 None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 08:01:21.743061 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00734124-0851-4cfb-a5a9-a323a45145a3 None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 08:01:21.747646 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed35bac0-3621-47fa-b4c8-1ac982315721 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 08:01:21.748231 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed35bac0-3621-47fa-b4c8-1ac982315721 admin admin] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 08:01:21.748504 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed35bac0-3621-47fa-b4c8-1ac982315721 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 08:01:21.748772 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed35bac0-3621-47fa-b4c8-1ac982315721 admin admin] PATH_INFO: `/v3/projects` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 08:01:21.749392 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed35bac0-3621-47fa-b4c8-1ac982315721 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 08:01:21.751289 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed35bac0-3621-47fa-b4c8-1ac982315721 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 08:01:21.782359 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1348/2714] 10.222.0.57 () {60 vars in 1153 bytes} [Fri Sep 16 08:01:21 2022] POST /identity/v3/projects => generated 385 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 08:01:21.783488 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b930317e-3c28-4329-bddd-3e685379e371 admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 08:01:21.793450 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b930317e-3c28-4329-bddd-3e685379e371 admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 08:01:21.836973 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 08:01:21.850911 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0346940d-e455-4f1e-9d02-e8004fefc16d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 08:01:21.851511 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0346940d-e455-4f1e-9d02-e8004fefc16d admin admin] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 08:01:21.851792 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0346940d-e455-4f1e-9d02-e8004fefc16d admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 08:01:21.852070 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0346940d-e455-4f1e-9d02-e8004fefc16d admin admin] PATH_INFO: `/v3/users` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 08:01:21.852699 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0346940d-e455-4f1e-9d02-e8004fefc16d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 08:01:21.854639 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0346940d-e455-4f1e-9d02-e8004fefc16d admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 08:01:21.877467 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1367/2715] 10.222.0.57 () {60 vars in 1144 bytes} [Fri Sep 16 08:01:21 2022] POST /identity/v3/users => generated 293 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 16 08:01:21.881685 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed35bac0-3621-47fa-b4c8-1ac982315721 admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 08:01:21.891739 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed35bac0-3621-47fa-b4c8-1ac982315721 admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 08:01:21.896606 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510affcc-cf8d-4f2d-905a-d441483090c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 08:01:21.897188 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510affcc-cf8d-4f2d-905a-d441483090c5 admin admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 08:01:21.897463 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510affcc-cf8d-4f2d-905a-d441483090c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 08:01:21.897746 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510affcc-cf8d-4f2d-905a-d441483090c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 08:01:21.898707 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510affcc-cf8d-4f2d-905a-d441483090c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 08:01:21.900271 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510affcc-cf8d-4f2d-905a-d441483090c5 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 08:01:21.910019 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1349/2716] 10.222.0.57 () {58 vars in 1122 bytes} [Fri Sep 16 08:01:21 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 08:01:21.913746 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0346940d-e455-4f1e-9d02-e8004fefc16d admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 08:01:21.924313 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0346940d-e455-4f1e-9d02-e8004fefc16d admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 08:01:21.928914 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32813d75-ca35-4822-b221-c0bf039515a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 08:01:21.929508 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32813d75-ca35-4822-b221-c0bf039515a6 admin admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 08:01:21.929818 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32813d75-ca35-4822-b221-c0bf039515a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 08:01:21.930088 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32813d75-ca35-4822-b221-c0bf039515a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 08:01:21.930713 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32813d75-ca35-4822-b221-c0bf039515a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 08:01:21.932284 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32813d75-ca35-4822-b221-c0bf039515a6 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 08:01:21.944146 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1368/2717] 10.222.0.57 () {58 vars in 1122 bytes} [Fri Sep 16 08:01:21 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 08:01:21.948189 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510affcc-cf8d-4f2d-905a-d441483090c5 admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 08:01:21.958402 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510affcc-cf8d-4f2d-905a-d441483090c5 admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 08:01:21.963040 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96e7353-4e70-4587-9890-c918c2222ca1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 08:01:21.963698 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96e7353-4e70-4587-9890-c918c2222ca1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 08:01:21.963982 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96e7353-4e70-4587-9890-c918c2222ca1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 08:01:21.964255 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96e7353-4e70-4587-9890-c918c2222ca1 admin admin] PATH_INFO: `/v3/projects/f8d52661ffa04d11be29078b76190d63/users/02c0e774a7ef49e59dcd5e7d2f8c10d3/roles/4818d38cf2564825b312e66c9eb24762` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 08:01:21.978734 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96e7353-4e70-4587-9890-c918c2222ca1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f8d52661ffa04d11be29078b76190d63, user_id=02c0e774a7ef49e59dcd5e7d2f8c10d3, role_id=4818d38cf2564825b312e66c9eb24762)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 08:01:21.981377 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96e7353-4e70-4587-9890-c918c2222ca1 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 08:01:21.994610 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1350/2718] 10.222.0.57 () {60 vars in 1483 bytes} [Fri Sep 16 08:01:21 2022] PUT /identity/v3/projects/f8d52661ffa04d11be29078b76190d63/users/02c0e774a7ef49e59dcd5e7d2f8c10d3/roles/4818d38cf2564825b312e66c9eb24762 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 16 08:01:22.005323 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5607f300-44b9-413a-b4af-08539cf7e33c None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 08:01:22.005609 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5607f300-44b9-413a-b4af-08539cf7e33c None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 08:01:22.006036 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5607f300-44b9-413a-b4af-08539cf7e33c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 08:01:22.033654 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-5607f300-44b9-413a-b4af-08539cf7e33c None None] MFA Rules not processed for user `02c0e774a7ef49e59dcd5e7d2f8c10d3`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 08:01:22.034912 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-5607f300-44b9-413a-b4af-08539cf7e33c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 08:01:22.098788 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1369/2719] 10.222.0.57 () {58 vars in 958 bytes} [Fri Sep 16 08:01:22 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 08:01:22.103276 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96e7353-4e70-4587-9890-c918c2222ca1 admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 08:01:22.172593 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96e7353-4e70-4587-9890-c918c2222ca1 admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 08:01:22.177898 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058af36f-7857-4f2a-a8ed-78c27411d30b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 08:01:22.178510 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058af36f-7857-4f2a-a8ed-78c27411d30b admin admin] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 08:01:22.178793 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058af36f-7857-4f2a-a8ed-78c27411d30b admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 08:01:22.179066 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058af36f-7857-4f2a-a8ed-78c27411d30b admin admin] PATH_INFO: `/v3/projects` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 08:01:22.179711 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058af36f-7857-4f2a-a8ed-78c27411d30b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 08:01:22.181599 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058af36f-7857-4f2a-a8ed-78c27411d30b admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 08:01:22.212739 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1351/2720] 10.222.0.57 () {60 vars in 1153 bytes} [Fri Sep 16 08:01:22 2022] POST /identity/v3/projects => generated 385 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 08:01:22.216464 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5607f300-44b9-413a-b4af-08539cf7e33c None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 08:01:22.227417 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5607f300-44b9-413a-b4af-08539cf7e33c None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 08:01:22.291966 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f65e76e-7cc9-4eed-8ba8-e9539558b697 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 08:01:22.292554 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f65e76e-7cc9-4eed-8ba8-e9539558b697 admin admin] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 08:01:22.292835 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f65e76e-7cc9-4eed-8ba8-e9539558b697 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 08:01:22.293490 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f65e76e-7cc9-4eed-8ba8-e9539558b697 admin admin] PATH_INFO: `/v3/users` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 08:01:22.293793 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f65e76e-7cc9-4eed-8ba8-e9539558b697 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 08:01:22.296101 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f65e76e-7cc9-4eed-8ba8-e9539558b697 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 08:01:22.327477 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1370/2721] 10.222.0.57 () {60 vars in 1144 bytes} [Fri Sep 16 08:01:22 2022] POST /identity/v3/users => generated 293 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 08:01:22.332243 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058af36f-7857-4f2a-a8ed-78c27411d30b admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 08:01:22.344065 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058af36f-7857-4f2a-a8ed-78c27411d30b admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 08:01:22.349374 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401a4164-62c2-44bd-893c-b143c62a28cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 08:01:22.349958 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401a4164-62c2-44bd-893c-b143c62a28cb admin admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 08:01:22.350242 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401a4164-62c2-44bd-893c-b143c62a28cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 08:01:22.350520 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401a4164-62c2-44bd-893c-b143c62a28cb admin admin] PATH_INFO: `/v3/roles` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 08:01:22.351167 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401a4164-62c2-44bd-893c-b143c62a28cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 08:01:22.352763 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401a4164-62c2-44bd-893c-b143c62a28cb admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 08:01:22.365752 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1352/2722] 10.222.0.57 () {58 vars in 1122 bytes} [Fri Sep 16 08:01:22 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 08:01:22.368254 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f65e76e-7cc9-4eed-8ba8-e9539558b697 admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 08:01:22.379026 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f65e76e-7cc9-4eed-8ba8-e9539558b697 admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 08:01:22.383807 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed8a495-f73c-4d11-a192-1aabbbc0bf84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 08:01:22.384481 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed8a495-f73c-4d11-a192-1aabbbc0bf84 admin admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 08:01:22.384825 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed8a495-f73c-4d11-a192-1aabbbc0bf84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 08:01:22.385098 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed8a495-f73c-4d11-a192-1aabbbc0bf84 admin admin] PATH_INFO: `/v3/roles` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 08:01:22.385769 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed8a495-f73c-4d11-a192-1aabbbc0bf84 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 08:01:22.387371 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed8a495-f73c-4d11-a192-1aabbbc0bf84 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 08:01:22.401761 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1371/2723] 10.222.0.57 () {58 vars in 1122 bytes} [Fri Sep 16 08:01:22 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 08:01:22.402938 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401a4164-62c2-44bd-893c-b143c62a28cb admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 08:01:22.413406 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401a4164-62c2-44bd-893c-b143c62a28cb admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 08:01:22.418213 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3fde8c-1208-4197-aa85-02eca64369fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 08:01:22.418867 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3fde8c-1208-4197-aa85-02eca64369fc admin admin] REQUEST_METHOD: `PUT` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 08:01:22.419148 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3fde8c-1208-4197-aa85-02eca64369fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 08:01:22.419424 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3fde8c-1208-4197-aa85-02eca64369fc admin admin] PATH_INFO: `/v3/projects/871d056b7f604c7089343d49f0395816/users/e53de68287f74a3c83820592d1450892/roles/4818d38cf2564825b312e66c9eb24762` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 08:01:22.434919 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3fde8c-1208-4197-aa85-02eca64369fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=871d056b7f604c7089343d49f0395816, user_id=e53de68287f74a3c83820592d1450892, role_id=4818d38cf2564825b312e66c9eb24762)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 08:01:22.437570 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3fde8c-1208-4197-aa85-02eca64369fc admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 08:01:22.448184 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:DELETE=6,keystone:SELECT=89,keystone:INSERT=5 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 08:01:22.453032 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1353/2724] 10.222.0.57 () {60 vars in 1483 bytes} [Fri Sep 16 08:01:22 2022] PUT /identity/v3/projects/871d056b7f604c7089343d49f0395816/users/e53de68287f74a3c83820592d1450892/roles/4818d38cf2564825b312e66c9eb24762 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 08:01:22.465217 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb51a34-7175-498e-87f7-384453d4074d None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 08:01:22.465571 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb51a34-7175-498e-87f7-384453d4074d None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 08:01:22.466019 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb51a34-7175-498e-87f7-384453d4074d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 08:01:22.494324 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-eeb51a34-7175-498e-87f7-384453d4074d None None] MFA Rules not processed for user `e53de68287f74a3c83820592d1450892`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 08:01:22.495533 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-eeb51a34-7175-498e-87f7-384453d4074d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 08:01:22.515416 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 08:01:22.562667 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1372/2725] 10.222.0.57 () {58 vars in 958 bytes} [Fri Sep 16 08:01:22 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 16 08:01:22.568026 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3fde8c-1208-4197-aa85-02eca64369fc admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 08:01:22.632317 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3fde8c-1208-4197-aa85-02eca64369fc admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 08:01:22.637042 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdac3689-879d-4488-a77c-6d0d5567a8d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 08:01:22.637646 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdac3689-879d-4488-a77c-6d0d5567a8d1 admin admin] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 08:01:22.637961 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdac3689-879d-4488-a77c-6d0d5567a8d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 08:01:22.638236 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdac3689-879d-4488-a77c-6d0d5567a8d1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 08:01:22.638877 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdac3689-879d-4488-a77c-6d0d5567a8d1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 08:01:22.640780 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdac3689-879d-4488-a77c-6d0d5567a8d1 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 08:01:22.671002 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1354/2726] 10.222.0.57 () {60 vars in 1153 bytes} [Fri Sep 16 08:01:22 2022] POST /identity/v3/projects => generated 383 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 08:01:22.675787 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb51a34-7175-498e-87f7-384453d4074d None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 08:01:22.686580 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb51a34-7175-498e-87f7-384453d4074d None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 08:01:22.743995 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085c5185-839c-4f13-beff-7a98856f2ff1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 08:01:22.744601 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085c5185-839c-4f13-beff-7a98856f2ff1 admin admin] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 08:01:22.744883 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085c5185-839c-4f13-beff-7a98856f2ff1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 08:01:22.745160 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085c5185-839c-4f13-beff-7a98856f2ff1 admin admin] PATH_INFO: `/v3/users` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 08:01:22.745804 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085c5185-839c-4f13-beff-7a98856f2ff1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 08:01:22.747702 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085c5185-839c-4f13-beff-7a98856f2ff1 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 08:01:22.772452 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1373/2727] 10.222.0.57 () {60 vars in 1144 bytes} [Fri Sep 16 08:01:22 2022] POST /identity/v3/users => generated 298 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 16 08:01:22.773966 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdac3689-879d-4488-a77c-6d0d5567a8d1 admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 08:01:22.784529 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdac3689-879d-4488-a77c-6d0d5567a8d1 admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 08:01:22.789248 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f9bfa4-9588-439f-b296-0b56c59509a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 08:01:22.789981 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f9bfa4-9588-439f-b296-0b56c59509a2 admin admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 08:01:22.790324 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f9bfa4-9588-439f-b296-0b56c59509a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 08:01:22.790676 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f9bfa4-9588-439f-b296-0b56c59509a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 08:01:22.791381 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f9bfa4-9588-439f-b296-0b56c59509a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 08:01:22.793041 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f9bfa4-9588-439f-b296-0b56c59509a2 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 08:01:22.807434 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1355/2728] 10.222.0.57 () {58 vars in 1122 bytes} [Fri Sep 16 08:01:22 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 08:01:22.808780 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085c5185-839c-4f13-beff-7a98856f2ff1 admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 08:01:22.820069 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085c5185-839c-4f13-beff-7a98856f2ff1 admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 08:01:22.824828 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9cba53-4e9c-4a4d-84d4-353f8c072b92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 08:01:22.825465 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9cba53-4e9c-4a4d-84d4-353f8c072b92 admin admin] REQUEST_METHOD: `PUT` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 08:01:22.825777 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9cba53-4e9c-4a4d-84d4-353f8c072b92 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 08:01:22.826053 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9cba53-4e9c-4a4d-84d4-353f8c072b92 admin admin] PATH_INFO: `/v3/projects/d65da1c3c0194edfbafffbe8f3e4deb9/users/f4450313a08a41fbb9511aca327a890c/roles/567db03c91854ad9af1e9a87ec1bd275` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 08:01:22.842022 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9cba53-4e9c-4a4d-84d4-353f8c072b92 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d65da1c3c0194edfbafffbe8f3e4deb9, user_id=f4450313a08a41fbb9511aca327a890c, role_id=567db03c91854ad9af1e9a87ec1bd275)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 08:01:22.844697 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9cba53-4e9c-4a4d-84d4-353f8c072b92 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 08:01:22.859182 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1374/2729] 10.222.0.57 () {60 vars in 1483 bytes} [Fri Sep 16 08:01:22 2022] PUT /identity/v3/projects/d65da1c3c0194edfbafffbe8f3e4deb9/users/f4450313a08a41fbb9511aca327a890c/roles/567db03c91854ad9af1e9a87ec1bd275 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 08:01:22.863524 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f9bfa4-9588-439f-b296-0b56c59509a2 admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 08:01:22.874822 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f9bfa4-9588-439f-b296-0b56c59509a2 admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 08:01:22.934429 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bb130d-f8f5-4e8f-ab8c-e08a7da87035 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 08:01:22.935041 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bb130d-f8f5-4e8f-ab8c-e08a7da87035 admin admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 08:01:22.935319 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bb130d-f8f5-4e8f-ab8c-e08a7da87035 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 08:01:22.935592 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bb130d-f8f5-4e8f-ab8c-e08a7da87035 admin admin] PATH_INFO: `/v3/roles` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 08:01:22.936306 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bb130d-f8f5-4e8f-ab8c-e08a7da87035 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 08:01:22.937832 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bb130d-f8f5-4e8f-ab8c-e08a7da87035 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 08:01:22.948417 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1356/2730] 10.222.0.57 () {58 vars in 1122 bytes} [Fri Sep 16 08:01:22 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 08:01:22.952612 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9cba53-4e9c-4a4d-84d4-353f8c072b92 admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 08:01:22.963743 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9cba53-4e9c-4a4d-84d4-353f8c072b92 admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 08:01:22.968324 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7001d9-6b01-482a-99f4-f76c62398b98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 08:01:22.968994 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7001d9-6b01-482a-99f4-f76c62398b98 admin admin] REQUEST_METHOD: `PUT` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 08:01:22.969224 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7001d9-6b01-482a-99f4-f76c62398b98 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 08:01:22.969488 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7001d9-6b01-482a-99f4-f76c62398b98 admin admin] PATH_INFO: `/v3/projects/d65da1c3c0194edfbafffbe8f3e4deb9/users/f4450313a08a41fbb9511aca327a890c/roles/567db03c91854ad9af1e9a87ec1bd275` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 08:01:22.971523 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7001d9-6b01-482a-99f4-f76c62398b98 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d65da1c3c0194edfbafffbe8f3e4deb9, user_id=f4450313a08a41fbb9511aca327a890c, role_id=567db03c91854ad9af1e9a87ec1bd275)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 08:01:22.974174 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7001d9-6b01-482a-99f4-f76c62398b98 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 08:01:22.985002 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1375/2731] 10.222.0.57 () {60 vars in 1483 bytes} [Fri Sep 16 08:01:22 2022] PUT /identity/v3/projects/d65da1c3c0194edfbafffbe8f3e4deb9/users/f4450313a08a41fbb9511aca327a890c/roles/567db03c91854ad9af1e9a87ec1bd275 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 08:01:22.995266 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803ab6e4-45a7-442c-bd65-9de8d361ee96 None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 08:01:22.995635 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803ab6e4-45a7-442c-bd65-9de8d361ee96 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 08:01:22.996011 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803ab6e4-45a7-442c-bd65-9de8d361ee96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 08:01:23.026297 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-803ab6e4-45a7-442c-bd65-9de8d361ee96 None None] MFA Rules not processed for user `f4450313a08a41fbb9511aca327a890c`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 08:01:23.027537 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-803ab6e4-45a7-442c-bd65-9de8d361ee96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 08:01:23.090519 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 08:01:23.105605 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1357/2732] 10.222.0.57 () {58 vars in 958 bytes} [Fri Sep 16 08:01:22 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 08:01:23.117490 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7001d9-6b01-482a-99f4-f76c62398b98 admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 08:01:23.119530 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-fe7001d9-6b01-482a-99f4-f76c62398b98 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 08:01:23.187686 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7001d9-6b01-482a-99f4-f76c62398b98 admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 08:01:23.192067 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a7af6d-248c-44f1-8645-fe1f66d9e401 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544bf6be4c24454a013ca110c43cef2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4735f453c0c24cc4a1c14e9ac84a0b46', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 08:01:23.192699 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a7af6d-248c-44f1-8645-fe1f66d9e401 service cinder] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 08:01:23.193008 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a7af6d-248c-44f1-8645-fe1f66d9e401 service cinder] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 08:01:23.193281 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a7af6d-248c-44f1-8645-fe1f66d9e401 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 08:01:23.229440 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 08:01:23.263653 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a7af6d-248c-44f1-8645-fe1f66d9e401 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 08:01:23.265341 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a7af6d-248c-44f1-8645-fe1f66d9e401 service cinder] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 08:01:23.279471 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1376/2733] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Sep 16 08:01:23 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 08:01:24.832223 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803ab6e4-45a7-442c-bd65-9de8d361ee96 None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 08:01:24.834294 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-803ab6e4-45a7-442c-bd65-9de8d361ee96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 08:01:24.847981 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803ab6e4-45a7-442c-bd65-9de8d361ee96 None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 08:01:24.853699 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c25d5d1-adb7-4150-a978-bba8293f90ee service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544bf6be4c24454a013ca110c43cef2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4735f453c0c24cc4a1c14e9ac84a0b46', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 08:01:24.854688 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c25d5d1-adb7-4150-a978-bba8293f90ee service cinder] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 08:01:24.855060 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c25d5d1-adb7-4150-a978-bba8293f90ee service cinder] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 08:01:24.855400 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c25d5d1-adb7-4150-a978-bba8293f90ee service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 08:01:24.922735 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c25d5d1-adb7-4150-a978-bba8293f90ee service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 08:01:24.925078 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c25d5d1-adb7-4150-a978-bba8293f90ee service cinder] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 08:01:24.936317 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1358/2734] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Sep 16 08:01:24 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 08:01:25.604378 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a7af6d-248c-44f1-8645-fe1f66d9e401 service cinder] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 08:01:25.613941 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a7af6d-248c-44f1-8645-fe1f66d9e401 service cinder] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 08:01:25.617492 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce49cdb-bfea-446e-8c12-b73ec25b7f9e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544bf6be4c24454a013ca110c43cef2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4735f453c0c24cc4a1c14e9ac84a0b46', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 08:01:25.618116 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce49cdb-bfea-446e-8c12-b73ec25b7f9e service cinder] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 08:01:25.618391 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce49cdb-bfea-446e-8c12-b73ec25b7f9e service cinder] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 08:01:25.618656 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce49cdb-bfea-446e-8c12-b73ec25b7f9e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 08:01:25.628207 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce49cdb-bfea-446e-8c12-b73ec25b7f9e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 08:01:25.629624 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce49cdb-bfea-446e-8c12-b73ec25b7f9e service cinder] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 08:01:25.639259 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1377/2735] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Sep 16 08:01:25 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 08:01:28.686627 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c25d5d1-adb7-4150-a978-bba8293f90ee service cinder] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 08:01:28.688037 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-7c25d5d1-adb7-4150-a978-bba8293f90ee service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 08:01:28.764725 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c25d5d1-adb7-4150-a978-bba8293f90ee service cinder] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 08:01:28.769474 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c207312-a875-4bfa-8ea3-7b28bdca83f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 08:01:28.770139 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c207312-a875-4bfa-8ea3-7b28bdca83f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 08:01:28.770420 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c207312-a875-4bfa-8ea3-7b28bdca83f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 08:01:28.770690 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c207312-a875-4bfa-8ea3-7b28bdca83f6 admin admin] PATH_INFO: `/v3/users/ed7a1886d2184619bb493de128365fa2` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 08:01:28.771823 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c207312-a875-4bfa-8ea3-7b28bdca83f6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ed7a1886d2184619bb493de128365fa2)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 08:01:28.773756 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c207312-a875-4bfa-8ea3-7b28bdca83f6 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 08:01:28.819053 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-0c207312-a875-4bfa-8ea3-7b28bdca83f6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ed7a1886d2184619bb493de128365fa2'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 08:01:28.819699 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-0c207312-a875-4bfa-8ea3-7b28bdca83f6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ed7a1886d2184619bb493de128365fa2'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 08:01:28.827362 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-0c207312-a875-4bfa-8ea3-7b28bdca83f6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ed7a1886d2184619bb493de128365fa2'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 08:01:28.839688 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-0c207312-a875-4bfa-8ea3-7b28bdca83f6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ed7a1886d2184619bb493de128365fa2'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 08:01:28.847347 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-0c207312-a875-4bfa-8ea3-7b28bdca83f6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ed7a1886d2184619bb493de128365fa2'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 08:01:28.853614 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1359/2736] 10.222.0.57 () {58 vars in 1224 bytes} [Fri Sep 16 08:01:28 2022] DELETE /identity/v3/users/ed7a1886d2184619bb493de128365fa2 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 08:01:29.030517 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce49cdb-bfea-446e-8c12-b73ec25b7f9e service cinder] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 08:01:29.042036 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce49cdb-bfea-446e-8c12-b73ec25b7f9e service cinder] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 08:01:29.102726 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77734dc3-504c-4e91-828c-bd22cc16e510 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 08:01:29.103354 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77734dc3-504c-4e91-828c-bd22cc16e510 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 08:01:29.103632 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77734dc3-504c-4e91-828c-bd22cc16e510 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 08:01:29.103902 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77734dc3-504c-4e91-828c-bd22cc16e510 admin admin] PATH_INFO: `/v3/projects/65db6ec3249b4c778f0c0c3207d65253` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 08:01:29.105022 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77734dc3-504c-4e91-828c-bd22cc16e510 admin admin] RBAC: Authorizing `identity:delete_project(project_id=65db6ec3249b4c778f0c0c3207d65253)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 08:01:29.107005 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77734dc3-504c-4e91-828c-bd22cc16e510 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 08:01:29.152720 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-77734dc3-504c-4e91-828c-bd22cc16e510 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '65db6ec3249b4c778f0c0c3207d65253', 'request_id': 'req-77734dc3-504c-4e91-828c-bd22cc16e510'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 08:01:29.159348 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-77734dc3-504c-4e91-828c-bd22cc16e510 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '65db6ec3249b4c778f0c0c3207d65253', 'request_id': 'req-77734dc3-504c-4e91-828c-bd22cc16e510'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 08:01:29.166642 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-77734dc3-504c-4e91-828c-bd22cc16e510 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '65db6ec3249b4c778f0c0c3207d65253', 'request_id': 'req-77734dc3-504c-4e91-828c-bd22cc16e510'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 08:01:29.177590 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-77734dc3-504c-4e91-828c-bd22cc16e510 admin admin] The token cache is being invalidate because project 65db6ec3249b4c778f0c0c3207d65253 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81431) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 08:01:29.177911 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-77734dc3-504c-4e91-828c-bd22cc16e510 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 08:01:29.178541 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-77734dc3-504c-4e91-828c-bd22cc16e510 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 08:01:29.180014 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1378/2737] 10.222.0.57 () {58 vars in 1233 bytes} [Fri Sep 16 08:01:29 2022] DELETE /identity/v3/projects/65db6ec3249b4c778f0c0c3207d65253 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 08:01:29.184006 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c207312-a875-4bfa-8ea3-7b28bdca83f6 admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 08:01:29.185398 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-0c207312-a875-4bfa-8ea3-7b28bdca83f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 08:01:29.198561 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c207312-a875-4bfa-8ea3-7b28bdca83f6 admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 08:01:29.206990 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 08:01:29.259028 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63438b06-cd7a-46e0-9f22-08d5a87df700 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 08:01:29.259646 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63438b06-cd7a-46e0-9f22-08d5a87df700 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 08:01:29.259924 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63438b06-cd7a-46e0-9f22-08d5a87df700 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 08:01:29.260195 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63438b06-cd7a-46e0-9f22-08d5a87df700 admin admin] PATH_INFO: `/v3/users/34f9d38540fd43f4a10e319931f69059` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 08:01:29.261299 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63438b06-cd7a-46e0-9f22-08d5a87df700 admin admin] RBAC: Authorizing `identity:delete_user(user_id=34f9d38540fd43f4a10e319931f69059)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 08:01:29.263243 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63438b06-cd7a-46e0-9f22-08d5a87df700 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 08:01:29.309134 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-63438b06-cd7a-46e0-9f22-08d5a87df700 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '34f9d38540fd43f4a10e319931f69059'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 08:01:29.309815 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-63438b06-cd7a-46e0-9f22-08d5a87df700 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '34f9d38540fd43f4a10e319931f69059'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 08:01:29.317238 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-63438b06-cd7a-46e0-9f22-08d5a87df700 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '34f9d38540fd43f4a10e319931f69059'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 08:01:29.330191 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-63438b06-cd7a-46e0-9f22-08d5a87df700 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '34f9d38540fd43f4a10e319931f69059'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 08:01:29.337216 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-63438b06-cd7a-46e0-9f22-08d5a87df700 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '34f9d38540fd43f4a10e319931f69059'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 08:01:29.347026 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1360/2738] 10.222.0.57 () {58 vars in 1224 bytes} [Fri Sep 16 08:01:29 2022] DELETE /identity/v3/users/34f9d38540fd43f4a10e319931f69059 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 08:01:29.356696 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77734dc3-504c-4e91-828c-bd22cc16e510 admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 08:01:29.358129 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-77734dc3-504c-4e91-828c-bd22cc16e510 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 08:01:29.411139 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 08:01:29.417501 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77734dc3-504c-4e91-828c-bd22cc16e510 admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 08:01:29.465155 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d76cfa-324d-4b61-b8f9-31f21eac9be5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1062e457207a41e4ba4f0a0c4bf36f1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4735f453c0c24cc4a1c14e9ac84a0b46', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 08:01:29.465692 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d76cfa-324d-4b61-b8f9-31f21eac9be5 service neutron] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 08:01:29.465998 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d76cfa-324d-4b61-b8f9-31f21eac9be5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 08:01:29.466266 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d76cfa-324d-4b61-b8f9-31f21eac9be5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 08:01:29.467969 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-a4d76cfa-324d-4b61-b8f9-31f21eac9be5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 08:01:29.529131 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d76cfa-324d-4b61-b8f9-31f21eac9be5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 08:01:29.530574 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d76cfa-324d-4b61-b8f9-31f21eac9be5 service neutron] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 08:01:29.542133 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1379/2739] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Sep 16 08:01:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 08:01:29.680410 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63438b06-cd7a-46e0-9f22-08d5a87df700 admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 08:01:29.681860 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-63438b06-cd7a-46e0-9f22-08d5a87df700 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 08:01:29.695622 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63438b06-cd7a-46e0-9f22-08d5a87df700 admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 08:01:29.700249 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb39c941-0184-46ea-a738-51643dab5fb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 08:01:29.700870 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb39c941-0184-46ea-a738-51643dab5fb2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 08:01:29.701147 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb39c941-0184-46ea-a738-51643dab5fb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 08:01:29.701425 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb39c941-0184-46ea-a738-51643dab5fb2 admin admin] PATH_INFO: `/v3/users/02c0e774a7ef49e59dcd5e7d2f8c10d3` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 08:01:29.702559 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb39c941-0184-46ea-a738-51643dab5fb2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=02c0e774a7ef49e59dcd5e7d2f8c10d3)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 08:01:29.705078 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb39c941-0184-46ea-a738-51643dab5fb2 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 08:01:29.716312 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d76cfa-324d-4b61-b8f9-31f21eac9be5 service neutron] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 08:01:29.717967 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-a4d76cfa-324d-4b61-b8f9-31f21eac9be5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 08:01:29.733248 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d76cfa-324d-4b61-b8f9-31f21eac9be5 service neutron] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 08:01:29.738388 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a15bff-0bf5-4ec8-9a84-c89d10dccfa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 08:01:29.739476 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a15bff-0bf5-4ec8-9a84-c89d10dccfa9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 08:01:29.739476 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a15bff-0bf5-4ec8-9a84-c89d10dccfa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 08:01:29.739864 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a15bff-0bf5-4ec8-9a84-c89d10dccfa9 admin admin] PATH_INFO: `/v3/projects/cdfbeab307284394abaaf2efef91f362` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 08:01:29.741086 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a15bff-0bf5-4ec8-9a84-c89d10dccfa9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cdfbeab307284394abaaf2efef91f362)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 08:01:29.743776 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a15bff-0bf5-4ec8-9a84-c89d10dccfa9 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 08:01:29.767036 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-cb39c941-0184-46ea-a738-51643dab5fb2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '02c0e774a7ef49e59dcd5e7d2f8c10d3'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 08:01:29.768301 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-cb39c941-0184-46ea-a738-51643dab5fb2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '02c0e774a7ef49e59dcd5e7d2f8c10d3'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 08:01:29.776055 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-cb39c941-0184-46ea-a738-51643dab5fb2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '02c0e774a7ef49e59dcd5e7d2f8c10d3'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 08:01:29.788505 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-cb39c941-0184-46ea-a738-51643dab5fb2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '02c0e774a7ef49e59dcd5e7d2f8c10d3'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 08:01:29.795645 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-76a15bff-0bf5-4ec8-9a84-c89d10dccfa9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cdfbeab307284394abaaf2efef91f362', 'request_id': 'req-76a15bff-0bf5-4ec8-9a84-c89d10dccfa9'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 08:01:29.796041 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-cb39c941-0184-46ea-a738-51643dab5fb2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '02c0e774a7ef49e59dcd5e7d2f8c10d3'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 08:01:29.801906 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-76a15bff-0bf5-4ec8-9a84-c89d10dccfa9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cdfbeab307284394abaaf2efef91f362', 'request_id': 'req-76a15bff-0bf5-4ec8-9a84-c89d10dccfa9'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 08:01:29.802881 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1361/2740] 10.222.0.57 () {58 vars in 1224 bytes} [Fri Sep 16 08:01:29 2022] DELETE /identity/v3/users/02c0e774a7ef49e59dcd5e7d2f8c10d3 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 08:01:29.807807 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804b1309-0ebf-46f6-9256-7bee8d764cb7 None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 08:01:29.808212 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804b1309-0ebf-46f6-9256-7bee8d764cb7 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 08:01:29.808439 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804b1309-0ebf-46f6-9256-7bee8d764cb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 08:01:29.812919 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-76a15bff-0bf5-4ec8-9a84-c89d10dccfa9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cdfbeab307284394abaaf2efef91f362', 'request_id': 'req-76a15bff-0bf5-4ec8-9a84-c89d10dccfa9'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 08:01:29.817802 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 08:01:29.826458 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-76a15bff-0bf5-4ec8-9a84-c89d10dccfa9 admin admin] The token cache is being invalidate because project cdfbeab307284394abaaf2efef91f362 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81431) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 08:01:29.826886 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-76a15bff-0bf5-4ec8-9a84-c89d10dccfa9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 08:01:29.827634 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-76a15bff-0bf5-4ec8-9a84-c89d10dccfa9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 08:01:29.829280 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1380/2741] 10.222.0.57 () {58 vars in 1233 bytes} [Fri Sep 16 08:01:29 2022] DELETE /identity/v3/projects/cdfbeab307284394abaaf2efef91f362 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 08:01:29.831546 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-804b1309-0ebf-46f6-9256-7bee8d764cb7 None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 08:01:29.833380 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-804b1309-0ebf-46f6-9256-7bee8d764cb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 08:01:29.901756 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1362/2742] 10.222.0.57 () {58 vars in 958 bytes} [Fri Sep 16 08:01:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 16 08:01:29.912344 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a15bff-0bf5-4ec8-9a84-c89d10dccfa9 admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 08:01:29.913865 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-76a15bff-0bf5-4ec8-9a84-c89d10dccfa9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 08:01:29.959316 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 08:01:29.980900 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a15bff-0bf5-4ec8-9a84-c89d10dccfa9 admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 08:01:30.034492 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aab140d-ae3a-4535-a9a9-c09d5ed13f95 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1062e457207a41e4ba4f0a0c4bf36f1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4735f453c0c24cc4a1c14e9ac84a0b46', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 08:01:30.035173 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aab140d-ae3a-4535-a9a9-c09d5ed13f95 service neutron] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 08:01:30.035381 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aab140d-ae3a-4535-a9a9-c09d5ed13f95 service neutron] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 08:01:30.035649 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aab140d-ae3a-4535-a9a9-c09d5ed13f95 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 08:01:30.045952 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aab140d-ae3a-4535-a9a9-c09d5ed13f95 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 08:01:30.047566 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aab140d-ae3a-4535-a9a9-c09d5ed13f95 service neutron] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 08:01:30.059140 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1381/2743] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Sep 16 08:01:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 08:01:30.327706 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804b1309-0ebf-46f6-9256-7bee8d764cb7 None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 08:01:30.329162 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-804b1309-0ebf-46f6-9256-7bee8d764cb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 08:01:30.341393 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804b1309-0ebf-46f6-9256-7bee8d764cb7 None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 08:01:30.346450 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506997cf-c9c8-4177-8646-67bb18eabc00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 08:01:30.347103 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506997cf-c9c8-4177-8646-67bb18eabc00 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 08:01:30.347381 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506997cf-c9c8-4177-8646-67bb18eabc00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 08:01:30.347652 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506997cf-c9c8-4177-8646-67bb18eabc00 admin admin] PATH_INFO: `/v3/projects/f8d52661ffa04d11be29078b76190d63` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 08:01:30.348778 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506997cf-c9c8-4177-8646-67bb18eabc00 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f8d52661ffa04d11be29078b76190d63)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 08:01:30.350771 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506997cf-c9c8-4177-8646-67bb18eabc00 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 08:01:30.398182 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-506997cf-c9c8-4177-8646-67bb18eabc00 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f8d52661ffa04d11be29078b76190d63', 'request_id': 'req-506997cf-c9c8-4177-8646-67bb18eabc00'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 08:01:30.405469 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-506997cf-c9c8-4177-8646-67bb18eabc00 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f8d52661ffa04d11be29078b76190d63', 'request_id': 'req-506997cf-c9c8-4177-8646-67bb18eabc00'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 08:01:30.412521 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-506997cf-c9c8-4177-8646-67bb18eabc00 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f8d52661ffa04d11be29078b76190d63', 'request_id': 'req-506997cf-c9c8-4177-8646-67bb18eabc00'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 08:01:30.425030 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-506997cf-c9c8-4177-8646-67bb18eabc00 admin admin] The token cache is being invalidate because project f8d52661ffa04d11be29078b76190d63 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81430) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 08:01:30.425322 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-506997cf-c9c8-4177-8646-67bb18eabc00 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 08:01:30.426027 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-506997cf-c9c8-4177-8646-67bb18eabc00 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 08:01:30.427522 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1363/2744] 10.222.0.57 () {58 vars in 1233 bytes} [Fri Sep 16 08:01:30 2022] DELETE /identity/v3/projects/f8d52661ffa04d11be29078b76190d63 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 08:01:30.431515 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aab140d-ae3a-4535-a9a9-c09d5ed13f95 service neutron] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 08:01:30.441079 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aab140d-ae3a-4535-a9a9-c09d5ed13f95 service neutron] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 08:01:30.503040 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e258f6-c154-4a93-9b5c-9df3849ec67b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 08:01:30.503668 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e258f6-c154-4a93-9b5c-9df3849ec67b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 08:01:30.504002 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e258f6-c154-4a93-9b5c-9df3849ec67b admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 08:01:30.504222 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e258f6-c154-4a93-9b5c-9df3849ec67b admin admin] PATH_INFO: `/v3/users/e53de68287f74a3c83820592d1450892` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 08:01:30.505343 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e258f6-c154-4a93-9b5c-9df3849ec67b admin admin] RBAC: Authorizing `identity:delete_user(user_id=e53de68287f74a3c83820592d1450892)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 08:01:30.507290 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e258f6-c154-4a93-9b5c-9df3849ec67b admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 08:01:30.552715 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-74e258f6-c154-4a93-9b5c-9df3849ec67b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e53de68287f74a3c83820592d1450892'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 08:01:30.564355 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-74e258f6-c154-4a93-9b5c-9df3849ec67b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e53de68287f74a3c83820592d1450892'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 08:01:30.565022 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-74e258f6-c154-4a93-9b5c-9df3849ec67b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e53de68287f74a3c83820592d1450892'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 08:01:30.572153 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-74e258f6-c154-4a93-9b5c-9df3849ec67b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e53de68287f74a3c83820592d1450892'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 08:01:30.578892 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-74e258f6-c154-4a93-9b5c-9df3849ec67b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e53de68287f74a3c83820592d1450892'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 08:01:30.584766 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1382/2745] 10.222.0.57 () {58 vars in 1224 bytes} [Fri Sep 16 08:01:30 2022] DELETE /identity/v3/users/e53de68287f74a3c83820592d1450892 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 08:01:30.856800 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506997cf-c9c8-4177-8646-67bb18eabc00 admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 08:01:30.858418 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-506997cf-c9c8-4177-8646-67bb18eabc00 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 08:01:30.874115 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506997cf-c9c8-4177-8646-67bb18eabc00 admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 08:01:30.934090 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf23710-ad6b-4438-80cd-80f493b1faee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 08:01:30.934715 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf23710-ad6b-4438-80cd-80f493b1faee admin admin] REQUEST_METHOD: `DELETE` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 08:01:30.934997 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf23710-ad6b-4438-80cd-80f493b1faee admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 08:01:30.935267 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf23710-ad6b-4438-80cd-80f493b1faee admin admin] PATH_INFO: `/v3/projects/871d056b7f604c7089343d49f0395816` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 08:01:30.936363 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf23710-ad6b-4438-80cd-80f493b1faee admin admin] RBAC: Authorizing `identity:delete_project(project_id=871d056b7f604c7089343d49f0395816)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 08:01:30.938327 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf23710-ad6b-4438-80cd-80f493b1faee admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 08:01:31.094309 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 08:01:31.110602 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-cdf23710-ad6b-4438-80cd-80f493b1faee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '871d056b7f604c7089343d49f0395816', 'request_id': 'req-cdf23710-ad6b-4438-80cd-80f493b1faee'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 08:01:31.118075 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-cdf23710-ad6b-4438-80cd-80f493b1faee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '871d056b7f604c7089343d49f0395816', 'request_id': 'req-cdf23710-ad6b-4438-80cd-80f493b1faee'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 08:01:31.123574 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-cdf23710-ad6b-4438-80cd-80f493b1faee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '871d056b7f604c7089343d49f0395816', 'request_id': 'req-cdf23710-ad6b-4438-80cd-80f493b1faee'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 08:01:31.135758 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-cdf23710-ad6b-4438-80cd-80f493b1faee admin admin] The token cache is being invalidate because project 871d056b7f604c7089343d49f0395816 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81430) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 08:01:31.136044 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-cdf23710-ad6b-4438-80cd-80f493b1faee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 08:01:31.136677 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-cdf23710-ad6b-4438-80cd-80f493b1faee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 08:01:31.138199 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1364/2746] 10.222.0.57 () {58 vars in 1233 bytes} [Fri Sep 16 08:01:30 2022] DELETE /identity/v3/projects/871d056b7f604c7089343d49f0395816 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 08:01:31.142879 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e258f6-c154-4a93-9b5c-9df3849ec67b admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 08:01:31.144290 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-74e258f6-c154-4a93-9b5c-9df3849ec67b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 08:01:31.156783 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e258f6-c154-4a93-9b5c-9df3849ec67b admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 08:01:31.165443 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 08:01:31.212929 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743424a0-4b94-4a93-b4db-cfde1ab9a556 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 08:01:31.213543 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743424a0-4b94-4a93-b4db-cfde1ab9a556 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 08:01:31.213848 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743424a0-4b94-4a93-b4db-cfde1ab9a556 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 08:01:31.214119 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743424a0-4b94-4a93-b4db-cfde1ab9a556 admin admin] PATH_INFO: `/v3/users/f4450313a08a41fbb9511aca327a890c` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 08:01:31.215210 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743424a0-4b94-4a93-b4db-cfde1ab9a556 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f4450313a08a41fbb9511aca327a890c)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 08:01:31.217098 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743424a0-4b94-4a93-b4db-cfde1ab9a556 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 08:01:31.262801 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-743424a0-4b94-4a93-b4db-cfde1ab9a556 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f4450313a08a41fbb9511aca327a890c'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 08:01:31.275264 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-743424a0-4b94-4a93-b4db-cfde1ab9a556 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f4450313a08a41fbb9511aca327a890c'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 08:01:31.275910 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-743424a0-4b94-4a93-b4db-cfde1ab9a556 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f4450313a08a41fbb9511aca327a890c'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 08:01:31.283159 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-743424a0-4b94-4a93-b4db-cfde1ab9a556 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f4450313a08a41fbb9511aca327a890c'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 08:01:31.289961 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-743424a0-4b94-4a93-b4db-cfde1ab9a556 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f4450313a08a41fbb9511aca327a890c'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 08:01:31.295875 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1383/2747] 10.222.0.57 () {58 vars in 1224 bytes} [Fri Sep 16 08:01:31 2022] DELETE /identity/v3/users/f4450313a08a41fbb9511aca327a890c => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 08:01:31.570758 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf23710-ad6b-4438-80cd-80f493b1faee admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 08:01:31.572348 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-cdf23710-ad6b-4438-80cd-80f493b1faee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 08:01:31.585836 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf23710-ad6b-4438-80cd-80f493b1faee admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 08:01:31.641125 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf42330-3020-44c6-8164-5093a294fa9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 08:01:31.642302 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf42330-3020-44c6-8164-5093a294fa9f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 08:01:31.642662 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf42330-3020-44c6-8164-5093a294fa9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 08:01:31.642940 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf42330-3020-44c6-8164-5093a294fa9f admin admin] PATH_INFO: `/v3/projects/d65da1c3c0194edfbafffbe8f3e4deb9` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 08:01:31.644077 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf42330-3020-44c6-8164-5093a294fa9f admin admin] RBAC: Authorizing `identity:delete_project(project_id=d65da1c3c0194edfbafffbe8f3e4deb9)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 08:01:31.646067 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf42330-3020-44c6-8164-5093a294fa9f admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 08:01:31.690440 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-2bf42330-3020-44c6-8164-5093a294fa9f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd65da1c3c0194edfbafffbe8f3e4deb9', 'request_id': 'req-2bf42330-3020-44c6-8164-5093a294fa9f'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 08:01:31.697282 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-2bf42330-3020-44c6-8164-5093a294fa9f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd65da1c3c0194edfbafffbe8f3e4deb9', 'request_id': 'req-2bf42330-3020-44c6-8164-5093a294fa9f'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 08:01:31.702769 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-2bf42330-3020-44c6-8164-5093a294fa9f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd65da1c3c0194edfbafffbe8f3e4deb9', 'request_id': 'req-2bf42330-3020-44c6-8164-5093a294fa9f'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 08:01:31.714492 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-2bf42330-3020-44c6-8164-5093a294fa9f admin admin] The token cache is being invalidate because project d65da1c3c0194edfbafffbe8f3e4deb9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81430) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 08:01:31.714779 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-2bf42330-3020-44c6-8164-5093a294fa9f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 08:01:31.715406 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-2bf42330-3020-44c6-8164-5093a294fa9f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 08:01:31.716988 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1365/2748] 10.222.0.57 () {58 vars in 1233 bytes} [Fri Sep 16 08:01:31 2022] DELETE /identity/v3/projects/d65da1c3c0194edfbafffbe8f3e4deb9 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 08:01:31.722901 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c35595-8bef-4e0e-9939-1db43945a84d None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 08:01:31.723299 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c35595-8bef-4e0e-9939-1db43945a84d None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 08:01:31.723663 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c35595-8bef-4e0e-9939-1db43945a84d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 08:01:31.743282 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-d7c35595-8bef-4e0e-9939-1db43945a84d None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 08:01:31.744466 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-d7c35595-8bef-4e0e-9939-1db43945a84d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 08:01:31.804186 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1384/2749] 10.222.0.57 () {58 vars in 958 bytes} [Fri Sep 16 08:01:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 08:01:31.811951 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d26106-2835-4d82-914c-c5520c18ff2f None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 08:01:31.812240 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d26106-2835-4d82-914c-c5520c18ff2f None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 08:01:31.812518 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d26106-2835-4d82-914c-c5520c18ff2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 08:01:31.831986 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-23d26106-2835-4d82-914c-c5520c18ff2f None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 08:01:31.833188 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-23d26106-2835-4d82-914c-c5520c18ff2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 08:01:31.844033 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1366/2750] 10.222.0.57 () {58 vars in 958 bytes} [Fri Sep 16 08:01:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 08:01:31.848995 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c35595-8bef-4e0e-9939-1db43945a84d None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 08:01:31.858910 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c35595-8bef-4e0e-9939-1db43945a84d None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 08:01:31.863553 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f06cee-71f6-4678-9670-d913312683d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 08:01:31.864270 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f06cee-71f6-4678-9670-d913312683d4 admin admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 08:01:31.864461 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f06cee-71f6-4678-9670-d913312683d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 08:01:31.864674 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f06cee-71f6-4678-9670-d913312683d4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 08:01:31.865391 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f06cee-71f6-4678-9670-d913312683d4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 08:01:31.865772 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f06cee-71f6-4678-9670-d913312683d4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 08:01:31.867513 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f06cee-71f6-4678-9670-d913312683d4 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 08:01:31.879921 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1385/2751] 10.222.0.57 () {58 vars in 1153 bytes} [Fri Sep 16 08:01:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 08:01:31.884385 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d26106-2835-4d82-914c-c5520c18ff2f None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 08:01:31.894085 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d26106-2835-4d82-914c-c5520c18ff2f None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 08:01:31.898778 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8727c6-e97b-4dbc-b2a4-b8c37ef68130 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 08:01:31.899313 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8727c6-e97b-4dbc-b2a4-b8c37ef68130 admin admin] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 08:01:31.899590 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8727c6-e97b-4dbc-b2a4-b8c37ef68130 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 08:01:31.899857 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8727c6-e97b-4dbc-b2a4-b8c37ef68130 admin admin] PATH_INFO: `/v3/projects` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 08:01:31.900491 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8727c6-e97b-4dbc-b2a4-b8c37ef68130 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 08:01:31.902395 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8727c6-e97b-4dbc-b2a4-b8c37ef68130 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 08:01:31.930050 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1367/2752] 10.222.0.57 () {60 vars in 1153 bytes} [Fri Sep 16 08:01:31 2022] POST /identity/v3/projects => generated 381 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 08:01:31.934326 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f06cee-71f6-4678-9670-d913312683d4 admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 08:01:31.944977 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f06cee-71f6-4678-9670-d913312683d4 admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 08:01:31.962310 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 08:01:32.004065 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5248b89b-7899-4ebe-b970-19bde9497aea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 08:01:32.004724 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5248b89b-7899-4ebe-b970-19bde9497aea admin admin] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 08:01:32.005004 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5248b89b-7899-4ebe-b970-19bde9497aea admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 08:01:32.005275 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5248b89b-7899-4ebe-b970-19bde9497aea admin admin] PATH_INFO: `/v3/users` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 08:01:32.005965 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5248b89b-7899-4ebe-b970-19bde9497aea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 08:01:32.007869 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5248b89b-7899-4ebe-b970-19bde9497aea admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 08:01:32.029116 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1386/2753] 10.222.0.57 () {60 vars in 1144 bytes} [Fri Sep 16 08:01:31 2022] POST /identity/v3/users => generated 291 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 08:01:32.033514 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8727c6-e97b-4dbc-b2a4-b8c37ef68130 admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 08:01:32.043673 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8727c6-e97b-4dbc-b2a4-b8c37ef68130 admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 08:01:32.048343 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda34f3c-d583-4879-9eb3-f5d038c6d8ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 08:01:32.048934 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda34f3c-d583-4879-9eb3-f5d038c6d8ed admin admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 08:01:32.049208 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda34f3c-d583-4879-9eb3-f5d038c6d8ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 08:01:32.049480 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda34f3c-d583-4879-9eb3-f5d038c6d8ed admin admin] PATH_INFO: `/v3/roles` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 08:01:32.050149 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda34f3c-d583-4879-9eb3-f5d038c6d8ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 08:01:32.051710 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda34f3c-d583-4879-9eb3-f5d038c6d8ed admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 08:01:32.061293 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1368/2754] 10.222.0.57 () {58 vars in 1122 bytes} [Fri Sep 16 08:01:32 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 08:01:32.065984 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5248b89b-7899-4ebe-b970-19bde9497aea admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 08:01:32.076121 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5248b89b-7899-4ebe-b970-19bde9497aea admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 08:01:32.081755 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e215045-1dab-4043-8499-510d67901707 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 08:01:32.082356 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e215045-1dab-4043-8499-510d67901707 admin admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 08:01:32.082635 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e215045-1dab-4043-8499-510d67901707 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 08:01:32.082905 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e215045-1dab-4043-8499-510d67901707 admin admin] PATH_INFO: `/v3/roles` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 08:01:32.083536 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e215045-1dab-4043-8499-510d67901707 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 08:01:32.085115 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e215045-1dab-4043-8499-510d67901707 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 08:01:32.096153 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1387/2755] 10.222.0.57 () {58 vars in 1122 bytes} [Fri Sep 16 08:01:32 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 08:01:32.100206 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda34f3c-d583-4879-9eb3-f5d038c6d8ed admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 08:01:32.110519 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda34f3c-d583-4879-9eb3-f5d038c6d8ed admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 08:01:32.115267 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e12ef82-c926-414f-91c7-e8dbf61a26e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 08:01:32.115905 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e12ef82-c926-414f-91c7-e8dbf61a26e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 08:01:32.116182 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e12ef82-c926-414f-91c7-e8dbf61a26e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 08:01:32.116455 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e12ef82-c926-414f-91c7-e8dbf61a26e7 admin admin] PATH_INFO: `/v3/projects/db084e0f13704d8e8cdf5d973cb797ae/users/c16c437c07e04b73aefa31b6cb33d392/roles/4818d38cf2564825b312e66c9eb24762` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 08:01:32.119515 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 08:01:32.132926 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e12ef82-c926-414f-91c7-e8dbf61a26e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=db084e0f13704d8e8cdf5d973cb797ae, user_id=c16c437c07e04b73aefa31b6cb33d392, role_id=4818d38cf2564825b312e66c9eb24762)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 08:01:32.136065 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e12ef82-c926-414f-91c7-e8dbf61a26e7 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 08:01:32.149904 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1369/2756] 10.222.0.57 () {60 vars in 1483 bytes} [Fri Sep 16 08:01:32 2022] PUT /identity/v3/projects/db084e0f13704d8e8cdf5d973cb797ae/users/c16c437c07e04b73aefa31b6cb33d392/roles/4818d38cf2564825b312e66c9eb24762 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 08:01:32.154871 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b90d91-6d2b-4632-9288-6b073cc7edcb None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 08:01:32.155344 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b90d91-6d2b-4632-9288-6b073cc7edcb None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 08:01:32.155444 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b90d91-6d2b-4632-9288-6b073cc7edcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 08:01:32.174179 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-61b90d91-6d2b-4632-9288-6b073cc7edcb None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 08:01:32.175359 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-61b90d91-6d2b-4632-9288-6b073cc7edcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 08:01:32.232296 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1388/2757] 10.222.0.57 () {58 vars in 958 bytes} [Fri Sep 16 08:01:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 08:01:32.243715 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e12ef82-c926-414f-91c7-e8dbf61a26e7 admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 08:01:32.245440 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-9e12ef82-c926-414f-91c7-e8dbf61a26e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 08:01:32.301995 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e12ef82-c926-414f-91c7-e8dbf61a26e7 admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 08:01:32.305543 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415b4878-746a-433e-9945-827f91ebb1e2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1062e457207a41e4ba4f0a0c4bf36f1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4735f453c0c24cc4a1c14e9ac84a0b46', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 08:01:32.306163 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415b4878-746a-433e-9945-827f91ebb1e2 service neutron] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 08:01:32.306440 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415b4878-746a-433e-9945-827f91ebb1e2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 08:01:32.306709 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415b4878-746a-433e-9945-827f91ebb1e2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 08:01:32.316163 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415b4878-746a-433e-9945-827f91ebb1e2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 08:01:32.317559 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415b4878-746a-433e-9945-827f91ebb1e2 service neutron] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 08:01:32.326622 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1370/2758] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Sep 16 08:01:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 16 08:01:36.418246 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0636b507-077a-4fac-b84b-732aa50e4076 None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 08:01:36.418830 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0636b507-077a-4fac-b84b-732aa50e4076 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 08:01:36.418830 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0636b507-077a-4fac-b84b-732aa50e4076 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 08:01:36.448240 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-0636b507-077a-4fac-b84b-732aa50e4076 None None] MFA Rules not processed for user `c16c437c07e04b73aefa31b6cb33d392`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 08:01:36.449379 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-0636b507-077a-4fac-b84b-732aa50e4076 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 08:01:36.516967 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1389/2759] 10.222.0.57 () {58 vars in 958 bytes} [Fri Sep 16 08:01:36 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 08:01:36.521882 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415b4878-746a-433e-9945-827f91ebb1e2 service neutron] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 08:01:36.531614 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415b4878-746a-433e-9945-827f91ebb1e2 service neutron] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 08:01:36.536986 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba632762-6ef9-4f2a-96e9-cc6e9b02c3d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 08:01:36.537575 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba632762-6ef9-4f2a-96e9-cc6e9b02c3d6 admin admin] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 08:01:36.537944 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba632762-6ef9-4f2a-96e9-cc6e9b02c3d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 08:01:36.538277 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba632762-6ef9-4f2a-96e9-cc6e9b02c3d6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 08:01:36.538910 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba632762-6ef9-4f2a-96e9-cc6e9b02c3d6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 08:01:36.540780 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba632762-6ef9-4f2a-96e9-cc6e9b02c3d6 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 08:01:36.570189 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1371/2760] 10.222.0.57 () {60 vars in 1153 bytes} [Fri Sep 16 08:01:36 2022] POST /identity/v3/projects => generated 385 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 08:01:36.574485 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0636b507-077a-4fac-b84b-732aa50e4076 None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 08:01:36.585988 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0636b507-077a-4fac-b84b-732aa50e4076 None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 08:01:36.612972 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 08:01:36.644291 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edec909-19b9-44c0-94a7-3aa7683accbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 08:01:36.644903 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edec909-19b9-44c0-94a7-3aa7683accbb admin admin] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 08:01:36.645183 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edec909-19b9-44c0-94a7-3aa7683accbb admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 08:01:36.645458 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edec909-19b9-44c0-94a7-3aa7683accbb admin admin] PATH_INFO: `/v3/users` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 08:01:36.646120 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5edec909-19b9-44c0-94a7-3aa7683accbb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 08:01:36.648022 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5edec909-19b9-44c0-94a7-3aa7683accbb admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 08:01:36.669073 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1390/2761] 10.222.0.57 () {60 vars in 1144 bytes} [Fri Sep 16 08:01:36 2022] POST /identity/v3/users => generated 299 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 08:01:36.673705 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba632762-6ef9-4f2a-96e9-cc6e9b02c3d6 admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 08:01:36.683918 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba632762-6ef9-4f2a-96e9-cc6e9b02c3d6 admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 08:01:36.688461 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84581e9f-dcf9-4cbe-b155-737abd57ccdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 08:01:36.689051 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84581e9f-dcf9-4cbe-b155-737abd57ccdd admin admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 08:01:36.689334 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84581e9f-dcf9-4cbe-b155-737abd57ccdd admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 08:01:36.689615 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84581e9f-dcf9-4cbe-b155-737abd57ccdd admin admin] PATH_INFO: `/v3/roles` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 08:01:36.691690 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84581e9f-dcf9-4cbe-b155-737abd57ccdd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 08:01:36.692971 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84581e9f-dcf9-4cbe-b155-737abd57ccdd admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 08:01:36.702779 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1372/2762] 10.222.0.57 () {58 vars in 1122 bytes} [Fri Sep 16 08:01:36 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 08:01:36.706808 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edec909-19b9-44c0-94a7-3aa7683accbb admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 08:01:36.716695 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edec909-19b9-44c0-94a7-3aa7683accbb admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 08:01:36.721811 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52cdcf8-422a-4203-a9bd-716076741873 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 08:01:36.722459 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52cdcf8-422a-4203-a9bd-716076741873 admin admin] REQUEST_METHOD: `PUT` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 08:01:36.722737 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52cdcf8-422a-4203-a9bd-716076741873 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 08:01:36.723005 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52cdcf8-422a-4203-a9bd-716076741873 admin admin] PATH_INFO: `/v3/projects/aad02e2f96344c5e895b75fb64ec26d8/users/181a019e0d464ecbb789e6a8073758f2/roles/567db03c91854ad9af1e9a87ec1bd275` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 08:01:36.738370 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52cdcf8-422a-4203-a9bd-716076741873 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aad02e2f96344c5e895b75fb64ec26d8, user_id=181a019e0d464ecbb789e6a8073758f2, role_id=567db03c91854ad9af1e9a87ec1bd275)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 08:01:36.741289 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52cdcf8-422a-4203-a9bd-716076741873 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 08:01:36.754110 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1391/2763] 10.222.0.57 () {60 vars in 1483 bytes} [Fri Sep 16 08:01:36 2022] PUT /identity/v3/projects/aad02e2f96344c5e895b75fb64ec26d8/users/181a019e0d464ecbb789e6a8073758f2/roles/567db03c91854ad9af1e9a87ec1bd275 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 16 08:01:36.758404 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84581e9f-dcf9-4cbe-b155-737abd57ccdd admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 08:01:36.768426 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84581e9f-dcf9-4cbe-b155-737abd57ccdd admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 08:01:36.826922 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd274693-a153-4726-9627-d5c42bce7cf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 08:01:36.827537 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd274693-a153-4726-9627-d5c42bce7cf5 admin admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 08:01:36.827820 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd274693-a153-4726-9627-d5c42bce7cf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 08:01:36.828095 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd274693-a153-4726-9627-d5c42bce7cf5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 08:01:36.828734 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd274693-a153-4726-9627-d5c42bce7cf5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 08:01:36.830399 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd274693-a153-4726-9627-d5c42bce7cf5 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 08:01:36.841171 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1373/2764] 10.222.0.57 () {58 vars in 1122 bytes} [Fri Sep 16 08:01:36 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 08:01:36.845619 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52cdcf8-422a-4203-a9bd-716076741873 admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 08:01:36.856695 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52cdcf8-422a-4203-a9bd-716076741873 admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 08:01:36.862584 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f626b2c7-0729-482e-b97c-1f12b95baebe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 08:01:36.863800 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f626b2c7-0729-482e-b97c-1f12b95baebe admin admin] REQUEST_METHOD: `PUT` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 08:01:36.864232 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f626b2c7-0729-482e-b97c-1f12b95baebe admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 08:01:36.864713 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f626b2c7-0729-482e-b97c-1f12b95baebe admin admin] PATH_INFO: `/v3/projects/aad02e2f96344c5e895b75fb64ec26d8/users/181a019e0d464ecbb789e6a8073758f2/roles/567db03c91854ad9af1e9a87ec1bd275` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 08:01:36.869424 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f626b2c7-0729-482e-b97c-1f12b95baebe admin admin] RBAC: Authorizing `identity:create_grant(project_id=aad02e2f96344c5e895b75fb64ec26d8, user_id=181a019e0d464ecbb789e6a8073758f2, role_id=567db03c91854ad9af1e9a87ec1bd275)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 08:01:36.873795 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f626b2c7-0729-482e-b97c-1f12b95baebe admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 08:01:36.885027 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1392/2765] 10.222.0.57 () {60 vars in 1483 bytes} [Fri Sep 16 08:01:36 2022] PUT /identity/v3/projects/aad02e2f96344c5e895b75fb64ec26d8/users/181a019e0d464ecbb789e6a8073758f2/roles/567db03c91854ad9af1e9a87ec1bd275 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 08:01:41.947277 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8965cd6-19cf-4140-94e2-85651dacbe6b None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 08:01:41.947801 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8965cd6-19cf-4140-94e2-85651dacbe6b None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 08:01:41.947801 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8965cd6-19cf-4140-94e2-85651dacbe6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 08:01:41.978321 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-b8965cd6-19cf-4140-94e2-85651dacbe6b None None] MFA Rules not processed for user `181a019e0d464ecbb789e6a8073758f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 08:01:41.979452 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-b8965cd6-19cf-4140-94e2-85651dacbe6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 08:01:42.022168 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 08:01:42.053077 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1374/2766] 10.222.0.57 () {58 vars in 958 bytes} [Fri Sep 16 08:01:41 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 08:01:42.065949 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f626b2c7-0729-482e-b97c-1f12b95baebe admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 08:01:42.067838 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-f626b2c7-0729-482e-b97c-1f12b95baebe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 08:01:42.128681 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f626b2c7-0729-482e-b97c-1f12b95baebe admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 08:01:42.132492 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fdd24c-80cd-4efc-b2ae-189c91fa9fa3 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceecb2c2fe9842e3b228848e00fd11ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4735f453c0c24cc4a1c14e9ac84a0b46', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 08:01:42.133270 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fdd24c-80cd-4efc-b2ae-189c91fa9fa3 service glance] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 08:01:42.133552 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fdd24c-80cd-4efc-b2ae-189c91fa9fa3 service glance] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 08:01:42.133848 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fdd24c-80cd-4efc-b2ae-189c91fa9fa3 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 08:01:42.191082 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fdd24c-80cd-4efc-b2ae-189c91fa9fa3 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 08:01:42.192457 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fdd24c-80cd-4efc-b2ae-189c91fa9fa3 service glance] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 08:01:42.201367 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1393/2767] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Sep 16 08:01:42 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 08:01:42.333539 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b21271-c903-4022-a7e6-0269a9fd6795 None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 08:01:42.333904 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b21271-c903-4022-a7e6-0269a9fd6795 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 08:01:42.334215 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b21271-c903-4022-a7e6-0269a9fd6795 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 08:01:42.353551 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-24b21271-c903-4022-a7e6-0269a9fd6795 None None] MFA Rules not processed for user `56eb9bbabb65436bb095952159df184c`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 08:01:42.354895 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-24b21271-c903-4022-a7e6-0269a9fd6795 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 08:01:42.411516 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1375/2768] 10.222.0.57 () {58 vars in 1009 bytes} [Fri Sep 16 08:01:42 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 08:01:42.459463 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fdd24c-80cd-4efc-b2ae-189c91fa9fa3 service glance] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 08:01:42.460850 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-d7fdd24c-80cd-4efc-b2ae-189c91fa9fa3 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 08:01:42.502772 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 08:01:42.534772 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fdd24c-80cd-4efc-b2ae-189c91fa9fa3 service glance] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 08:01:42.539966 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb68bb8d-efa6-4413-b184-2742a26f9798 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38abb0283b41449d8183b88912f2574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4735f453c0c24cc4a1c14e9ac84a0b46', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 08:01:42.540574 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb68bb8d-efa6-4413-b184-2742a26f9798 service swift] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 08:01:42.540842 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb68bb8d-efa6-4413-b184-2742a26f9798 service swift] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 08:01:42.541107 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb68bb8d-efa6-4413-b184-2742a26f9798 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 08:01:42.549361 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb68bb8d-efa6-4413-b184-2742a26f9798 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 08:01:42.551018 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb68bb8d-efa6-4413-b184-2742a26f9798 service swift] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 08:01:42.558806 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1394/2769] 10.222.0.57 () {60 vars in 1384 bytes} [Fri Sep 16 08:01:42 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 16 08:01:51.500125 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7879acb9-5983-40d4-a931-6285b03561f2 None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 08:01:51.500736 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7879acb9-5983-40d4-a931-6285b03561f2 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 08:01:51.500736 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7879acb9-5983-40d4-a931-6285b03561f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 08:01:51.519437 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-7879acb9-5983-40d4-a931-6285b03561f2 None None] MFA Rules not processed for user `c16c437c07e04b73aefa31b6cb33d392`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 08:01:51.520611 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-7879acb9-5983-40d4-a931-6285b03561f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 08:01:51.527264 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1376/2770] 10.222.0.57 () {58 vars in 958 bytes} [Fri Sep 16 08:01:51 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 08:01:51.791088 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb68bb8d-efa6-4413-b184-2742a26f9798 service swift] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 08:01:51.844628 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb68bb8d-efa6-4413-b184-2742a26f9798 service swift] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 08:01:51.848860 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2870c29-c41b-4518-9732-d07bd5e8bc49 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1062e457207a41e4ba4f0a0c4bf36f1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4735f453c0c24cc4a1c14e9ac84a0b46', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 08:01:51.849460 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2870c29-c41b-4518-9732-d07bd5e8bc49 service neutron] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 08:01:51.849756 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2870c29-c41b-4518-9732-d07bd5e8bc49 service neutron] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 08:01:51.850029 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2870c29-c41b-4518-9732-d07bd5e8bc49 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 08:01:51.851735 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-c2870c29-c41b-4518-9732-d07bd5e8bc49 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 08:01:51.862060 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2870c29-c41b-4518-9732-d07bd5e8bc49 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 08:01:51.863498 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2870c29-c41b-4518-9732-d07bd5e8bc49 service neutron] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 08:01:51.871668 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1395/2771] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Sep 16 08:01:51 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 08:01:52.181351 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7879acb9-5983-40d4-a931-6285b03561f2 None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 08:01:52.182685 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-7879acb9-5983-40d4-a931-6285b03561f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 08:01:52.254047 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7879acb9-5983-40d4-a931-6285b03561f2 None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 08:01:52.258915 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1a9b3e-88af-4a19-b69f-e4cfc5e3238c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7d4ccdd6ef9400ba9e344df0964da1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4735f453c0c24cc4a1c14e9ac84a0b46', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 08:01:52.259511 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1a9b3e-88af-4a19-b69f-e4cfc5e3238c service placement] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 08:01:52.259786 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1a9b3e-88af-4a19-b69f-e4cfc5e3238c service placement] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 08:01:52.260053 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1a9b3e-88af-4a19-b69f-e4cfc5e3238c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 08:01:52.261733 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-ec1a9b3e-88af-4a19-b69f-e4cfc5e3238c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 08:01:52.273474 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1a9b3e-88af-4a19-b69f-e4cfc5e3238c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 08:01:52.275064 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1a9b3e-88af-4a19-b69f-e4cfc5e3238c service placement] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 08:01:52.285894 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1377/2772] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Sep 16 08:01:52 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 08:01:53.621513 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffab73a-2d8a-47ec-945c-3c0cba2671cd None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 08:01:53.622050 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffab73a-2d8a-47ec-945c-3c0cba2671cd None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 08:01:53.622169 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffab73a-2d8a-47ec-945c-3c0cba2671cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 08:01:53.641818 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-6ffab73a-2d8a-47ec-945c-3c0cba2671cd None None] MFA Rules not processed for user `56eb9bbabb65436bb095952159df184c`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 08:01:53.643074 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-6ffab73a-2d8a-47ec-945c-3c0cba2671cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 08:01:53.650527 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1396/2773] 10.222.0.57 () {58 vars in 1009 bytes} [Fri Sep 16 08:01:53 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 08:01:53.662691 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1a9b3e-88af-4a19-b69f-e4cfc5e3238c service placement] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 08:01:53.674781 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1a9b3e-88af-4a19-b69f-e4cfc5e3238c service placement] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 08:01:53.679791 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190fd6aa-8efc-4636-9172-f4cdce31d053 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38abb0283b41449d8183b88912f2574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4735f453c0c24cc4a1c14e9ac84a0b46', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 08:01:53.680593 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190fd6aa-8efc-4636-9172-f4cdce31d053 service swift] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 08:01:53.680870 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190fd6aa-8efc-4636-9172-f4cdce31d053 service swift] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 08:01:53.681199 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190fd6aa-8efc-4636-9172-f4cdce31d053 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 08:01:53.689875 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190fd6aa-8efc-4636-9172-f4cdce31d053 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 08:01:53.691430 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190fd6aa-8efc-4636-9172-f4cdce31d053 service swift] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 08:01:53.699568 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1378/2774] 10.222.0.57 () {60 vars in 1384 bytes} [Fri Sep 16 08:01:53 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 16 08:02:03.636351 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=45 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 08:02:03.696221 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=77 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 08:02:08.593575 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffab73a-2d8a-47ec-945c-3c0cba2671cd None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 08:02:08.595310 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-6ffab73a-2d8a-47ec-945c-3c0cba2671cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 08:02:08.686386 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffab73a-2d8a-47ec-945c-3c0cba2671cd None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 08:02:08.692471 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe527dff-9df7-4f39-a282-7a3da0bf6f09 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bec4d9b08514461a1bf63c6b88f53b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4735f453c0c24cc4a1c14e9ac84a0b46', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 08:02:08.693094 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe527dff-9df7-4f39-a282-7a3da0bf6f09 service nova] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 08:02:08.693375 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe527dff-9df7-4f39-a282-7a3da0bf6f09 service nova] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 08:02:08.693646 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe527dff-9df7-4f39-a282-7a3da0bf6f09 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 08:02:08.695580 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-fe527dff-9df7-4f39-a282-7a3da0bf6f09 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 08:02:08.708884 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe527dff-9df7-4f39-a282-7a3da0bf6f09 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 08:02:08.710503 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe527dff-9df7-4f39-a282-7a3da0bf6f09 service nova] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 08:02:08.721123 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1397/2775] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Sep 16 08:02:08 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 08:02:14.806570 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190fd6aa-8efc-4636-9172-f4cdce31d053 service swift] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 08:02:14.816576 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190fd6aa-8efc-4636-9172-f4cdce31d053 service swift] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 08:02:14.820149 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995ee1a9-0f66-4fc1-9805-310850dff627 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1062e457207a41e4ba4f0a0c4bf36f1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4735f453c0c24cc4a1c14e9ac84a0b46', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 08:02:14.820734 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995ee1a9-0f66-4fc1-9805-310850dff627 service neutron] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 08:02:14.821015 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995ee1a9-0f66-4fc1-9805-310850dff627 service neutron] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 08:02:14.821288 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995ee1a9-0f66-4fc1-9805-310850dff627 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 08:02:14.830205 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995ee1a9-0f66-4fc1-9805-310850dff627 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 08:02:14.831606 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995ee1a9-0f66-4fc1-9805-310850dff627 service neutron] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 08:02:14.840989 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1379/2776] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Sep 16 08:02:14 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 08:02:18.716567 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=34 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 08:02:24.836923 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=6 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 08:02:40.513468 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c0b731-bd9b-490c-bcb4-01cf49117f41 None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 08:02:40.514110 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c0b731-bd9b-490c-bcb4-01cf49117f41 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 08:02:40.514110 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c0b731-bd9b-490c-bcb4-01cf49117f41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 08:02:40.533608 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-00c0b731-bd9b-490c-bcb4-01cf49117f41 None None] MFA Rules not processed for user `1776184047fd445aae14f8589d9634be`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 08:02:40.534849 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-00c0b731-bd9b-490c-bcb4-01cf49117f41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 08:02:40.590435 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1398/2777] 10.222.0.57 () {58 vars in 958 bytes} [Fri Sep 16 08:02:40 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 08:02:40.894177 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995ee1a9-0f66-4fc1-9805-310850dff627 service neutron] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 08:02:40.902871 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995ee1a9-0f66-4fc1-9805-310850dff627 service neutron] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 08:02:40.906663 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700a8408-5e7e-4977-9b80-f9cafdf07bbb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1062e457207a41e4ba4f0a0c4bf36f1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4735f453c0c24cc4a1c14e9ac84a0b46', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 08:02:40.907254 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700a8408-5e7e-4977-9b80-f9cafdf07bbb service neutron] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 08:02:40.907534 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700a8408-5e7e-4977-9b80-f9cafdf07bbb service neutron] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 08:02:40.907805 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700a8408-5e7e-4977-9b80-f9cafdf07bbb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 08:02:40.909553 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-700a8408-5e7e-4977-9b80-f9cafdf07bbb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 08:02:40.919669 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700a8408-5e7e-4977-9b80-f9cafdf07bbb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 08:02:40.921071 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700a8408-5e7e-4977-9b80-f9cafdf07bbb service neutron] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 08:02:40.929810 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1380/2778] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Sep 16 08:02:40 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 08:02:50.583655 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=25 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 08:02:50.926172 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=6 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 08:03:15.176144 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c0b731-bd9b-490c-bcb4-01cf49117f41 None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 08:03:15.235589 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c0b731-bd9b-490c-bcb4-01cf49117f41 None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 08:03:15.240583 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3d2123-6764-445f-abfc-23da996fc391 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7d4ccdd6ef9400ba9e344df0964da1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4735f453c0c24cc4a1c14e9ac84a0b46', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 08:03:15.241183 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3d2123-6764-445f-abfc-23da996fc391 service placement] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 08:03:15.241465 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3d2123-6764-445f-abfc-23da996fc391 service placement] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 08:03:15.241750 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3d2123-6764-445f-abfc-23da996fc391 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 08:03:15.243472 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-da3d2123-6764-445f-abfc-23da996fc391 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 08:03:15.276928 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3d2123-6764-445f-abfc-23da996fc391 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 08:03:15.278549 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3d2123-6764-445f-abfc-23da996fc391 service placement] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 08:03:15.288780 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1399/2779] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Sep 16 08:03:15 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 08:03:25.284560 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=36 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 08:03:38.039721 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1366de96-32e5-4ae0-aed6-d09afa64359d None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 08:03:38.040221 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1366de96-32e5-4ae0-aed6-d09afa64359d None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 08:03:38.040327 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1366de96-32e5-4ae0-aed6-d09afa64359d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 08:03:38.069223 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-1366de96-32e5-4ae0-aed6-d09afa64359d None None] MFA Rules not processed for user `56eb9bbabb65436bb095952159df184c`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 08:03:38.070446 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-1366de96-32e5-4ae0-aed6-d09afa64359d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 08:03:38.089161 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1381/2780] 10.222.0.57 () {58 vars in 967 bytes} [Fri Sep 16 08:03:38 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 08:03:38.133622 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3d2123-6764-445f-abfc-23da996fc391 service placement] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 08:03:38.145570 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3d2123-6764-445f-abfc-23da996fc391 service placement] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 08:03:38.150917 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9b745b-0a38-4862-821d-668875a58239 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38abb0283b41449d8183b88912f2574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4735f453c0c24cc4a1c14e9ac84a0b46', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 08:03:38.151592 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9b745b-0a38-4862-821d-668875a58239 service swift] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 08:03:38.151937 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9b745b-0a38-4862-821d-668875a58239 service swift] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 08:03:38.152262 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9b745b-0a38-4862-821d-668875a58239 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 08:03:38.161405 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9b745b-0a38-4862-821d-668875a58239 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 08:03:38.163071 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9b745b-0a38-4862-821d-668875a58239 service swift] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 08:03:38.171812 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1400/2781] 10.222.0.57 () {60 vars in 1384 bytes} [Fri Sep 16 08:03:38 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 16 08:03:41.614674 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1366de96-32e5-4ae0-aed6-d09afa64359d None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 08:03:41.661971 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1366de96-32e5-4ae0-aed6-d09afa64359d None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 08:03:41.676211 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20582a54-0071-43b8-85dc-e94b68a923c1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7d4ccdd6ef9400ba9e344df0964da1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4735f453c0c24cc4a1c14e9ac84a0b46', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 08:03:41.676841 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20582a54-0071-43b8-85dc-e94b68a923c1 service placement] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 08:03:41.677171 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20582a54-0071-43b8-85dc-e94b68a923c1 service placement] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 08:03:41.677457 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20582a54-0071-43b8-85dc-e94b68a923c1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 08:03:41.680034 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-20582a54-0071-43b8-85dc-e94b68a923c1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 08:03:41.708316 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20582a54-0071-43b8-85dc-e94b68a923c1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 08:03:41.710847 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20582a54-0071-43b8-85dc-e94b68a923c1 service placement] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 08:03:41.749098 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1382/2782] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Sep 16 08:03:41 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 08:03:45.418197 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9b745b-0a38-4862-821d-668875a58239 service swift] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 08:03:45.420153 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-1d9b745b-0a38-4862-821d-668875a58239 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 08:03:45.448855 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9b745b-0a38-4862-821d-668875a58239 service swift] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 08:03:45.449888 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20582a54-0071-43b8-85dc-e94b68a923c1 service placement] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 08:03:45.456704 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8cfbd8-785d-4c11-bc7e-53e58deb1dd4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7d4ccdd6ef9400ba9e344df0964da1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4735f453c0c24cc4a1c14e9ac84a0b46', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 08:03:45.457324 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8cfbd8-785d-4c11-bc7e-53e58deb1dd4 service placement] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 08:03:45.458125 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8cfbd8-785d-4c11-bc7e-53e58deb1dd4 service placement] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 08:03:45.458278 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8cfbd8-785d-4c11-bc7e-53e58deb1dd4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 08:03:45.461658 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-fa8cfbd8-785d-4c11-bc7e-53e58deb1dd4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 08:03:45.474991 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8cfbd8-785d-4c11-bc7e-53e58deb1dd4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 08:03:45.476572 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8cfbd8-785d-4c11-bc7e-53e58deb1dd4 service placement] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 08:03:45.487999 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1401/2783] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Sep 16 08:03:45 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 08:03:45.556085 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20582a54-0071-43b8-85dc-e94b68a923c1 service placement] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 08:03:45.561309 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88dca7d1-19e0-4082-8458-1137d4e204d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 08:03:45.561959 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dca7d1-19e0-4082-8458-1137d4e204d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 08:03:45.562235 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dca7d1-19e0-4082-8458-1137d4e204d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 08:03:45.562504 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dca7d1-19e0-4082-8458-1137d4e204d1 admin admin] PATH_INFO: `/v3/users/c16c437c07e04b73aefa31b6cb33d392` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 08:03:45.563602 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88dca7d1-19e0-4082-8458-1137d4e204d1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c16c437c07e04b73aefa31b6cb33d392)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 08:03:45.565504 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88dca7d1-19e0-4082-8458-1137d4e204d1 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 08:03:45.611622 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-88dca7d1-19e0-4082-8458-1137d4e204d1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c16c437c07e04b73aefa31b6cb33d392'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 08:03:45.612272 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-88dca7d1-19e0-4082-8458-1137d4e204d1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c16c437c07e04b73aefa31b6cb33d392'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 08:03:45.619603 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-88dca7d1-19e0-4082-8458-1137d4e204d1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c16c437c07e04b73aefa31b6cb33d392'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 08:03:45.632669 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-88dca7d1-19e0-4082-8458-1137d4e204d1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c16c437c07e04b73aefa31b6cb33d392'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 08:03:45.639504 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-88dca7d1-19e0-4082-8458-1137d4e204d1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c16c437c07e04b73aefa31b6cb33d392'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 08:03:45.645398 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1383/2784] 10.222.0.57 () {58 vars in 1224 bytes} [Fri Sep 16 08:03:45 2022] DELETE /identity/v3/users/c16c437c07e04b73aefa31b6cb33d392 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 16 08:03:45.820438 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8cfbd8-785d-4c11-bc7e-53e58deb1dd4 service placement] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 08:03:45.833289 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8cfbd8-785d-4c11-bc7e-53e58deb1dd4 service placement] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 08:03:45.891656 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc321e4-e6a0-4e66-93b6-024952ec8abd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 08:03:45.892291 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc321e4-e6a0-4e66-93b6-024952ec8abd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 08:03:45.892568 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc321e4-e6a0-4e66-93b6-024952ec8abd admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 08:03:45.892846 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc321e4-e6a0-4e66-93b6-024952ec8abd admin admin] PATH_INFO: `/v3/projects/db084e0f13704d8e8cdf5d973cb797ae` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 08:03:45.893997 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc321e4-e6a0-4e66-93b6-024952ec8abd admin admin] RBAC: Authorizing `identity:delete_project(project_id=db084e0f13704d8e8cdf5d973cb797ae)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 08:03:45.895943 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc321e4-e6a0-4e66-93b6-024952ec8abd admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 08:03:45.944323 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-fcc321e4-e6a0-4e66-93b6-024952ec8abd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'db084e0f13704d8e8cdf5d973cb797ae', 'request_id': 'req-fcc321e4-e6a0-4e66-93b6-024952ec8abd'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 08:03:45.950474 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-fcc321e4-e6a0-4e66-93b6-024952ec8abd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'db084e0f13704d8e8cdf5d973cb797ae', 'request_id': 'req-fcc321e4-e6a0-4e66-93b6-024952ec8abd'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 08:03:45.957859 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-fcc321e4-e6a0-4e66-93b6-024952ec8abd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'db084e0f13704d8e8cdf5d973cb797ae', 'request_id': 'req-fcc321e4-e6a0-4e66-93b6-024952ec8abd'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 08:03:45.980716 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-fcc321e4-e6a0-4e66-93b6-024952ec8abd admin admin] The token cache is being invalidate because project db084e0f13704d8e8cdf5d973cb797ae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81431) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 08:03:45.981000 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-fcc321e4-e6a0-4e66-93b6-024952ec8abd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 08:03:45.981613 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-fcc321e4-e6a0-4e66-93b6-024952ec8abd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 08:03:45.983841 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1402/2785] 10.222.0.57 () {58 vars in 1233 bytes} [Fri Sep 16 08:03:45 2022] DELETE /identity/v3/projects/db084e0f13704d8e8cdf5d973cb797ae => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 08:03:45.987888 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88dca7d1-19e0-4082-8458-1137d4e204d1 admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 08:03:45.989355 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-88dca7d1-19e0-4082-8458-1137d4e204d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 08:03:46.002497 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88dca7d1-19e0-4082-8458-1137d4e204d1 admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 08:03:46.026526 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 08:03:46.060306 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2987a506-49a2-4b0e-8c52-2181eb02f38f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 08:03:46.060921 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2987a506-49a2-4b0e-8c52-2181eb02f38f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 08:03:46.061197 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2987a506-49a2-4b0e-8c52-2181eb02f38f admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 08:03:46.061467 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2987a506-49a2-4b0e-8c52-2181eb02f38f admin admin] PATH_INFO: `/v3/users/181a019e0d464ecbb789e6a8073758f2` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 08:03:46.062606 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2987a506-49a2-4b0e-8c52-2181eb02f38f admin admin] RBAC: Authorizing `identity:delete_user(user_id=181a019e0d464ecbb789e6a8073758f2)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 08:03:46.064880 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2987a506-49a2-4b0e-8c52-2181eb02f38f admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 08:03:46.111221 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-2987a506-49a2-4b0e-8c52-2181eb02f38f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '181a019e0d464ecbb789e6a8073758f2'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 08:03:46.111881 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-2987a506-49a2-4b0e-8c52-2181eb02f38f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '181a019e0d464ecbb789e6a8073758f2'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 08:03:46.119218 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-2987a506-49a2-4b0e-8c52-2181eb02f38f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '181a019e0d464ecbb789e6a8073758f2'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 08:03:46.131112 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-2987a506-49a2-4b0e-8c52-2181eb02f38f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '181a019e0d464ecbb789e6a8073758f2'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 08:03:46.137854 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-2987a506-49a2-4b0e-8c52-2181eb02f38f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '181a019e0d464ecbb789e6a8073758f2'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 08:03:46.144057 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1384/2786] 10.222.0.57 () {58 vars in 1224 bytes} [Fri Sep 16 08:03:45 2022] DELETE /identity/v3/users/181a019e0d464ecbb789e6a8073758f2 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 08:03:46.327920 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc321e4-e6a0-4e66-93b6-024952ec8abd admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 08:03:46.329482 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-fcc321e4-e6a0-4e66-93b6-024952ec8abd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 08:03:46.342422 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc321e4-e6a0-4e66-93b6-024952ec8abd admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 08:03:46.394847 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 08:03:46.404937 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda8a391-c8fc-4730-be81-2fc44af4cfca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 08:03:46.405492 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda8a391-c8fc-4730-be81-2fc44af4cfca admin admin] REQUEST_METHOD: `DELETE` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 08:03:46.405798 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda8a391-c8fc-4730-be81-2fc44af4cfca admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 08:03:46.406069 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda8a391-c8fc-4730-be81-2fc44af4cfca admin admin] PATH_INFO: `/v3/projects/aad02e2f96344c5e895b75fb64ec26d8` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 08:03:46.407168 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda8a391-c8fc-4730-be81-2fc44af4cfca admin admin] RBAC: Authorizing `identity:delete_project(project_id=aad02e2f96344c5e895b75fb64ec26d8)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 08:03:46.409107 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda8a391-c8fc-4730-be81-2fc44af4cfca admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 08:03:46.458142 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-fda8a391-c8fc-4730-be81-2fc44af4cfca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aad02e2f96344c5e895b75fb64ec26d8', 'request_id': 'req-fda8a391-c8fc-4730-be81-2fc44af4cfca'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 08:03:46.465403 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-fda8a391-c8fc-4730-be81-2fc44af4cfca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aad02e2f96344c5e895b75fb64ec26d8', 'request_id': 'req-fda8a391-c8fc-4730-be81-2fc44af4cfca'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 08:03:46.473036 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-fda8a391-c8fc-4730-be81-2fc44af4cfca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aad02e2f96344c5e895b75fb64ec26d8', 'request_id': 'req-fda8a391-c8fc-4730-be81-2fc44af4cfca'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 08:03:46.485057 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-fda8a391-c8fc-4730-be81-2fc44af4cfca admin admin] The token cache is being invalidate because project aad02e2f96344c5e895b75fb64ec26d8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81431) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 08:03:46.485348 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-fda8a391-c8fc-4730-be81-2fc44af4cfca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 08:03:46.486009 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-fda8a391-c8fc-4730-be81-2fc44af4cfca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 08:03:46.487532 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1403/2787] 10.222.0.57 () {58 vars in 1233 bytes} [Fri Sep 16 08:03:46 2022] DELETE /identity/v3/projects/aad02e2f96344c5e895b75fb64ec26d8 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 08:03:51.820049 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2987a506-49a2-4b0e-8c52-2181eb02f38f admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 08:03:51.821556 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-2987a506-49a2-4b0e-8c52-2181eb02f38f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 08:03:51.836363 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2987a506-49a2-4b0e-8c52-2181eb02f38f admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 08:03:51.899844 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29860c49-ddee-4b31-a1bc-aeb7c2d34f76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 08:03:51.900505 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29860c49-ddee-4b31-a1bc-aeb7c2d34f76 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 08:03:51.900788 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29860c49-ddee-4b31-a1bc-aeb7c2d34f76 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 08:03:51.901065 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29860c49-ddee-4b31-a1bc-aeb7c2d34f76 admin admin] PATH_INFO: `/v3/users/1776184047fd445aae14f8589d9634be` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 08:03:51.902262 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29860c49-ddee-4b31-a1bc-aeb7c2d34f76 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1776184047fd445aae14f8589d9634be)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 08:03:51.904201 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29860c49-ddee-4b31-a1bc-aeb7c2d34f76 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 08:03:51.953365 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-29860c49-ddee-4b31-a1bc-aeb7c2d34f76 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1776184047fd445aae14f8589d9634be'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 08:03:51.954046 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-29860c49-ddee-4b31-a1bc-aeb7c2d34f76 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1776184047fd445aae14f8589d9634be'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 08:03:51.955673 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 08:03:51.961656 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-29860c49-ddee-4b31-a1bc-aeb7c2d34f76 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1776184047fd445aae14f8589d9634be'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 08:03:51.974794 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-29860c49-ddee-4b31-a1bc-aeb7c2d34f76 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1776184047fd445aae14f8589d9634be'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 08:03:51.982040 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-29860c49-ddee-4b31-a1bc-aeb7c2d34f76 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1776184047fd445aae14f8589d9634be'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 08:03:51.988211 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1385/2788] 10.222.0.57 () {58 vars in 1224 bytes} [Fri Sep 16 08:03:51 2022] DELETE /identity/v3/users/1776184047fd445aae14f8589d9634be => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 08:03:52.162881 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda8a391-c8fc-4730-be81-2fc44af4cfca admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 08:03:52.164357 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-fda8a391-c8fc-4730-be81-2fc44af4cfca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 08:03:52.177625 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda8a391-c8fc-4730-be81-2fc44af4cfca admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 08:03:52.236415 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c24bbb6-68cc-4aae-86b1-16578e340ed7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 08:03:52.237040 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c24bbb6-68cc-4aae-86b1-16578e340ed7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 08:03:52.237316 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c24bbb6-68cc-4aae-86b1-16578e340ed7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 08:03:52.237583 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c24bbb6-68cc-4aae-86b1-16578e340ed7 admin admin] PATH_INFO: `/v3/projects/20fd0dabcd434370b3b38bf4f2ed82ce` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 08:03:52.238709 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c24bbb6-68cc-4aae-86b1-16578e340ed7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=20fd0dabcd434370b3b38bf4f2ed82ce)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 08:03:52.240586 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c24bbb6-68cc-4aae-86b1-16578e340ed7 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 08:03:52.285634 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-6c24bbb6-68cc-4aae-86b1-16578e340ed7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '20fd0dabcd434370b3b38bf4f2ed82ce', 'request_id': 'req-6c24bbb6-68cc-4aae-86b1-16578e340ed7'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 08:03:52.291807 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-6c24bbb6-68cc-4aae-86b1-16578e340ed7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '20fd0dabcd434370b3b38bf4f2ed82ce', 'request_id': 'req-6c24bbb6-68cc-4aae-86b1-16578e340ed7'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 08:03:52.299150 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-6c24bbb6-68cc-4aae-86b1-16578e340ed7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '20fd0dabcd434370b3b38bf4f2ed82ce', 'request_id': 'req-6c24bbb6-68cc-4aae-86b1-16578e340ed7'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 08:03:52.309946 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-6c24bbb6-68cc-4aae-86b1-16578e340ed7 admin admin] The token cache is being invalidate because project 20fd0dabcd434370b3b38bf4f2ed82ce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81431) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 08:03:52.310238 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-6c24bbb6-68cc-4aae-86b1-16578e340ed7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 08:03:52.311728 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-6c24bbb6-68cc-4aae-86b1-16578e340ed7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 08:03:52.313343 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1404/2789] 10.222.0.57 () {58 vars in 1233 bytes} [Fri Sep 16 08:03:52 2022] DELETE /identity/v3/projects/20fd0dabcd434370b3b38bf4f2ed82ce => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 16 08:03:52.318295 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98af47a-c51c-43c1-b6f5-aab64dbf144b None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 08:03:52.318576 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98af47a-c51c-43c1-b6f5-aab64dbf144b None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 08:03:52.318846 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98af47a-c51c-43c1-b6f5-aab64dbf144b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 08:03:52.375999 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-b98af47a-c51c-43c1-b6f5-aab64dbf144b None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 08:03:52.377212 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-b98af47a-c51c-43c1-b6f5-aab64dbf144b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 08:03:52.436517 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1386/2790] 10.222.0.57 () {58 vars in 958 bytes} [Fri Sep 16 08:03:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 08:03:52.444291 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93c164e-09e2-4fce-834d-6245baeb11c3 None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 08:03:52.444580 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93c164e-09e2-4fce-834d-6245baeb11c3 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 08:03:52.444856 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93c164e-09e2-4fce-834d-6245baeb11c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 08:03:52.464354 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-e93c164e-09e2-4fce-834d-6245baeb11c3 None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 08:03:52.465556 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-e93c164e-09e2-4fce-834d-6245baeb11c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 08:03:52.474205 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1405/2791] 10.222.0.57 () {58 vars in 958 bytes} [Fri Sep 16 08:03:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 08:03:52.478304 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98af47a-c51c-43c1-b6f5-aab64dbf144b None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 08:03:52.488932 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98af47a-c51c-43c1-b6f5-aab64dbf144b None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 08:03:52.493664 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fe49a6-d1b0-4715-ad2a-eac41652f652 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 08:03:52.494293 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fe49a6-d1b0-4715-ad2a-eac41652f652 admin admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 08:03:52.494627 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fe49a6-d1b0-4715-ad2a-eac41652f652 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 08:03:52.494907 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fe49a6-d1b0-4715-ad2a-eac41652f652 admin admin] PATH_INFO: `/v3/domains` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 08:03:52.495550 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fe49a6-d1b0-4715-ad2a-eac41652f652 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 08:03:52.495881 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fe49a6-d1b0-4715-ad2a-eac41652f652 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 08:03:52.497495 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fe49a6-d1b0-4715-ad2a-eac41652f652 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 08:03:52.509201 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1387/2792] 10.222.0.57 () {58 vars in 1153 bytes} [Fri Sep 16 08:03:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 08:03:52.513988 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93c164e-09e2-4fce-834d-6245baeb11c3 None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 08:03:52.522987 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93c164e-09e2-4fce-834d-6245baeb11c3 None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 08:03:52.527552 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5811fc-0a12-45b2-b505-c229965777a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 08:03:52.528135 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5811fc-0a12-45b2-b505-c229965777a6 admin admin] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 08:03:52.528413 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5811fc-0a12-45b2-b505-c229965777a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 08:03:52.528682 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5811fc-0a12-45b2-b505-c229965777a6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 08:03:52.530070 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5811fc-0a12-45b2-b505-c229965777a6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 08:03:52.531952 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5811fc-0a12-45b2-b505-c229965777a6 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 08:03:52.536400 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 08:03:52.560321 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1406/2793] 10.222.0.57 () {60 vars in 1153 bytes} [Fri Sep 16 08:03:52 2022] POST /identity/v3/projects => generated 381 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 08:03:52.564844 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fe49a6-d1b0-4715-ad2a-eac41652f652 admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 08:03:52.574696 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fe49a6-d1b0-4715-ad2a-eac41652f652 admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 08:03:52.630851 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ceb677-c502-45ad-9fcd-cbe7fcf177b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 08:03:52.631448 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ceb677-c502-45ad-9fcd-cbe7fcf177b0 admin admin] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 08:03:52.631730 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ceb677-c502-45ad-9fcd-cbe7fcf177b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 08:03:52.632000 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ceb677-c502-45ad-9fcd-cbe7fcf177b0 admin admin] PATH_INFO: `/v3/users` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 08:03:52.632618 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ceb677-c502-45ad-9fcd-cbe7fcf177b0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 08:03:52.634590 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ceb677-c502-45ad-9fcd-cbe7fcf177b0 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 08:03:52.656068 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1388/2794] 10.222.0.57 () {60 vars in 1144 bytes} [Fri Sep 16 08:03:52 2022] POST /identity/v3/users => generated 291 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 08:03:52.660256 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5811fc-0a12-45b2-b505-c229965777a6 admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 08:03:52.671071 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5811fc-0a12-45b2-b505-c229965777a6 admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 08:03:52.675631 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3b8384-a753-4033-b557-86e55f432ad7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 08:03:52.676215 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3b8384-a753-4033-b557-86e55f432ad7 admin admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 08:03:52.676492 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3b8384-a753-4033-b557-86e55f432ad7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 08:03:52.676760 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3b8384-a753-4033-b557-86e55f432ad7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 08:03:52.677382 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3b8384-a753-4033-b557-86e55f432ad7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 08:03:52.679006 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3b8384-a753-4033-b557-86e55f432ad7 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 08:03:52.688706 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1407/2795] 10.222.0.57 () {58 vars in 1122 bytes} [Fri Sep 16 08:03:52 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 08:03:52.692618 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ceb677-c502-45ad-9fcd-cbe7fcf177b0 admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 08:03:52.702829 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ceb677-c502-45ad-9fcd-cbe7fcf177b0 admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 08:03:52.707425 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a26fc12-e5bd-4835-95d7-17c4993ec646 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 08:03:52.708014 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a26fc12-e5bd-4835-95d7-17c4993ec646 admin admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 08:03:52.708296 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a26fc12-e5bd-4835-95d7-17c4993ec646 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 08:03:52.708578 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a26fc12-e5bd-4835-95d7-17c4993ec646 admin admin] PATH_INFO: `/v3/roles` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 08:03:52.709213 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a26fc12-e5bd-4835-95d7-17c4993ec646 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 08:03:52.710818 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a26fc12-e5bd-4835-95d7-17c4993ec646 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 08:03:52.716005 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:INSERT=4,keystone:DELETE=3,keystone:SELECT=93 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 08:03:52.722682 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1389/2796] 10.222.0.57 () {58 vars in 1122 bytes} [Fri Sep 16 08:03:52 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 08:03:52.726731 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3b8384-a753-4033-b557-86e55f432ad7 admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 08:03:52.737473 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3b8384-a753-4033-b557-86e55f432ad7 admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 08:03:52.742105 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b8e5de-9d3a-4e3e-9225-100ff29d59d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 08:03:52.742740 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b8e5de-9d3a-4e3e-9225-100ff29d59d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 08:03:52.743019 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b8e5de-9d3a-4e3e-9225-100ff29d59d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 08:03:52.743289 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b8e5de-9d3a-4e3e-9225-100ff29d59d8 admin admin] PATH_INFO: `/v3/projects/7af8bf0c929d40cd9eb0b9519b880043/users/0bf31da50a754e45bb4d426e3a476b4e/roles/4818d38cf2564825b312e66c9eb24762` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 08:03:52.757521 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b8e5de-9d3a-4e3e-9225-100ff29d59d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7af8bf0c929d40cd9eb0b9519b880043, user_id=0bf31da50a754e45bb4d426e3a476b4e, role_id=4818d38cf2564825b312e66c9eb24762)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 08:03:52.760212 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b8e5de-9d3a-4e3e-9225-100ff29d59d8 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 08:03:52.773701 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1408/2797] 10.222.0.57 () {60 vars in 1483 bytes} [Fri Sep 16 08:03:52 2022] PUT /identity/v3/projects/7af8bf0c929d40cd9eb0b9519b880043/users/0bf31da50a754e45bb4d426e3a476b4e/roles/4818d38cf2564825b312e66c9eb24762 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 08:03:52.778658 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6850dfdc-09ff-408f-be0a-a2ca2a70c43c None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 08:03:52.778945 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6850dfdc-09ff-408f-be0a-a2ca2a70c43c None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 08:03:52.779342 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6850dfdc-09ff-408f-be0a-a2ca2a70c43c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 08:03:52.798696 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-6850dfdc-09ff-408f-be0a-a2ca2a70c43c None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 08:03:52.799825 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-6850dfdc-09ff-408f-be0a-a2ca2a70c43c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 08:03:52.857063 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1390/2798] 10.222.0.57 () {58 vars in 958 bytes} [Fri Sep 16 08:03:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 08:03:52.867134 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b8e5de-9d3a-4e3e-9225-100ff29d59d8 admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 08:03:52.868875 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-36b8e5de-9d3a-4e3e-9225-100ff29d59d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 08:03:52.947351 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b8e5de-9d3a-4e3e-9225-100ff29d59d8 admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 08:03:52.951344 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25ddc19-bd6d-4727-9791-0a6fb0482559 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1062e457207a41e4ba4f0a0c4bf36f1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4735f453c0c24cc4a1c14e9ac84a0b46', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 08:03:52.952164 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25ddc19-bd6d-4727-9791-0a6fb0482559 service neutron] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 08:03:52.952446 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25ddc19-bd6d-4727-9791-0a6fb0482559 service neutron] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 08:03:52.952718 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25ddc19-bd6d-4727-9791-0a6fb0482559 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 08:03:52.961931 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25ddc19-bd6d-4727-9791-0a6fb0482559 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 08:03:52.963351 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25ddc19-bd6d-4727-9791-0a6fb0482559 service neutron] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 08:03:52.973005 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1409/2799] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Sep 16 08:03:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 16 08:03:56.891185 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8da9afa-fd7e-42ab-b922-69410bb2480a None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 08:03:56.891726 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8da9afa-fd7e-42ab-b922-69410bb2480a None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 08:03:56.891726 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8da9afa-fd7e-42ab-b922-69410bb2480a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 08:03:56.923079 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-b8da9afa-fd7e-42ab-b922-69410bb2480a None None] MFA Rules not processed for user `0bf31da50a754e45bb4d426e3a476b4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 08:03:56.924191 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-b8da9afa-fd7e-42ab-b922-69410bb2480a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 08:03:57.012776 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1391/2800] 10.222.0.57 () {58 vars in 958 bytes} [Fri Sep 16 08:03:56 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 08:03:57.027604 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25ddc19-bd6d-4727-9791-0a6fb0482559 service neutron] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 08:03:57.030677 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-a25ddc19-bd6d-4727-9791-0a6fb0482559 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 08:03:57.176776 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25ddc19-bd6d-4727-9791-0a6fb0482559 service neutron] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 08:03:57.182535 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a880f9-54fd-40e5-996b-422ab3e8f223 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bec4d9b08514461a1bf63c6b88f53b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4735f453c0c24cc4a1c14e9ac84a0b46', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 08:03:57.183224 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a880f9-54fd-40e5-996b-422ab3e8f223 service nova] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 08:03:57.183576 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a880f9-54fd-40e5-996b-422ab3e8f223 service nova] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 08:03:57.183856 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a880f9-54fd-40e5-996b-422ab3e8f223 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 08:03:57.192780 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a880f9-54fd-40e5-996b-422ab3e8f223 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 08:03:57.194412 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a880f9-54fd-40e5-996b-422ab3e8f223 service nova] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 08:03:57.198421 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 08:03:57.205560 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1410/2801] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Sep 16 08:03:57 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 08:03:58.520605 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6eb577b-1ec6-49d6-ad36-8cc320492188 None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 08:03:58.521131 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6eb577b-1ec6-49d6-ad36-8cc320492188 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 08:03:58.521131 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6eb577b-1ec6-49d6-ad36-8cc320492188 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 08:03:58.540447 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-b6eb577b-1ec6-49d6-ad36-8cc320492188 None None] MFA Rules not processed for user `0bf31da50a754e45bb4d426e3a476b4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 08:03:58.541749 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-b6eb577b-1ec6-49d6-ad36-8cc320492188 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 08:03:58.549206 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1392/2802] 10.222.0.57 () {58 vars in 958 bytes} [Fri Sep 16 08:03:58 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 08:04:07.208562 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=1 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 08:04:08.534693 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=62 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 08:04:50.205846 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c69e98-c0a5-4c2d-a504-dfa385de69d7 None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 08:04:50.206374 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c69e98-c0a5-4c2d-a504-dfa385de69d7 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 08:04:50.206374 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c69e98-c0a5-4c2d-a504-dfa385de69d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 08:04:50.225931 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-39c69e98-c0a5-4c2d-a504-dfa385de69d7 None None] MFA Rules not processed for user `0bf31da50a754e45bb4d426e3a476b4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 08:04:50.227114 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-39c69e98-c0a5-4c2d-a504-dfa385de69d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 08:04:50.235926 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1411/2803] 10.222.0.57 () {58 vars in 958 bytes} [Fri Sep 16 08:04:50 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 08:05:00.220619 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=3 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 08:05:36.024404 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6eb577b-1ec6-49d6-ad36-8cc320492188 None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 08:05:36.025818 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-b6eb577b-1ec6-49d6-ad36-8cc320492188 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 08:05:36.106713 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6eb577b-1ec6-49d6-ad36-8cc320492188 None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 08:05:36.110564 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad0b329-ca6a-4a6a-b903-46627fe20c6d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544bf6be4c24454a013ca110c43cef2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4735f453c0c24cc4a1c14e9ac84a0b46', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 08:05:36.111200 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad0b329-ca6a-4a6a-b903-46627fe20c6d service cinder] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 08:05:36.111476 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad0b329-ca6a-4a6a-b903-46627fe20c6d service cinder] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 08:05:36.111743 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad0b329-ca6a-4a6a-b903-46627fe20c6d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 08:05:36.114333 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-7ad0b329-ca6a-4a6a-b903-46627fe20c6d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 08:05:36.127608 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad0b329-ca6a-4a6a-b903-46627fe20c6d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 08:05:36.129655 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad0b329-ca6a-4a6a-b903-46627fe20c6d service cinder] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 08:05:36.140401 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1393/2804] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Sep 16 08:05:36 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 08:05:37.548777 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c69e98-c0a5-4c2d-a504-dfa385de69d7 None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 08:05:37.559925 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c69e98-c0a5-4c2d-a504-dfa385de69d7 None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 08:05:37.563452 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca90130-2a11-46c2-be4b-d215bc9615aa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1062e457207a41e4ba4f0a0c4bf36f1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4735f453c0c24cc4a1c14e9ac84a0b46', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 08:05:37.564047 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca90130-2a11-46c2-be4b-d215bc9615aa service neutron] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 08:05:37.564328 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca90130-2a11-46c2-be4b-d215bc9615aa service neutron] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 08:05:37.564600 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca90130-2a11-46c2-be4b-d215bc9615aa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 08:05:37.566591 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-3ca90130-2a11-46c2-be4b-d215bc9615aa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 08:05:37.580149 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca90130-2a11-46c2-be4b-d215bc9615aa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 08:05:37.581706 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca90130-2a11-46c2-be4b-d215bc9615aa service neutron] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 08:05:37.592601 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1412/2805] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Sep 16 08:05:37 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 08:05:46.135615 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=35 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 08:05:47.365700 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73453b6-1c9d-4491-821a-fa041cb801fd None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 08:05:47.366316 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73453b6-1c9d-4491-821a-fa041cb801fd None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 08:05:47.366316 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73453b6-1c9d-4491-821a-fa041cb801fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 08:05:47.386811 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-b73453b6-1c9d-4491-821a-fa041cb801fd None None] MFA Rules not processed for user `0bf31da50a754e45bb4d426e3a476b4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 08:05:47.388080 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-b73453b6-1c9d-4491-821a-fa041cb801fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 08:05:47.394942 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1394/2806] 10.222.0.57 () {58 vars in 958 bytes} [Fri Sep 16 08:05:47 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 08:05:47.587793 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=6 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 08:05:57.382352 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=3 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 08:06:39.313047 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca90130-2a11-46c2-be4b-d215bc9615aa service neutron] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 08:06:39.315715 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-3ca90130-2a11-46c2-be4b-d215bc9615aa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 08:06:39.332396 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca90130-2a11-46c2-be4b-d215bc9615aa service neutron] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 08:06:39.338827 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddeed2d-5147-4009-9edc-90131568bfca service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bec4d9b08514461a1bf63c6b88f53b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4735f453c0c24cc4a1c14e9ac84a0b46', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 08:06:39.339765 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddeed2d-5147-4009-9edc-90131568bfca service nova] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 08:06:39.339935 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddeed2d-5147-4009-9edc-90131568bfca service nova] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 08:06:39.340221 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddeed2d-5147-4009-9edc-90131568bfca service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 08:06:39.342495 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-6ddeed2d-5147-4009-9edc-90131568bfca service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 08:06:39.372643 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ddeed2d-5147-4009-9edc-90131568bfca service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 08:06:39.374296 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ddeed2d-5147-4009-9edc-90131568bfca service nova] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 08:06:39.402454 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1413/2807] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Sep 16 08:06:39 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 08:06:42.538804 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea8cd5e-711c-4e27-8826-7ec51264b2c7 None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 08:06:42.539333 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea8cd5e-711c-4e27-8826-7ec51264b2c7 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 08:06:42.539506 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea8cd5e-711c-4e27-8826-7ec51264b2c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 08:06:42.558238 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-0ea8cd5e-711c-4e27-8826-7ec51264b2c7 None None] MFA Rules not processed for user `0bf31da50a754e45bb4d426e3a476b4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 08:06:42.559462 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-0ea8cd5e-711c-4e27-8826-7ec51264b2c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 08:06:42.566760 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1395/2808] 10.222.0.57 () {58 vars in 958 bytes} [Fri Sep 16 08:06:42 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 08:06:44.880069 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddeed2d-5147-4009-9edc-90131568bfca service nova] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 08:06:44.881518 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-6ddeed2d-5147-4009-9edc-90131568bfca service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 08:06:44.894424 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddeed2d-5147-4009-9edc-90131568bfca service nova] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 08:06:44.898627 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea39ac1d-98c0-4bda-b3b5-dbd7ba8591cc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1062e457207a41e4ba4f0a0c4bf36f1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4735f453c0c24cc4a1c14e9ac84a0b46', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 08:06:44.900033 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea39ac1d-98c0-4bda-b3b5-dbd7ba8591cc service neutron] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 08:06:44.900375 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea39ac1d-98c0-4bda-b3b5-dbd7ba8591cc service neutron] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 08:06:44.900716 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea39ac1d-98c0-4bda-b3b5-dbd7ba8591cc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 08:06:44.902658 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-ea39ac1d-98c0-4bda-b3b5-dbd7ba8591cc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 08:06:44.913168 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea39ac1d-98c0-4bda-b3b5-dbd7ba8591cc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 08:06:44.915120 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea39ac1d-98c0-4bda-b3b5-dbd7ba8591cc service neutron] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 08:06:44.924664 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1414/2809] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Sep 16 08:06:44 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 08:06:52.552740 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=3 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 08:06:53.774477 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea8cd5e-711c-4e27-8826-7ec51264b2c7 None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 08:06:53.788965 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea8cd5e-711c-4e27-8826-7ec51264b2c7 None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 08:06:53.795945 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31200a1-c28f-409d-83c9-8f43d5d9db82 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bec4d9b08514461a1bf63c6b88f53b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4735f453c0c24cc4a1c14e9ac84a0b46', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 08:06:53.796566 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31200a1-c28f-409d-83c9-8f43d5d9db82 service nova] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 08:06:53.796849 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31200a1-c28f-409d-83c9-8f43d5d9db82 service nova] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 08:06:53.797123 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31200a1-c28f-409d-83c9-8f43d5d9db82 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 08:06:53.799064 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-b31200a1-c28f-409d-83c9-8f43d5d9db82 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 08:06:53.813089 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31200a1-c28f-409d-83c9-8f43d5d9db82 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 08:06:53.814691 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31200a1-c28f-409d-83c9-8f43d5d9db82 service nova] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 08:06:53.825565 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1396/2810] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Sep 16 08:06:53 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 16 08:06:54.920620 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=12 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 08:07:03.821571 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=6 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 08:07:38.485516 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea39ac1d-98c0-4bda-b3b5-dbd7ba8591cc service neutron] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 08:07:38.500454 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea39ac1d-98c0-4bda-b3b5-dbd7ba8591cc service neutron] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 08:07:38.505292 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e828994-c3f6-40ab-bce7-7ce7d13f66f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 08:07:38.506052 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e828994-c3f6-40ab-bce7-7ce7d13f66f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 08:07:38.506392 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e828994-c3f6-40ab-bce7-7ce7d13f66f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 08:07:38.506729 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e828994-c3f6-40ab-bce7-7ce7d13f66f3 admin admin] PATH_INFO: `/v3/users/0bf31da50a754e45bb4d426e3a476b4e` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 08:07:38.507931 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e828994-c3f6-40ab-bce7-7ce7d13f66f3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0bf31da50a754e45bb4d426e3a476b4e)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 08:07:38.510015 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e828994-c3f6-40ab-bce7-7ce7d13f66f3 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 08:07:38.561467 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-0e828994-c3f6-40ab-bce7-7ce7d13f66f3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0bf31da50a754e45bb4d426e3a476b4e'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 08:07:38.574551 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-0e828994-c3f6-40ab-bce7-7ce7d13f66f3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0bf31da50a754e45bb4d426e3a476b4e'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 08:07:38.575285 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-0e828994-c3f6-40ab-bce7-7ce7d13f66f3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0bf31da50a754e45bb4d426e3a476b4e'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 08:07:38.583408 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-0e828994-c3f6-40ab-bce7-7ce7d13f66f3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0bf31da50a754e45bb4d426e3a476b4e'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 08:07:38.591908 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-0e828994-c3f6-40ab-bce7-7ce7d13f66f3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0bf31da50a754e45bb4d426e3a476b4e'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 08:07:38.598485 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1415/2811] 10.222.0.57 () {58 vars in 1224 bytes} [Fri Sep 16 08:07:38 2022] DELETE /identity/v3/users/0bf31da50a754e45bb4d426e3a476b4e => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 08:07:38.775493 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31200a1-c28f-409d-83c9-8f43d5d9db82 service nova] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 08:07:38.786050 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31200a1-c28f-409d-83c9-8f43d5d9db82 service nova] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 08:07:38.842693 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea5a361-621a-4a75-b186-52a0a556a76d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 08:07:38.843320 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea5a361-621a-4a75-b186-52a0a556a76d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 08:07:38.843604 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea5a361-621a-4a75-b186-52a0a556a76d admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 08:07:38.843877 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea5a361-621a-4a75-b186-52a0a556a76d admin admin] PATH_INFO: `/v3/projects/7af8bf0c929d40cd9eb0b9519b880043` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 08:07:38.844994 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea5a361-621a-4a75-b186-52a0a556a76d admin admin] RBAC: Authorizing `identity:delete_project(project_id=7af8bf0c929d40cd9eb0b9519b880043)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 08:07:38.846903 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea5a361-621a-4a75-b186-52a0a556a76d admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 08:07:38.893011 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-cea5a361-621a-4a75-b186-52a0a556a76d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7af8bf0c929d40cd9eb0b9519b880043', 'request_id': 'req-cea5a361-621a-4a75-b186-52a0a556a76d'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 08:07:38.900852 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-cea5a361-621a-4a75-b186-52a0a556a76d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7af8bf0c929d40cd9eb0b9519b880043', 'request_id': 'req-cea5a361-621a-4a75-b186-52a0a556a76d'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 08:07:38.906359 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-cea5a361-621a-4a75-b186-52a0a556a76d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7af8bf0c929d40cd9eb0b9519b880043', 'request_id': 'req-cea5a361-621a-4a75-b186-52a0a556a76d'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 08:07:38.918460 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-cea5a361-621a-4a75-b186-52a0a556a76d admin admin] The token cache is being invalidate because project 7af8bf0c929d40cd9eb0b9519b880043 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81430) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 08:07:38.918753 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-cea5a361-621a-4a75-b186-52a0a556a76d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 08:07:38.919390 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-cea5a361-621a-4a75-b186-52a0a556a76d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 08:07:38.920847 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1397/2812] 10.222.0.57 () {58 vars in 1233 bytes} [Fri Sep 16 08:07:38 2022] DELETE /identity/v3/projects/7af8bf0c929d40cd9eb0b9519b880043 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 08:07:38.925780 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a117fd-5cda-460d-9d44-c4b3b416ff74 None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 08:07:38.926072 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a117fd-5cda-460d-9d44-c4b3b416ff74 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 08:07:38.926351 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a117fd-5cda-460d-9d44-c4b3b416ff74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 08:07:38.948179 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-24a117fd-5cda-460d-9d44-c4b3b416ff74 None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 08:07:38.949383 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-24a117fd-5cda-460d-9d44-c4b3b416ff74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 08:07:39.011319 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1416/2813] 10.222.0.57 () {58 vars in 958 bytes} [Fri Sep 16 08:07:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 08:07:39.018852 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8b005c-65b9-4c38-bbf5-5590577dfee3 None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 08:07:39.019074 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8b005c-65b9-4c38-bbf5-5590577dfee3 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 08:07:39.019347 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8b005c-65b9-4c38-bbf5-5590577dfee3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 08:07:39.038545 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-3c8b005c-65b9-4c38-bbf5-5590577dfee3 None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 08:07:39.040278 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-3c8b005c-65b9-4c38-bbf5-5590577dfee3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 08:07:39.048434 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1398/2814] 10.222.0.57 () {58 vars in 958 bytes} [Fri Sep 16 08:07:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 08:07:39.052461 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a117fd-5cda-460d-9d44-c4b3b416ff74 None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 08:07:39.062964 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a117fd-5cda-460d-9d44-c4b3b416ff74 None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 08:07:39.067687 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acdf864-aa3b-4a3c-9e61-53f93bcd3c33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 08:07:39.068289 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acdf864-aa3b-4a3c-9e61-53f93bcd3c33 admin admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 08:07:39.068563 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acdf864-aa3b-4a3c-9e61-53f93bcd3c33 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 08:07:39.068828 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acdf864-aa3b-4a3c-9e61-53f93bcd3c33 admin admin] PATH_INFO: `/v3/domains` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 08:07:39.069464 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9acdf864-aa3b-4a3c-9e61-53f93bcd3c33 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 08:07:39.069856 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9acdf864-aa3b-4a3c-9e61-53f93bcd3c33 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 08:07:39.071441 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9acdf864-aa3b-4a3c-9e61-53f93bcd3c33 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 08:07:39.087790 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1417/2815] 10.222.0.57 () {58 vars in 1153 bytes} [Fri Sep 16 08:07:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 08:07:39.092124 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8b005c-65b9-4c38-bbf5-5590577dfee3 None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 08:07:39.101773 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8b005c-65b9-4c38-bbf5-5590577dfee3 None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 08:07:39.107129 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49ce392-ada3-4f88-b21a-ea9aff19b7fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 08:07:39.107811 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49ce392-ada3-4f88-b21a-ea9aff19b7fe admin admin] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 08:07:39.108465 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49ce392-ada3-4f88-b21a-ea9aff19b7fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 08:07:39.108465 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49ce392-ada3-4f88-b21a-ea9aff19b7fe admin admin] PATH_INFO: `/v3/projects` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 08:07:39.109027 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49ce392-ada3-4f88-b21a-ea9aff19b7fe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 08:07:39.111192 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49ce392-ada3-4f88-b21a-ea9aff19b7fe admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 08:07:39.150117 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1399/2816] 10.222.0.57 () {60 vars in 1153 bytes} [Fri Sep 16 08:07:39 2022] POST /identity/v3/projects => generated 367 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 16 08:07:39.154223 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acdf864-aa3b-4a3c-9e61-53f93bcd3c33 admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 08:07:39.164013 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acdf864-aa3b-4a3c-9e61-53f93bcd3c33 admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 08:07:39.224772 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99de5698-a23f-44fd-a56c-8af1e6d9927c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 08:07:39.225376 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99de5698-a23f-44fd-a56c-8af1e6d9927c admin admin] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 08:07:39.225674 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99de5698-a23f-44fd-a56c-8af1e6d9927c admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 08:07:39.225976 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99de5698-a23f-44fd-a56c-8af1e6d9927c admin admin] PATH_INFO: `/v3/users` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 08:07:39.226626 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99de5698-a23f-44fd-a56c-8af1e6d9927c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 08:07:39.229190 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99de5698-a23f-44fd-a56c-8af1e6d9927c admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 08:07:39.237311 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 08:07:39.251131 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1418/2817] 10.222.0.57 () {60 vars in 1144 bytes} [Fri Sep 16 08:07:39 2022] POST /identity/v3/users => generated 284 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 16 08:07:39.255376 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49ce392-ada3-4f88-b21a-ea9aff19b7fe admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 08:07:39.265584 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49ce392-ada3-4f88-b21a-ea9aff19b7fe admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 08:07:39.270251 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407e2ec5-7d5a-4b3e-aaa1-77757c677c6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 08:07:39.270790 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407e2ec5-7d5a-4b3e-aaa1-77757c677c6f admin admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 08:07:39.271072 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407e2ec5-7d5a-4b3e-aaa1-77757c677c6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 08:07:39.271348 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407e2ec5-7d5a-4b3e-aaa1-77757c677c6f admin admin] PATH_INFO: `/v3/roles` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 08:07:39.272020 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407e2ec5-7d5a-4b3e-aaa1-77757c677c6f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 08:07:39.273595 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407e2ec5-7d5a-4b3e-aaa1-77757c677c6f admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 08:07:39.283868 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1400/2818] 10.222.0.57 () {58 vars in 1122 bytes} [Fri Sep 16 08:07:39 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 08:07:39.287667 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99de5698-a23f-44fd-a56c-8af1e6d9927c admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 08:07:39.301624 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99de5698-a23f-44fd-a56c-8af1e6d9927c admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 08:07:39.306265 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29209489-967a-49dd-8f1d-117fddd5e8d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 08:07:39.306887 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29209489-967a-49dd-8f1d-117fddd5e8d5 admin admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 08:07:39.307162 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29209489-967a-49dd-8f1d-117fddd5e8d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 08:07:39.307427 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29209489-967a-49dd-8f1d-117fddd5e8d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 08:07:39.308058 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29209489-967a-49dd-8f1d-117fddd5e8d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 08:07:39.309670 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29209489-967a-49dd-8f1d-117fddd5e8d5 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 08:07:39.320849 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1419/2819] 10.222.0.57 () {58 vars in 1122 bytes} [Fri Sep 16 08:07:39 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 08:07:39.326178 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407e2ec5-7d5a-4b3e-aaa1-77757c677c6f admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 08:07:39.336304 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407e2ec5-7d5a-4b3e-aaa1-77757c677c6f admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 08:07:39.341679 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a188e0db-3e38-4063-be10-c93c5cd68792 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 08:07:39.342354 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a188e0db-3e38-4063-be10-c93c5cd68792 admin admin] REQUEST_METHOD: `PUT` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 08:07:39.342633 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a188e0db-3e38-4063-be10-c93c5cd68792 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 08:07:39.342901 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a188e0db-3e38-4063-be10-c93c5cd68792 admin admin] PATH_INFO: `/v3/projects/1de8d83433724d2d8215e6c63c43a087/users/63e1ae07d5a443dcac20a3db97010a98/roles/4818d38cf2564825b312e66c9eb24762` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 08:07:39.357665 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a188e0db-3e38-4063-be10-c93c5cd68792 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1de8d83433724d2d8215e6c63c43a087, user_id=63e1ae07d5a443dcac20a3db97010a98, role_id=4818d38cf2564825b312e66c9eb24762)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 08:07:39.360312 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a188e0db-3e38-4063-be10-c93c5cd68792 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 08:07:39.373883 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1401/2820] 10.222.0.57 () {60 vars in 1483 bytes} [Fri Sep 16 08:07:39 2022] PUT /identity/v3/projects/1de8d83433724d2d8215e6c63c43a087/users/63e1ae07d5a443dcac20a3db97010a98/roles/4818d38cf2564825b312e66c9eb24762 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 08:07:39.436177 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf69283-b6d2-4d33-bdd2-a35ed34a01f7 None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 08:07:39.436459 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf69283-b6d2-4d33-bdd2-a35ed34a01f7 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 08:07:39.436731 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf69283-b6d2-4d33-bdd2-a35ed34a01f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 08:07:39.464009 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-4cf69283-b6d2-4d33-bdd2-a35ed34a01f7 None None] MFA Rules not processed for user `63e1ae07d5a443dcac20a3db97010a98`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 08:07:39.465196 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-4cf69283-b6d2-4d33-bdd2-a35ed34a01f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 08:07:39.528001 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1420/2821] 10.222.0.57 () {58 vars in 958 bytes} [Fri Sep 16 08:07:39 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 08:07:39.538655 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a188e0db-3e38-4063-be10-c93c5cd68792 admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 08:07:39.540587 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-a188e0db-3e38-4063-be10-c93c5cd68792 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 08:07:39.560852 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 08:07:39.601406 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a188e0db-3e38-4063-be10-c93c5cd68792 admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 08:07:39.605193 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f26a91-b683-4921-ad8a-15f1d87987f3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544bf6be4c24454a013ca110c43cef2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4735f453c0c24cc4a1c14e9ac84a0b46', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 08:07:39.605826 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f26a91-b683-4921-ad8a-15f1d87987f3 service cinder] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 08:07:39.606109 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f26a91-b683-4921-ad8a-15f1d87987f3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 08:07:39.606379 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f26a91-b683-4921-ad8a-15f1d87987f3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 08:07:39.614669 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f26a91-b683-4921-ad8a-15f1d87987f3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 08:07:39.616069 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f26a91-b683-4921-ad8a-15f1d87987f3 service cinder] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 08:07:39.625016 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1402/2822] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Sep 16 08:07:39 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 08:07:47.999206 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf69283-b6d2-4d33-bdd2-a35ed34a01f7 None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 08:07:48.059740 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf69283-b6d2-4d33-bdd2-a35ed34a01f7 None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 08:07:48.064226 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5865d97e-a905-4a39-9f72-d71cc8e69f8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 08:07:48.064845 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5865d97e-a905-4a39-9f72-d71cc8e69f8f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 08:07:48.065120 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5865d97e-a905-4a39-9f72-d71cc8e69f8f admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 08:07:48.065389 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5865d97e-a905-4a39-9f72-d71cc8e69f8f admin admin] PATH_INFO: `/v3/users/63e1ae07d5a443dcac20a3db97010a98` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 08:07:48.066519 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5865d97e-a905-4a39-9f72-d71cc8e69f8f admin admin] RBAC: Authorizing `identity:delete_user(user_id=63e1ae07d5a443dcac20a3db97010a98)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 08:07:48.068433 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5865d97e-a905-4a39-9f72-d71cc8e69f8f admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 08:07:48.115607 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-5865d97e-a905-4a39-9f72-d71cc8e69f8f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '63e1ae07d5a443dcac20a3db97010a98'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 08:07:48.127379 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-5865d97e-a905-4a39-9f72-d71cc8e69f8f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '63e1ae07d5a443dcac20a3db97010a98'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 08:07:48.128056 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-5865d97e-a905-4a39-9f72-d71cc8e69f8f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '63e1ae07d5a443dcac20a3db97010a98'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 08:07:48.131792 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:INSERT=4,keystone:SELECT=86,keystone:DELETE=10 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 08:07:48.136479 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-5865d97e-a905-4a39-9f72-d71cc8e69f8f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '63e1ae07d5a443dcac20a3db97010a98'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 08:07:48.144869 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-5865d97e-a905-4a39-9f72-d71cc8e69f8f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '63e1ae07d5a443dcac20a3db97010a98'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 08:07:48.150600 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1421/2823] 10.222.0.57 () {58 vars in 1224 bytes} [Fri Sep 16 08:07:47 2022] DELETE /identity/v3/users/63e1ae07d5a443dcac20a3db97010a98 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 08:07:48.155833 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d39fbee-b560-4cfd-bc27-80587d909aae None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 08:07:48.156349 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d39fbee-b560-4cfd-bc27-80587d909aae None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 08:07:48.156463 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d39fbee-b560-4cfd-bc27-80587d909aae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 08:07:48.175920 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-7d39fbee-b560-4cfd-bc27-80587d909aae None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 08:07:48.177125 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-7d39fbee-b560-4cfd-bc27-80587d909aae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 08:07:48.235245 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1403/2824] 10.222.0.57 () {58 vars in 958 bytes} [Fri Sep 16 08:07:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 08:07:48.245105 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5865d97e-a905-4a39-9f72-d71cc8e69f8f admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 08:07:48.246549 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-5865d97e-a905-4a39-9f72-d71cc8e69f8f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 08:07:48.302950 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5865d97e-a905-4a39-9f72-d71cc8e69f8f admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 08:07:48.306610 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efce801-81a0-4e9c-8886-9d4c192aef82 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1062e457207a41e4ba4f0a0c4bf36f1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4735f453c0c24cc4a1c14e9ac84a0b46', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 08:07:48.307210 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efce801-81a0-4e9c-8886-9d4c192aef82 service neutron] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 08:07:48.307488 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efce801-81a0-4e9c-8886-9d4c192aef82 service neutron] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 08:07:48.307762 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efce801-81a0-4e9c-8886-9d4c192aef82 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 08:07:48.316894 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efce801-81a0-4e9c-8886-9d4c192aef82 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 08:07:48.318359 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efce801-81a0-4e9c-8886-9d4c192aef82 service neutron] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 08:07:48.327881 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1422/2825] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Sep 16 08:07:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 08:07:48.598592 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d39fbee-b560-4cfd-bc27-80587d909aae None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 08:07:48.600032 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-7d39fbee-b560-4cfd-bc27-80587d909aae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 08:07:48.614992 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d39fbee-b560-4cfd-bc27-80587d909aae None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 08:07:48.619821 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad886b9-40bb-47fb-91d3-bd50f232b04a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 08:07:48.627825 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad886b9-40bb-47fb-91d3-bd50f232b04a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 08:07:48.628197 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad886b9-40bb-47fb-91d3-bd50f232b04a admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 08:07:48.628486 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad886b9-40bb-47fb-91d3-bd50f232b04a admin admin] PATH_INFO: `/v3/projects/1de8d83433724d2d8215e6c63c43a087` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 08:07:48.629744 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad886b9-40bb-47fb-91d3-bd50f232b04a admin admin] RBAC: Authorizing `identity:delete_project(project_id=1de8d83433724d2d8215e6c63c43a087)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 08:07:48.631667 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad886b9-40bb-47fb-91d3-bd50f232b04a admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 08:07:48.677447 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-7ad886b9-40bb-47fb-91d3-bd50f232b04a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1de8d83433724d2d8215e6c63c43a087', 'request_id': 'req-7ad886b9-40bb-47fb-91d3-bd50f232b04a'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 08:07:48.685063 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-7ad886b9-40bb-47fb-91d3-bd50f232b04a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1de8d83433724d2d8215e6c63c43a087', 'request_id': 'req-7ad886b9-40bb-47fb-91d3-bd50f232b04a'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 08:07:48.690550 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-7ad886b9-40bb-47fb-91d3-bd50f232b04a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1de8d83433724d2d8215e6c63c43a087', 'request_id': 'req-7ad886b9-40bb-47fb-91d3-bd50f232b04a'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 08:07:48.701339 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-7ad886b9-40bb-47fb-91d3-bd50f232b04a admin admin] The token cache is being invalidate because project 1de8d83433724d2d8215e6c63c43a087 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81430) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 08:07:48.701620 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-7ad886b9-40bb-47fb-91d3-bd50f232b04a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 08:07:48.702268 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-7ad886b9-40bb-47fb-91d3-bd50f232b04a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 08:07:48.703722 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1404/2826] 10.222.0.57 () {58 vars in 1233 bytes} [Fri Sep 16 08:07:48 2022] DELETE /identity/v3/projects/1de8d83433724d2d8215e6c63c43a087 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 08:07:48.708659 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c4aa30-fa11-446f-b388-72d6bd585bcf None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 08:07:48.708945 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c4aa30-fa11-446f-b388-72d6bd585bcf None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 08:07:48.709214 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c4aa30-fa11-446f-b388-72d6bd585bcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 08:07:48.728555 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-93c4aa30-fa11-446f-b388-72d6bd585bcf None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 08:07:48.729946 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-93c4aa30-fa11-446f-b388-72d6bd585bcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 08:07:48.789976 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1423/2827] 10.222.0.57 () {58 vars in 958 bytes} [Fri Sep 16 08:07:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 08:07:48.798251 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a894e091-a82e-402c-a33c-18efee40df4f None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 08:07:48.798542 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a894e091-a82e-402c-a33c-18efee40df4f None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 08:07:48.798822 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a894e091-a82e-402c-a33c-18efee40df4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 08:07:48.818521 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-a894e091-a82e-402c-a33c-18efee40df4f None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 08:07:48.819720 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-a894e091-a82e-402c-a33c-18efee40df4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 08:07:48.827841 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1405/2828] 10.222.0.57 () {58 vars in 958 bytes} [Fri Sep 16 08:07:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 08:07:48.831942 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c4aa30-fa11-446f-b388-72d6bd585bcf None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 08:07:48.841946 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c4aa30-fa11-446f-b388-72d6bd585bcf None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 08:07:48.846500 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4842a4-41b3-4fe6-8375-ec28c3abe1d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 08:07:48.847091 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4842a4-41b3-4fe6-8375-ec28c3abe1d6 admin admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 08:07:48.847370 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4842a4-41b3-4fe6-8375-ec28c3abe1d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 08:07:48.847642 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4842a4-41b3-4fe6-8375-ec28c3abe1d6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 08:07:48.848274 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4842a4-41b3-4fe6-8375-ec28c3abe1d6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 08:07:48.848574 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4842a4-41b3-4fe6-8375-ec28c3abe1d6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 08:07:48.850198 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4842a4-41b3-4fe6-8375-ec28c3abe1d6 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 08:07:48.862285 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1424/2829] 10.222.0.57 () {58 vars in 1153 bytes} [Fri Sep 16 08:07:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 08:07:48.866463 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a894e091-a82e-402c-a33c-18efee40df4f None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 08:07:48.875621 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a894e091-a82e-402c-a33c-18efee40df4f None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 08:07:48.880258 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ce7a2b-1410-48fa-a45f-4fef5f22f2bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 08:07:48.880845 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ce7a2b-1410-48fa-a45f-4fef5f22f2bb admin admin] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 08:07:48.881123 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ce7a2b-1410-48fa-a45f-4fef5f22f2bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 08:07:48.881394 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ce7a2b-1410-48fa-a45f-4fef5f22f2bb admin admin] PATH_INFO: `/v3/projects` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 08:07:48.882068 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ce7a2b-1410-48fa-a45f-4fef5f22f2bb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 08:07:48.883943 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ce7a2b-1410-48fa-a45f-4fef5f22f2bb admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 08:07:48.911883 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1406/2830] 10.222.0.57 () {60 vars in 1153 bytes} [Fri Sep 16 08:07:48 2022] POST /identity/v3/projects => generated 369 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 16 08:07:48.916279 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4842a4-41b3-4fe6-8375-ec28c3abe1d6 admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 08:07:48.927289 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4842a4-41b3-4fe6-8375-ec28c3abe1d6 admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 08:07:48.982641 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5541c66-5d80-4b29-a217-5c954b1d2f5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 08:07:48.983236 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5541c66-5d80-4b29-a217-5c954b1d2f5c admin admin] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 08:07:48.983510 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5541c66-5d80-4b29-a217-5c954b1d2f5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 08:07:48.983775 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5541c66-5d80-4b29-a217-5c954b1d2f5c admin admin] PATH_INFO: `/v3/users` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 08:07:48.984397 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5541c66-5d80-4b29-a217-5c954b1d2f5c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 08:07:48.986589 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5541c66-5d80-4b29-a217-5c954b1d2f5c admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 08:07:49.007839 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1425/2831] 10.222.0.57 () {60 vars in 1144 bytes} [Fri Sep 16 08:07:48 2022] POST /identity/v3/users => generated 285 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 16 08:07:49.020336 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ce7a2b-1410-48fa-a45f-4fef5f22f2bb admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 08:07:49.031399 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ce7a2b-1410-48fa-a45f-4fef5f22f2bb admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 08:07:49.036064 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2263d50c-943e-415e-94c2-1b24a7a60a78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 08:07:49.036651 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2263d50c-943e-415e-94c2-1b24a7a60a78 admin admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 08:07:49.036932 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2263d50c-943e-415e-94c2-1b24a7a60a78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 08:07:49.037205 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2263d50c-943e-415e-94c2-1b24a7a60a78 admin admin] PATH_INFO: `/v3/roles` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 08:07:49.037902 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2263d50c-943e-415e-94c2-1b24a7a60a78 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 08:07:49.039475 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2263d50c-943e-415e-94c2-1b24a7a60a78 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 08:07:49.050251 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1407/2832] 10.222.0.57 () {58 vars in 1122 bytes} [Fri Sep 16 08:07:49 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 08:07:49.054367 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5541c66-5d80-4b29-a217-5c954b1d2f5c admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 08:07:49.064382 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5541c66-5d80-4b29-a217-5c954b1d2f5c admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 08:07:49.068918 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fb1558-c80a-4cdb-b0bb-18de91f40f28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 08:07:49.069504 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fb1558-c80a-4cdb-b0bb-18de91f40f28 admin admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 08:07:49.069813 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fb1558-c80a-4cdb-b0bb-18de91f40f28 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 08:07:49.070084 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fb1558-c80a-4cdb-b0bb-18de91f40f28 admin admin] PATH_INFO: `/v3/roles` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 08:07:49.070710 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7fb1558-c80a-4cdb-b0bb-18de91f40f28 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 08:07:49.072306 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7fb1558-c80a-4cdb-b0bb-18de91f40f28 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 08:07:49.073566 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 08:07:49.085193 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1426/2833] 10.222.0.57 () {58 vars in 1122 bytes} [Fri Sep 16 08:07:49 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 08:07:49.089347 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2263d50c-943e-415e-94c2-1b24a7a60a78 admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 08:07:49.096192 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 08:07:49.100338 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2263d50c-943e-415e-94c2-1b24a7a60a78 admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 08:07:49.107351 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0d3b75-68f8-429d-a002-976875d33810 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 08:07:49.108181 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0d3b75-68f8-429d-a002-976875d33810 admin admin] REQUEST_METHOD: `PUT` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 08:07:49.109107 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0d3b75-68f8-429d-a002-976875d33810 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 08:07:49.109217 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0d3b75-68f8-429d-a002-976875d33810 admin admin] PATH_INFO: `/v3/projects/05b7a86783a54a76944e23ff855adcbe/users/18c36dd246044762a0e24b1c6a964c51/roles/4818d38cf2564825b312e66c9eb24762` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 08:07:49.124138 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0d3b75-68f8-429d-a002-976875d33810 admin admin] RBAC: Authorizing `identity:create_grant(project_id=05b7a86783a54a76944e23ff855adcbe, user_id=18c36dd246044762a0e24b1c6a964c51, role_id=4818d38cf2564825b312e66c9eb24762)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 08:07:49.126773 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0d3b75-68f8-429d-a002-976875d33810 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 08:07:49.140174 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1408/2834] 10.222.0.57 () {60 vars in 1483 bytes} [Fri Sep 16 08:07:49 2022] PUT /identity/v3/projects/05b7a86783a54a76944e23ff855adcbe/users/18c36dd246044762a0e24b1c6a964c51/roles/4818d38cf2564825b312e66c9eb24762 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 08:07:49.149973 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c583d8f6-5066-438d-95a6-933c96486bd6 None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 08:07:49.150259 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c583d8f6-5066-438d-95a6-933c96486bd6 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 08:07:49.150526 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c583d8f6-5066-438d-95a6-933c96486bd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 08:07:49.177913 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-c583d8f6-5066-438d-95a6-933c96486bd6 None None] MFA Rules not processed for user `18c36dd246044762a0e24b1c6a964c51`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 08:07:49.179170 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-c583d8f6-5066-438d-95a6-933c96486bd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 08:07:49.242161 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1427/2835] 10.222.0.57 () {58 vars in 958 bytes} [Fri Sep 16 08:07:49 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 08:07:49.246608 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0d3b75-68f8-429d-a002-976875d33810 admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 08:07:49.307804 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0d3b75-68f8-429d-a002-976875d33810 admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 08:07:49.312520 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6eb04ed-bdf3-4a22-84d5-657de85a36e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 08:07:49.313113 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6eb04ed-bdf3-4a22-84d5-657de85a36e3 admin admin] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 08:07:49.313393 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6eb04ed-bdf3-4a22-84d5-657de85a36e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 08:07:49.313667 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6eb04ed-bdf3-4a22-84d5-657de85a36e3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 08:07:49.314352 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6eb04ed-bdf3-4a22-84d5-657de85a36e3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 08:07:49.316231 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6eb04ed-bdf3-4a22-84d5-657de85a36e3 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 08:07:49.343100 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1409/2836] 10.222.0.57 () {60 vars in 1153 bytes} [Fri Sep 16 08:07:49 2022] POST /identity/v3/projects => generated 369 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 08:07:49.347424 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c583d8f6-5066-438d-95a6-933c96486bd6 None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 08:07:49.359263 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c583d8f6-5066-438d-95a6-933c96486bd6 None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 08:07:49.416477 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b901f6bc-d8e3-4c79-9d0a-0e940a0479dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 08:07:49.417080 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b901f6bc-d8e3-4c79-9d0a-0e940a0479dd admin admin] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 08:07:49.417361 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b901f6bc-d8e3-4c79-9d0a-0e940a0479dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 08:07:49.417637 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b901f6bc-d8e3-4c79-9d0a-0e940a0479dd admin admin] PATH_INFO: `/v3/users` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 08:07:49.418287 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b901f6bc-d8e3-4c79-9d0a-0e940a0479dd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 08:07:49.420604 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b901f6bc-d8e3-4c79-9d0a-0e940a0479dd admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 08:07:49.441593 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1428/2837] 10.222.0.57 () {60 vars in 1144 bytes} [Fri Sep 16 08:07:49 2022] POST /identity/v3/users => generated 291 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 08:07:49.445565 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6eb04ed-bdf3-4a22-84d5-657de85a36e3 admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 08:07:49.456178 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6eb04ed-bdf3-4a22-84d5-657de85a36e3 admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 08:07:49.460840 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9f747d-2dbe-4d32-bd9f-2779ed07e467 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 08:07:49.461425 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9f747d-2dbe-4d32-bd9f-2779ed07e467 admin admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 08:07:49.461704 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9f747d-2dbe-4d32-bd9f-2779ed07e467 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 08:07:49.462003 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9f747d-2dbe-4d32-bd9f-2779ed07e467 admin admin] PATH_INFO: `/v3/roles` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 08:07:49.462636 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9f747d-2dbe-4d32-bd9f-2779ed07e467 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 08:07:49.464228 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9f747d-2dbe-4d32-bd9f-2779ed07e467 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 08:07:49.475199 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1410/2838] 10.222.0.57 () {58 vars in 1122 bytes} [Fri Sep 16 08:07:49 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 08:07:49.479039 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b901f6bc-d8e3-4c79-9d0a-0e940a0479dd admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 08:07:49.489063 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b901f6bc-d8e3-4c79-9d0a-0e940a0479dd admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 08:07:49.493557 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b2408f-ee4a-4618-8b91-062a052d7fc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 08:07:49.494294 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b2408f-ee4a-4618-8b91-062a052d7fc0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 08:07:49.494576 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b2408f-ee4a-4618-8b91-062a052d7fc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 08:07:49.494846 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b2408f-ee4a-4618-8b91-062a052d7fc0 admin admin] PATH_INFO: `/v3/projects/afad666c8db943f29dd37f664a452438/users/1e1536c9dd874bacadd6f03f63134ada/roles/567db03c91854ad9af1e9a87ec1bd275` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 08:07:49.509676 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b2408f-ee4a-4618-8b91-062a052d7fc0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=afad666c8db943f29dd37f664a452438, user_id=1e1536c9dd874bacadd6f03f63134ada, role_id=567db03c91854ad9af1e9a87ec1bd275)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 08:07:49.512343 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b2408f-ee4a-4618-8b91-062a052d7fc0 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 08:07:49.526319 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1429/2839] 10.222.0.57 () {60 vars in 1483 bytes} [Fri Sep 16 08:07:49 2022] PUT /identity/v3/projects/afad666c8db943f29dd37f664a452438/users/1e1536c9dd874bacadd6f03f63134ada/roles/567db03c91854ad9af1e9a87ec1bd275 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 08:07:49.530318 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9f747d-2dbe-4d32-bd9f-2779ed07e467 admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 08:07:49.540156 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9f747d-2dbe-4d32-bd9f-2779ed07e467 admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 08:07:49.597503 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118801c3-abe7-4851-83b6-036ff326f105 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 08:07:49.598059 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118801c3-abe7-4851-83b6-036ff326f105 admin admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 08:07:49.598338 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118801c3-abe7-4851-83b6-036ff326f105 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 08:07:49.598646 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118801c3-abe7-4851-83b6-036ff326f105 admin admin] PATH_INFO: `/v3/roles` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 08:07:49.599276 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118801c3-abe7-4851-83b6-036ff326f105 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 08:07:49.600861 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118801c3-abe7-4851-83b6-036ff326f105 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 08:07:49.610402 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1411/2840] 10.222.0.57 () {58 vars in 1122 bytes} [Fri Sep 16 08:07:49 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 08:07:49.614714 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b2408f-ee4a-4618-8b91-062a052d7fc0 admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 08:07:49.625408 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b2408f-ee4a-4618-8b91-062a052d7fc0 admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 08:07:49.630393 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d76464-4ef0-4fb8-9ec4-0c4fc9dd0735 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 08:07:49.631069 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d76464-4ef0-4fb8-9ec4-0c4fc9dd0735 admin admin] REQUEST_METHOD: `PUT` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 08:07:49.631351 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d76464-4ef0-4fb8-9ec4-0c4fc9dd0735 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 08:07:49.631626 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d76464-4ef0-4fb8-9ec4-0c4fc9dd0735 admin admin] PATH_INFO: `/v3/projects/afad666c8db943f29dd37f664a452438/users/1e1536c9dd874bacadd6f03f63134ada/roles/567db03c91854ad9af1e9a87ec1bd275` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 08:07:49.633587 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d76464-4ef0-4fb8-9ec4-0c4fc9dd0735 admin admin] RBAC: Authorizing `identity:create_grant(project_id=afad666c8db943f29dd37f664a452438, user_id=1e1536c9dd874bacadd6f03f63134ada, role_id=567db03c91854ad9af1e9a87ec1bd275)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 08:07:49.636290 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d76464-4ef0-4fb8-9ec4-0c4fc9dd0735 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 08:07:49.647761 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1430/2841] 10.222.0.57 () {60 vars in 1483 bytes} [Fri Sep 16 08:07:49 2022] PUT /identity/v3/projects/afad666c8db943f29dd37f664a452438/users/1e1536c9dd874bacadd6f03f63134ada/roles/567db03c91854ad9af1e9a87ec1bd275 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 16 08:07:49.661624 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec510051-430e-461c-91cb-1d97c1ab4ad8 None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 08:07:49.661950 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec510051-430e-461c-91cb-1d97c1ab4ad8 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 08:07:49.662228 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec510051-430e-461c-91cb-1d97c1ab4ad8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 08:07:49.689869 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-ec510051-430e-461c-91cb-1d97c1ab4ad8 None None] MFA Rules not processed for user `1e1536c9dd874bacadd6f03f63134ada`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 08:07:49.691072 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-ec510051-430e-461c-91cb-1d97c1ab4ad8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 08:07:49.729950 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 08:07:49.758942 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1412/2842] 10.222.0.57 () {58 vars in 958 bytes} [Fri Sep 16 08:07:49 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 08:07:49.770278 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d76464-4ef0-4fb8-9ec4-0c4fc9dd0735 admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 08:07:49.771966 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-d2d76464-4ef0-4fb8-9ec4-0c4fc9dd0735 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 08:07:49.813871 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 08:07:49.830698 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d76464-4ef0-4fb8-9ec4-0c4fc9dd0735 admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 08:07:49.834869 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd626c6-42a9-4f3a-aa67-8129ef891301 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544bf6be4c24454a013ca110c43cef2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4735f453c0c24cc4a1c14e9ac84a0b46', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 08:07:49.835463 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd626c6-42a9-4f3a-aa67-8129ef891301 service cinder] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 08:07:49.835745 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd626c6-42a9-4f3a-aa67-8129ef891301 service cinder] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 08:07:49.836020 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd626c6-42a9-4f3a-aa67-8129ef891301 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 08:07:49.844949 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd626c6-42a9-4f3a-aa67-8129ef891301 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 08:07:49.846409 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd626c6-42a9-4f3a-aa67-8129ef891301 service cinder] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 08:07:49.855933 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1431/2843] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Sep 16 08:07:49 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 08:07:51.174117 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec510051-430e-461c-91cb-1d97c1ab4ad8 None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 08:07:51.235416 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec510051-430e-461c-91cb-1d97c1ab4ad8 None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 08:07:51.240110 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0cd278-a100-4f6f-9fe2-288820d0d58f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 08:07:51.240733 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0cd278-a100-4f6f-9fe2-288820d0d58f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 08:07:51.241012 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0cd278-a100-4f6f-9fe2-288820d0d58f admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 08:07:51.241292 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0cd278-a100-4f6f-9fe2-288820d0d58f admin admin] PATH_INFO: `/v3/users/18c36dd246044762a0e24b1c6a964c51` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 08:07:51.242423 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0cd278-a100-4f6f-9fe2-288820d0d58f admin admin] RBAC: Authorizing `identity:delete_user(user_id=18c36dd246044762a0e24b1c6a964c51)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 08:07:51.244321 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0cd278-a100-4f6f-9fe2-288820d0d58f admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 08:07:51.289307 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-6a0cd278-a100-4f6f-9fe2-288820d0d58f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '18c36dd246044762a0e24b1c6a964c51'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 08:07:51.289973 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-6a0cd278-a100-4f6f-9fe2-288820d0d58f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '18c36dd246044762a0e24b1c6a964c51'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 08:07:51.297346 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-6a0cd278-a100-4f6f-9fe2-288820d0d58f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '18c36dd246044762a0e24b1c6a964c51'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 08:07:51.309174 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-6a0cd278-a100-4f6f-9fe2-288820d0d58f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '18c36dd246044762a0e24b1c6a964c51'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 08:07:51.316569 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-6a0cd278-a100-4f6f-9fe2-288820d0d58f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '18c36dd246044762a0e24b1c6a964c51'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 08:07:51.322351 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1413/2844] 10.222.0.57 () {58 vars in 1224 bytes} [Fri Sep 16 08:07:51 2022] DELETE /identity/v3/users/18c36dd246044762a0e24b1c6a964c51 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 08:07:51.330965 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471181be-8c15-491e-9b96-a0fc41272ff7 None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 08:07:51.331464 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471181be-8c15-491e-9b96-a0fc41272ff7 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 08:07:51.331573 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471181be-8c15-491e-9b96-a0fc41272ff7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 08:07:51.351264 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-471181be-8c15-491e-9b96-a0fc41272ff7 None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 08:07:51.352473 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-471181be-8c15-491e-9b96-a0fc41272ff7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 08:07:51.413801 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1432/2845] 10.222.0.57 () {58 vars in 958 bytes} [Fri Sep 16 08:07:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 16 08:07:51.423912 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0cd278-a100-4f6f-9fe2-288820d0d58f admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 08:07:51.425314 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-6a0cd278-a100-4f6f-9fe2-288820d0d58f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 08:07:51.481614 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0cd278-a100-4f6f-9fe2-288820d0d58f admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 08:07:51.485526 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e84a598-e3ad-4c77-a288-6b64d1ce0cb0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1062e457207a41e4ba4f0a0c4bf36f1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4735f453c0c24cc4a1c14e9ac84a0b46', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 08:07:51.486419 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e84a598-e3ad-4c77-a288-6b64d1ce0cb0 service neutron] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 08:07:51.486696 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e84a598-e3ad-4c77-a288-6b64d1ce0cb0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 08:07:51.486966 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e84a598-e3ad-4c77-a288-6b64d1ce0cb0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 08:07:51.495952 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e84a598-e3ad-4c77-a288-6b64d1ce0cb0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 08:07:51.498316 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e84a598-e3ad-4c77-a288-6b64d1ce0cb0 service neutron] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 08:07:51.502183 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 08:07:51.509550 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1414/2846] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Sep 16 08:07:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 08:07:51.785275 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471181be-8c15-491e-9b96-a0fc41272ff7 None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 08:07:51.786692 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-471181be-8c15-491e-9b96-a0fc41272ff7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 08:07:51.799167 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471181be-8c15-491e-9b96-a0fc41272ff7 None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 08:07:51.803721 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c3d0e4-f80d-4254-a6a3-de04778bc370 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 08:07:51.804367 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c3d0e4-f80d-4254-a6a3-de04778bc370 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 08:07:51.804641 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c3d0e4-f80d-4254-a6a3-de04778bc370 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 08:07:51.804895 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c3d0e4-f80d-4254-a6a3-de04778bc370 admin admin] PATH_INFO: `/v3/projects/05b7a86783a54a76944e23ff855adcbe` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 08:07:51.806046 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c3d0e4-f80d-4254-a6a3-de04778bc370 admin admin] RBAC: Authorizing `identity:delete_project(project_id=05b7a86783a54a76944e23ff855adcbe)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 08:07:51.807945 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c3d0e4-f80d-4254-a6a3-de04778bc370 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 08:07:51.856933 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-b9c3d0e4-f80d-4254-a6a3-de04778bc370 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '05b7a86783a54a76944e23ff855adcbe', 'request_id': 'req-b9c3d0e4-f80d-4254-a6a3-de04778bc370'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 08:07:51.863639 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-b9c3d0e4-f80d-4254-a6a3-de04778bc370 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '05b7a86783a54a76944e23ff855adcbe', 'request_id': 'req-b9c3d0e4-f80d-4254-a6a3-de04778bc370'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 08:07:51.871083 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-b9c3d0e4-f80d-4254-a6a3-de04778bc370 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '05b7a86783a54a76944e23ff855adcbe', 'request_id': 'req-b9c3d0e4-f80d-4254-a6a3-de04778bc370'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 08:07:51.881642 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-b9c3d0e4-f80d-4254-a6a3-de04778bc370 admin admin] The token cache is being invalidate because project 05b7a86783a54a76944e23ff855adcbe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81431) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 08:07:51.881974 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-b9c3d0e4-f80d-4254-a6a3-de04778bc370 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 08:07:51.882598 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-b9c3d0e4-f80d-4254-a6a3-de04778bc370 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 08:07:51.884304 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1433/2847] 10.222.0.57 () {58 vars in 1233 bytes} [Fri Sep 16 08:07:51 2022] DELETE /identity/v3/projects/05b7a86783a54a76944e23ff855adcbe => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 08:07:51.888087 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e84a598-e3ad-4c77-a288-6b64d1ce0cb0 service neutron] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 08:07:51.899576 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e84a598-e3ad-4c77-a288-6b64d1ce0cb0 service neutron] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 08:07:51.956204 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1692ed6c-68e4-4a4a-9884-94d4ff3dd65e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 08:07:51.956912 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1692ed6c-68e4-4a4a-9884-94d4ff3dd65e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 08:07:51.957132 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1692ed6c-68e4-4a4a-9884-94d4ff3dd65e admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 08:07:51.957402 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1692ed6c-68e4-4a4a-9884-94d4ff3dd65e admin admin] PATH_INFO: `/v3/users/1e1536c9dd874bacadd6f03f63134ada` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 08:07:51.958538 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1692ed6c-68e4-4a4a-9884-94d4ff3dd65e admin admin] RBAC: Authorizing `identity:delete_user(user_id=1e1536c9dd874bacadd6f03f63134ada)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 08:07:51.960425 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1692ed6c-68e4-4a4a-9884-94d4ff3dd65e admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 08:07:52.006613 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-1692ed6c-68e4-4a4a-9884-94d4ff3dd65e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1e1536c9dd874bacadd6f03f63134ada'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 08:07:52.007280 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-1692ed6c-68e4-4a4a-9884-94d4ff3dd65e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1e1536c9dd874bacadd6f03f63134ada'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 08:07:52.015849 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-1692ed6c-68e4-4a4a-9884-94d4ff3dd65e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1e1536c9dd874bacadd6f03f63134ada'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 08:07:52.031200 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-1692ed6c-68e4-4a4a-9884-94d4ff3dd65e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1e1536c9dd874bacadd6f03f63134ada'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 08:07:52.038050 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-1692ed6c-68e4-4a4a-9884-94d4ff3dd65e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1e1536c9dd874bacadd6f03f63134ada'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 08:07:52.044704 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1415/2848] 10.222.0.57 () {58 vars in 1224 bytes} [Fri Sep 16 08:07:51 2022] DELETE /identity/v3/users/1e1536c9dd874bacadd6f03f63134ada => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 08:07:52.321189 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c3d0e4-f80d-4254-a6a3-de04778bc370 admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 08:07:52.322963 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-b9c3d0e4-f80d-4254-a6a3-de04778bc370 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 08:07:52.338771 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c3d0e4-f80d-4254-a6a3-de04778bc370 admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 08:07:52.399405 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c32fac-1f3f-4ffe-b719-4304747bc365 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 08:07:52.400052 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c32fac-1f3f-4ffe-b719-4304747bc365 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 08:07:52.400331 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c32fac-1f3f-4ffe-b719-4304747bc365 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 08:07:52.400602 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c32fac-1f3f-4ffe-b719-4304747bc365 admin admin] PATH_INFO: `/v3/projects/afad666c8db943f29dd37f664a452438` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 08:07:52.401696 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c32fac-1f3f-4ffe-b719-4304747bc365 admin admin] RBAC: Authorizing `identity:delete_project(project_id=afad666c8db943f29dd37f664a452438)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 08:07:52.404375 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c32fac-1f3f-4ffe-b719-4304747bc365 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 08:07:52.410475 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 08:07:52.449511 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-25c32fac-1f3f-4ffe-b719-4304747bc365 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'afad666c8db943f29dd37f664a452438', 'request_id': 'req-25c32fac-1f3f-4ffe-b719-4304747bc365'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 08:07:52.456270 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-25c32fac-1f3f-4ffe-b719-4304747bc365 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'afad666c8db943f29dd37f664a452438', 'request_id': 'req-25c32fac-1f3f-4ffe-b719-4304747bc365'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 08:07:52.464053 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-25c32fac-1f3f-4ffe-b719-4304747bc365 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'afad666c8db943f29dd37f664a452438', 'request_id': 'req-25c32fac-1f3f-4ffe-b719-4304747bc365'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 08:07:52.474859 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-25c32fac-1f3f-4ffe-b719-4304747bc365 admin admin] The token cache is being invalidate because project afad666c8db943f29dd37f664a452438 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81431) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 08:07:52.475141 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-25c32fac-1f3f-4ffe-b719-4304747bc365 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 08:07:52.475758 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-25c32fac-1f3f-4ffe-b719-4304747bc365 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 08:07:52.477202 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1434/2849] 10.222.0.57 () {58 vars in 1233 bytes} [Fri Sep 16 08:07:52 2022] DELETE /identity/v3/projects/afad666c8db943f29dd37f664a452438 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 08:07:52.482237 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94117c5b-f950-4dc7-9878-f63902dec29b None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 08:07:52.482708 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94117c5b-f950-4dc7-9878-f63902dec29b None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 08:07:52.482809 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94117c5b-f950-4dc7-9878-f63902dec29b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 08:07:52.503822 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-94117c5b-f950-4dc7-9878-f63902dec29b None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 08:07:52.504949 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-94117c5b-f950-4dc7-9878-f63902dec29b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 08:07:52.561816 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1416/2850] 10.222.0.57 () {58 vars in 958 bytes} [Fri Sep 16 08:07:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 08:07:52.569615 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458be843-ad72-4812-8191-b203eb65d232 None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 08:07:52.569934 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458be843-ad72-4812-8191-b203eb65d232 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 08:07:52.570207 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458be843-ad72-4812-8191-b203eb65d232 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 08:07:52.590897 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-458be843-ad72-4812-8191-b203eb65d232 None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 08:07:52.592081 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-458be843-ad72-4812-8191-b203eb65d232 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 08:07:52.599795 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1435/2851] 10.222.0.57 () {58 vars in 958 bytes} [Fri Sep 16 08:07:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 16 08:07:52.604060 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94117c5b-f950-4dc7-9878-f63902dec29b None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 08:07:52.613919 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94117c5b-f950-4dc7-9878-f63902dec29b None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 08:07:52.618507 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05264176-754e-404b-86c3-61a5be8d5d7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 08:07:52.619100 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05264176-754e-404b-86c3-61a5be8d5d7d admin admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 08:07:52.619380 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05264176-754e-404b-86c3-61a5be8d5d7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 08:07:52.619653 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05264176-754e-404b-86c3-61a5be8d5d7d admin admin] PATH_INFO: `/v3/domains` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 08:07:52.620290 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05264176-754e-404b-86c3-61a5be8d5d7d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 08:07:52.620588 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05264176-754e-404b-86c3-61a5be8d5d7d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 08:07:52.622879 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05264176-754e-404b-86c3-61a5be8d5d7d admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 08:07:52.634076 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1417/2852] 10.222.0.57 () {58 vars in 1153 bytes} [Fri Sep 16 08:07:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 08:07:52.638694 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458be843-ad72-4812-8191-b203eb65d232 None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 08:07:52.647654 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458be843-ad72-4812-8191-b203eb65d232 None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 08:07:52.652194 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67abc0a-3c22-4a8a-95c0-9d6dd05dbf95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 08:07:52.652770 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67abc0a-3c22-4a8a-95c0-9d6dd05dbf95 admin admin] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 08:07:52.653131 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67abc0a-3c22-4a8a-95c0-9d6dd05dbf95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 08:07:52.653428 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67abc0a-3c22-4a8a-95c0-9d6dd05dbf95 admin admin] PATH_INFO: `/v3/projects` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 08:07:52.654074 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67abc0a-3c22-4a8a-95c0-9d6dd05dbf95 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 08:07:52.655980 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67abc0a-3c22-4a8a-95c0-9d6dd05dbf95 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 08:07:52.681869 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1436/2853] 10.222.0.57 () {60 vars in 1153 bytes} [Fri Sep 16 08:07:52 2022] POST /identity/v3/projects => generated 387 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 16 08:07:52.686604 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05264176-754e-404b-86c3-61a5be8d5d7d admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 08:07:52.692983 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 08:07:52.696734 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05264176-754e-404b-86c3-61a5be8d5d7d admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 08:07:52.753803 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7fc937-4ce8-40f1-853c-9cd31ad78375 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 08:07:52.754452 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7fc937-4ce8-40f1-853c-9cd31ad78375 admin admin] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 08:07:52.754677 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7fc937-4ce8-40f1-853c-9cd31ad78375 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 08:07:52.754943 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7fc937-4ce8-40f1-853c-9cd31ad78375 admin admin] PATH_INFO: `/v3/users` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 08:07:52.755574 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7fc937-4ce8-40f1-853c-9cd31ad78375 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 08:07:52.757451 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7fc937-4ce8-40f1-853c-9cd31ad78375 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 08:07:52.778830 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1418/2854] 10.222.0.57 () {60 vars in 1144 bytes} [Fri Sep 16 08:07:52 2022] POST /identity/v3/users => generated 294 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 16 08:07:52.782905 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67abc0a-3c22-4a8a-95c0-9d6dd05dbf95 admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 08:07:52.793248 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67abc0a-3c22-4a8a-95c0-9d6dd05dbf95 admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 08:07:52.797760 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da364114-69f1-43bc-ae63-642d1b11016e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 08:07:52.798350 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da364114-69f1-43bc-ae63-642d1b11016e admin admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 08:07:52.798625 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da364114-69f1-43bc-ae63-642d1b11016e admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 08:07:52.798894 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da364114-69f1-43bc-ae63-642d1b11016e admin admin] PATH_INFO: `/v3/roles` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 08:07:52.799520 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da364114-69f1-43bc-ae63-642d1b11016e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 08:07:52.801090 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da364114-69f1-43bc-ae63-642d1b11016e admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 08:07:52.811883 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1437/2855] 10.222.0.57 () {58 vars in 1122 bytes} [Fri Sep 16 08:07:52 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 08:07:52.815738 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7fc937-4ce8-40f1-853c-9cd31ad78375 admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 08:07:52.825704 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7fc937-4ce8-40f1-853c-9cd31ad78375 admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 08:07:52.830286 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830a250f-8c03-4eef-9dba-94ceb82f65e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 08:07:52.830870 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830a250f-8c03-4eef-9dba-94ceb82f65e8 admin admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 08:07:52.831151 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830a250f-8c03-4eef-9dba-94ceb82f65e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 08:07:52.831425 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830a250f-8c03-4eef-9dba-94ceb82f65e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 08:07:52.832062 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830a250f-8c03-4eef-9dba-94ceb82f65e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 08:07:52.833632 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830a250f-8c03-4eef-9dba-94ceb82f65e8 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 08:07:52.844438 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1419/2856] 10.222.0.57 () {58 vars in 1122 bytes} [Fri Sep 16 08:07:52 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 08:07:52.848417 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da364114-69f1-43bc-ae63-642d1b11016e admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 08:07:52.858791 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da364114-69f1-43bc-ae63-642d1b11016e admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 08:07:52.863654 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a09365-3df9-41a8-abc1-e0bbbf99ec10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 08:07:52.864284 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a09365-3df9-41a8-abc1-e0bbbf99ec10 admin admin] REQUEST_METHOD: `PUT` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 08:07:52.864559 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a09365-3df9-41a8-abc1-e0bbbf99ec10 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 08:07:52.864827 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a09365-3df9-41a8-abc1-e0bbbf99ec10 admin admin] PATH_INFO: `/v3/projects/4baca5db87604a3cb472e5e0476d6b16/users/f8b98c2580694536a417c1e65c15a8e6/roles/4818d38cf2564825b312e66c9eb24762` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 08:07:52.878785 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a09365-3df9-41a8-abc1-e0bbbf99ec10 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4baca5db87604a3cb472e5e0476d6b16, user_id=f8b98c2580694536a417c1e65c15a8e6, role_id=4818d38cf2564825b312e66c9eb24762)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 08:07:52.881410 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a09365-3df9-41a8-abc1-e0bbbf99ec10 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 08:07:52.894559 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1438/2857] 10.222.0.57 () {60 vars in 1483 bytes} [Fri Sep 16 08:07:52 2022] PUT /identity/v3/projects/4baca5db87604a3cb472e5e0476d6b16/users/f8b98c2580694536a417c1e65c15a8e6/roles/4818d38cf2564825b312e66c9eb24762 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 16 08:07:52.907345 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bed1a9-851e-4d6a-8dcc-082c2841e9fd None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 08:07:52.907631 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bed1a9-851e-4d6a-8dcc-082c2841e9fd None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 08:07:52.907901 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bed1a9-851e-4d6a-8dcc-082c2841e9fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 08:07:52.934664 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-73bed1a9-851e-4d6a-8dcc-082c2841e9fd None None] MFA Rules not processed for user `f8b98c2580694536a417c1e65c15a8e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 08:07:52.936025 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-73bed1a9-851e-4d6a-8dcc-082c2841e9fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 08:07:52.998957 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1420/2858] 10.222.0.57 () {58 vars in 958 bytes} [Fri Sep 16 08:07:52 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 08:07:53.003409 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a09365-3df9-41a8-abc1-e0bbbf99ec10 admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 08:07:53.063727 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a09365-3df9-41a8-abc1-e0bbbf99ec10 admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 08:07:53.068343 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9433fe1-b931-4939-82b7-81280cc78d36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 08:07:53.068933 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9433fe1-b931-4939-82b7-81280cc78d36 admin admin] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 08:07:53.069212 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9433fe1-b931-4939-82b7-81280cc78d36 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 08:07:53.069481 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9433fe1-b931-4939-82b7-81280cc78d36 admin admin] PATH_INFO: `/v3/projects` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 08:07:53.070153 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9433fe1-b931-4939-82b7-81280cc78d36 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 08:07:53.072036 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9433fe1-b931-4939-82b7-81280cc78d36 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 08:07:53.099242 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1439/2859] 10.222.0.57 () {60 vars in 1153 bytes} [Fri Sep 16 08:07:53 2022] POST /identity/v3/projects => generated 387 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 08:07:53.103348 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bed1a9-851e-4d6a-8dcc-082c2841e9fd None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 08:07:53.114208 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bed1a9-851e-4d6a-8dcc-082c2841e9fd None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 08:07:53.168803 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b408b7e-1b6f-43bc-a682-961c3e8d007d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 08:07:53.169406 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b408b7e-1b6f-43bc-a682-961c3e8d007d admin admin] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 08:07:53.169686 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b408b7e-1b6f-43bc-a682-961c3e8d007d admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 08:07:53.169985 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b408b7e-1b6f-43bc-a682-961c3e8d007d admin admin] PATH_INFO: `/v3/users` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 08:07:53.170604 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b408b7e-1b6f-43bc-a682-961c3e8d007d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 08:07:53.172518 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b408b7e-1b6f-43bc-a682-961c3e8d007d admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 08:07:53.193009 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1421/2860] 10.222.0.57 () {60 vars in 1144 bytes} [Fri Sep 16 08:07:53 2022] POST /identity/v3/users => generated 300 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 08:07:53.197023 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9433fe1-b931-4939-82b7-81280cc78d36 admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 08:07:53.208012 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9433fe1-b931-4939-82b7-81280cc78d36 admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 08:07:53.212571 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27367680-1c1e-4187-852e-3c9484466622 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 08:07:53.213162 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27367680-1c1e-4187-852e-3c9484466622 admin admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 08:07:53.213438 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27367680-1c1e-4187-852e-3c9484466622 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 08:07:53.213707 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27367680-1c1e-4187-852e-3c9484466622 admin admin] PATH_INFO: `/v3/roles` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 08:07:53.214357 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27367680-1c1e-4187-852e-3c9484466622 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 08:07:53.216794 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27367680-1c1e-4187-852e-3c9484466622 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 08:07:53.227099 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1440/2861] 10.222.0.57 () {58 vars in 1122 bytes} [Fri Sep 16 08:07:53 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 08:07:53.231494 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b408b7e-1b6f-43bc-a682-961c3e8d007d admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 08:07:53.236966 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 08:07:53.243362 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b408b7e-1b6f-43bc-a682-961c3e8d007d admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 08:07:53.248880 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8525b2b-aa5b-4aeb-9e1a-f8e4ed2799a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 08:07:53.249533 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8525b2b-aa5b-4aeb-9e1a-f8e4ed2799a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 08:07:53.249837 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8525b2b-aa5b-4aeb-9e1a-f8e4ed2799a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 08:07:53.250110 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8525b2b-aa5b-4aeb-9e1a-f8e4ed2799a7 admin admin] PATH_INFO: `/v3/projects/20252471ca41406ba4687deb08ed13b0/users/bcfe187d840b485e8464d8c7c3b185ec/roles/567db03c91854ad9af1e9a87ec1bd275` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 08:07:53.265092 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8525b2b-aa5b-4aeb-9e1a-f8e4ed2799a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=20252471ca41406ba4687deb08ed13b0, user_id=bcfe187d840b485e8464d8c7c3b185ec, role_id=567db03c91854ad9af1e9a87ec1bd275)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 08:07:53.267696 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8525b2b-aa5b-4aeb-9e1a-f8e4ed2799a7 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 08:07:53.279989 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1422/2862] 10.222.0.57 () {60 vars in 1483 bytes} [Fri Sep 16 08:07:53 2022] PUT /identity/v3/projects/20252471ca41406ba4687deb08ed13b0/users/bcfe187d840b485e8464d8c7c3b185ec/roles/567db03c91854ad9af1e9a87ec1bd275 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 16 08:07:53.283982 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27367680-1c1e-4187-852e-3c9484466622 admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 08:07:53.291113 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 08:07:53.297393 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27367680-1c1e-4187-852e-3c9484466622 admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 08:07:53.357104 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1a8373-4f40-4d22-a0d4-4f7f695be411 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 08:07:53.357812 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1a8373-4f40-4d22-a0d4-4f7f695be411 admin admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 08:07:53.357988 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1a8373-4f40-4d22-a0d4-4f7f695be411 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 08:07:53.358253 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1a8373-4f40-4d22-a0d4-4f7f695be411 admin admin] PATH_INFO: `/v3/roles` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 08:07:53.358870 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1a8373-4f40-4d22-a0d4-4f7f695be411 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 08:07:53.360583 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1a8373-4f40-4d22-a0d4-4f7f695be411 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 08:07:53.370402 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1441/2863] 10.222.0.57 () {58 vars in 1122 bytes} [Fri Sep 16 08:07:53 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 08:07:53.374640 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8525b2b-aa5b-4aeb-9e1a-f8e4ed2799a7 admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 08:07:53.384587 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8525b2b-aa5b-4aeb-9e1a-f8e4ed2799a7 admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 08:07:53.389240 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491cb97d-722f-4b54-8d69-ffca8d42069b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 08:07:53.389920 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491cb97d-722f-4b54-8d69-ffca8d42069b admin admin] REQUEST_METHOD: `PUT` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 08:07:53.390198 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491cb97d-722f-4b54-8d69-ffca8d42069b admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 08:07:53.390470 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491cb97d-722f-4b54-8d69-ffca8d42069b admin admin] PATH_INFO: `/v3/projects/20252471ca41406ba4687deb08ed13b0/users/bcfe187d840b485e8464d8c7c3b185ec/roles/567db03c91854ad9af1e9a87ec1bd275` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 08:07:53.392367 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491cb97d-722f-4b54-8d69-ffca8d42069b admin admin] RBAC: Authorizing `identity:create_grant(project_id=20252471ca41406ba4687deb08ed13b0, user_id=bcfe187d840b485e8464d8c7c3b185ec, role_id=567db03c91854ad9af1e9a87ec1bd275)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 08:07:53.394991 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491cb97d-722f-4b54-8d69-ffca8d42069b admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 08:07:53.405685 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1423/2864] 10.222.0.57 () {60 vars in 1483 bytes} [Fri Sep 16 08:07:53 2022] PUT /identity/v3/projects/20252471ca41406ba4687deb08ed13b0/users/bcfe187d840b485e8464d8c7c3b185ec/roles/567db03c91854ad9af1e9a87ec1bd275 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 08:07:53.415869 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f62bf6-6547-43e5-8e6d-7b2374b352cd None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 08:07:53.416156 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f62bf6-6547-43e5-8e6d-7b2374b352cd None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 08:07:53.416434 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f62bf6-6547-43e5-8e6d-7b2374b352cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 08:07:53.444938 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-22f62bf6-6547-43e5-8e6d-7b2374b352cd None None] MFA Rules not processed for user `bcfe187d840b485e8464d8c7c3b185ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 08:07:53.446181 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-22f62bf6-6547-43e5-8e6d-7b2374b352cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 08:07:53.513982 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1442/2865] 10.222.0.57 () {58 vars in 958 bytes} [Fri Sep 16 08:07:53 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 16 08:07:53.524407 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491cb97d-722f-4b54-8d69-ffca8d42069b admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 08:07:53.526144 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-491cb97d-722f-4b54-8d69-ffca8d42069b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 08:07:53.582355 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491cb97d-722f-4b54-8d69-ffca8d42069b admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 08:07:53.585968 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fee6f36-e009-46c0-a041-0eb68c604816 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544bf6be4c24454a013ca110c43cef2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4735f453c0c24cc4a1c14e9ac84a0b46', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 08:07:53.586557 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fee6f36-e009-46c0-a041-0eb68c604816 service cinder] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 08:07:53.586833 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fee6f36-e009-46c0-a041-0eb68c604816 service cinder] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 08:07:53.587101 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fee6f36-e009-46c0-a041-0eb68c604816 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 08:07:53.595905 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fee6f36-e009-46c0-a041-0eb68c604816 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 08:07:53.597297 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fee6f36-e009-46c0-a041-0eb68c604816 service cinder] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 08:07:53.606958 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1424/2866] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Sep 16 08:07:53 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 08:07:53.742478 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f62bf6-6547-43e5-8e6d-7b2374b352cd None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 08:07:53.804473 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f62bf6-6547-43e5-8e6d-7b2374b352cd None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 08:07:53.808926 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc03884-f53d-40ab-ba68-655184431593 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 08:07:53.810485 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc03884-f53d-40ab-ba68-655184431593 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 08:07:53.810772 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc03884-f53d-40ab-ba68-655184431593 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 08:07:53.811045 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc03884-f53d-40ab-ba68-655184431593 admin admin] PATH_INFO: `/v3/users/f8b98c2580694536a417c1e65c15a8e6` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 08:07:53.812173 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc03884-f53d-40ab-ba68-655184431593 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f8b98c2580694536a417c1e65c15a8e6)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 08:07:53.814144 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc03884-f53d-40ab-ba68-655184431593 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 08:07:53.843156 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 08:07:53.864365 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-0cc03884-f53d-40ab-ba68-655184431593 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f8b98c2580694536a417c1e65c15a8e6'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 08:07:53.877240 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-0cc03884-f53d-40ab-ba68-655184431593 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f8b98c2580694536a417c1e65c15a8e6'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 08:07:53.877964 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-0cc03884-f53d-40ab-ba68-655184431593 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f8b98c2580694536a417c1e65c15a8e6'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 08:07:53.885304 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-0cc03884-f53d-40ab-ba68-655184431593 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f8b98c2580694536a417c1e65c15a8e6'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 08:07:53.892276 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-0cc03884-f53d-40ab-ba68-655184431593 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f8b98c2580694536a417c1e65c15a8e6'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 08:07:53.898355 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1443/2867] 10.222.0.57 () {58 vars in 1224 bytes} [Fri Sep 16 08:07:53 2022] DELETE /identity/v3/users/f8b98c2580694536a417c1e65c15a8e6 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 08:07:53.902823 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd77491-b28d-4475-ac05-87cc28694c09 None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 08:07:53.903174 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd77491-b28d-4475-ac05-87cc28694c09 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 08:07:53.903549 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd77491-b28d-4475-ac05-87cc28694c09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 08:07:53.922182 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-ccd77491-b28d-4475-ac05-87cc28694c09 None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 08:07:53.923363 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-ccd77491-b28d-4475-ac05-87cc28694c09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 08:07:53.980950 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1425/2868] 10.222.0.57 () {58 vars in 958 bytes} [Fri Sep 16 08:07:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 08:07:53.991347 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc03884-f53d-40ab-ba68-655184431593 admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 08:07:53.992736 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-0cc03884-f53d-40ab-ba68-655184431593 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 08:07:54.050693 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc03884-f53d-40ab-ba68-655184431593 admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 08:07:54.054376 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63abc62f-a4e0-462c-abe2-6cb481e232ba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1062e457207a41e4ba4f0a0c4bf36f1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4735f453c0c24cc4a1c14e9ac84a0b46', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 08:07:54.054982 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63abc62f-a4e0-462c-abe2-6cb481e232ba service neutron] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 08:07:54.055261 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63abc62f-a4e0-462c-abe2-6cb481e232ba service neutron] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 08:07:54.055532 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63abc62f-a4e0-462c-abe2-6cb481e232ba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 08:07:54.064625 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63abc62f-a4e0-462c-abe2-6cb481e232ba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 08:07:54.066081 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63abc62f-a4e0-462c-abe2-6cb481e232ba service neutron] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 08:07:54.075357 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1444/2869] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Sep 16 08:07:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 08:07:54.353126 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd77491-b28d-4475-ac05-87cc28694c09 None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 08:07:54.354623 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-ccd77491-b28d-4475-ac05-87cc28694c09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 08:07:54.371654 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd77491-b28d-4475-ac05-87cc28694c09 None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 08:07:54.379193 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d0b893-4a10-4d21-84dc-d39f6be35a6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 08:07:54.379997 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d0b893-4a10-4d21-84dc-d39f6be35a6b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 08:07:54.380396 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d0b893-4a10-4d21-84dc-d39f6be35a6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 08:07:54.380786 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d0b893-4a10-4d21-84dc-d39f6be35a6b admin admin] PATH_INFO: `/v3/projects/4baca5db87604a3cb472e5e0476d6b16` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 08:07:54.382145 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d0b893-4a10-4d21-84dc-d39f6be35a6b admin admin] RBAC: Authorizing `identity:delete_project(project_id=4baca5db87604a3cb472e5e0476d6b16)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 08:07:54.384053 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d0b893-4a10-4d21-84dc-d39f6be35a6b admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 08:07:54.432252 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-c1d0b893-4a10-4d21-84dc-d39f6be35a6b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4baca5db87604a3cb472e5e0476d6b16', 'request_id': 'req-c1d0b893-4a10-4d21-84dc-d39f6be35a6b'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 08:07:54.439270 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-c1d0b893-4a10-4d21-84dc-d39f6be35a6b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4baca5db87604a3cb472e5e0476d6b16', 'request_id': 'req-c1d0b893-4a10-4d21-84dc-d39f6be35a6b'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 08:07:54.443910 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 08:07:54.445196 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-c1d0b893-4a10-4d21-84dc-d39f6be35a6b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4baca5db87604a3cb472e5e0476d6b16', 'request_id': 'req-c1d0b893-4a10-4d21-84dc-d39f6be35a6b'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 08:07:54.458325 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-c1d0b893-4a10-4d21-84dc-d39f6be35a6b admin admin] The token cache is being invalidate because project 4baca5db87604a3cb472e5e0476d6b16 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81430) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 08:07:54.458614 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-c1d0b893-4a10-4d21-84dc-d39f6be35a6b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 08:07:54.459328 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-c1d0b893-4a10-4d21-84dc-d39f6be35a6b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 08:07:54.460920 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1426/2870] 10.222.0.57 () {58 vars in 1233 bytes} [Fri Sep 16 08:07:54 2022] DELETE /identity/v3/projects/4baca5db87604a3cb472e5e0476d6b16 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 08:07:54.464895 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63abc62f-a4e0-462c-abe2-6cb481e232ba service neutron] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 08:07:54.475202 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63abc62f-a4e0-462c-abe2-6cb481e232ba service neutron] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 08:07:54.531020 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d74f52-7e5f-4fec-9723-35818f67e416 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 08:07:54.531639 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d74f52-7e5f-4fec-9723-35818f67e416 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 08:07:54.531913 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d74f52-7e5f-4fec-9723-35818f67e416 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 08:07:54.532179 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d74f52-7e5f-4fec-9723-35818f67e416 admin admin] PATH_INFO: `/v3/users/bcfe187d840b485e8464d8c7c3b185ec` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 08:07:54.533325 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d74f52-7e5f-4fec-9723-35818f67e416 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bcfe187d840b485e8464d8c7c3b185ec)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 08:07:54.535270 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d74f52-7e5f-4fec-9723-35818f67e416 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 08:07:54.581445 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-69d74f52-7e5f-4fec-9723-35818f67e416 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bcfe187d840b485e8464d8c7c3b185ec'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 08:07:54.583337 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 08:07:54.596591 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-69d74f52-7e5f-4fec-9723-35818f67e416 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bcfe187d840b485e8464d8c7c3b185ec'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 08:07:54.597261 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-69d74f52-7e5f-4fec-9723-35818f67e416 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bcfe187d840b485e8464d8c7c3b185ec'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 08:07:54.604362 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-69d74f52-7e5f-4fec-9723-35818f67e416 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bcfe187d840b485e8464d8c7c3b185ec'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 08:07:54.611858 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-69d74f52-7e5f-4fec-9723-35818f67e416 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bcfe187d840b485e8464d8c7c3b185ec'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 08:07:54.617619 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1445/2871] 10.222.0.57 () {58 vars in 1224 bytes} [Fri Sep 16 08:07:54 2022] DELETE /identity/v3/users/bcfe187d840b485e8464d8c7c3b185ec => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 08:07:54.901379 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d0b893-4a10-4d21-84dc-d39f6be35a6b admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 08:07:54.902897 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-c1d0b893-4a10-4d21-84dc-d39f6be35a6b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 08:07:54.922215 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d0b893-4a10-4d21-84dc-d39f6be35a6b admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 08:07:54.979601 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ec3138-9849-4145-b777-f3d3c9c2df4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 08:07:54.980154 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ec3138-9849-4145-b777-f3d3c9c2df4d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 08:07:54.980457 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ec3138-9849-4145-b777-f3d3c9c2df4d admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 08:07:54.980726 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ec3138-9849-4145-b777-f3d3c9c2df4d admin admin] PATH_INFO: `/v3/projects/20252471ca41406ba4687deb08ed13b0` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 08:07:54.982489 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ec3138-9849-4145-b777-f3d3c9c2df4d admin admin] RBAC: Authorizing `identity:delete_project(project_id=20252471ca41406ba4687deb08ed13b0)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 08:07:54.984368 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ec3138-9849-4145-b777-f3d3c9c2df4d admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 08:07:55.029119 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-14ec3138-9849-4145-b777-f3d3c9c2df4d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '20252471ca41406ba4687deb08ed13b0', 'request_id': 'req-14ec3138-9849-4145-b777-f3d3c9c2df4d'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 08:07:55.035754 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-14ec3138-9849-4145-b777-f3d3c9c2df4d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '20252471ca41406ba4687deb08ed13b0', 'request_id': 'req-14ec3138-9849-4145-b777-f3d3c9c2df4d'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 08:07:55.041283 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-14ec3138-9849-4145-b777-f3d3c9c2df4d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '20252471ca41406ba4687deb08ed13b0', 'request_id': 'req-14ec3138-9849-4145-b777-f3d3c9c2df4d'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 08:07:55.052767 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-14ec3138-9849-4145-b777-f3d3c9c2df4d admin admin] The token cache is being invalidate because project 20252471ca41406ba4687deb08ed13b0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81430) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 08:07:55.052965 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-14ec3138-9849-4145-b777-f3d3c9c2df4d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 08:07:55.053682 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-14ec3138-9849-4145-b777-f3d3c9c2df4d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 08:07:55.055046 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1427/2872] 10.222.0.57 () {58 vars in 1233 bytes} [Fri Sep 16 08:07:54 2022] DELETE /identity/v3/projects/20252471ca41406ba4687deb08ed13b0 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 08:07:55.059969 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0217e44-265a-44fc-ac3d-73f12862f1b9 None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 08:07:55.060277 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0217e44-265a-44fc-ac3d-73f12862f1b9 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 08:07:55.060555 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0217e44-265a-44fc-ac3d-73f12862f1b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 08:07:55.080303 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-e0217e44-265a-44fc-ac3d-73f12862f1b9 None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 08:07:55.081507 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-e0217e44-265a-44fc-ac3d-73f12862f1b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 08:07:55.140617 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1446/2873] 10.222.0.57 () {58 vars in 958 bytes} [Fri Sep 16 08:07:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 08:07:55.148803 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0fcf1a-511a-4362-bc1b-7e5bb17afc78 None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 08:07:55.149091 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0fcf1a-511a-4362-bc1b-7e5bb17afc78 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 08:07:55.149362 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0fcf1a-511a-4362-bc1b-7e5bb17afc78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 08:07:55.169601 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-5f0fcf1a-511a-4362-bc1b-7e5bb17afc78 None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 08:07:55.170822 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-5f0fcf1a-511a-4362-bc1b-7e5bb17afc78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 08:07:55.178718 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1428/2874] 10.222.0.57 () {58 vars in 958 bytes} [Fri Sep 16 08:07:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 08:07:55.182908 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0217e44-265a-44fc-ac3d-73f12862f1b9 None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 08:07:55.193203 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0217e44-265a-44fc-ac3d-73f12862f1b9 None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 08:07:55.197757 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91f9243-8af0-4311-93d6-2f69acff06ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 08:07:55.198368 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91f9243-8af0-4311-93d6-2f69acff06ec admin admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 08:07:55.198643 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91f9243-8af0-4311-93d6-2f69acff06ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 08:07:55.198913 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91f9243-8af0-4311-93d6-2f69acff06ec admin admin] PATH_INFO: `/v3/domains` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 08:07:55.199552 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91f9243-8af0-4311-93d6-2f69acff06ec admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 08:07:55.199905 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91f9243-8af0-4311-93d6-2f69acff06ec admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 08:07:55.201529 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91f9243-8af0-4311-93d6-2f69acff06ec admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 08:07:55.212796 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1447/2875] 10.222.0.57 () {58 vars in 1153 bytes} [Fri Sep 16 08:07:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 08:07:55.217020 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0fcf1a-511a-4362-bc1b-7e5bb17afc78 None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 08:07:55.226372 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0fcf1a-511a-4362-bc1b-7e5bb17afc78 None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 08:07:55.231582 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6485b74-1d1f-4850-abe4-f1b0a618e6c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 08:07:55.232228 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6485b74-1d1f-4850-abe4-f1b0a618e6c6 admin admin] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 08:07:55.232695 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6485b74-1d1f-4850-abe4-f1b0a618e6c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 08:07:55.232973 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6485b74-1d1f-4850-abe4-f1b0a618e6c6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 08:07:55.233623 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6485b74-1d1f-4850-abe4-f1b0a618e6c6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 08:07:55.235564 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6485b74-1d1f-4850-abe4-f1b0a618e6c6 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 08:07:55.262559 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1429/2876] 10.222.0.57 () {60 vars in 1153 bytes} [Fri Sep 16 08:07:55 2022] POST /identity/v3/projects => generated 371 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 08:07:55.266625 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91f9243-8af0-4311-93d6-2f69acff06ec admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 08:07:55.276559 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91f9243-8af0-4311-93d6-2f69acff06ec admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 08:07:55.331475 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fa6dbb-4769-4e13-9a4a-97ff95dfd6c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 08:07:55.332332 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fa6dbb-4769-4e13-9a4a-97ff95dfd6c2 admin admin] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 08:07:55.332664 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fa6dbb-4769-4e13-9a4a-97ff95dfd6c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 08:07:55.332932 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fa6dbb-4769-4e13-9a4a-97ff95dfd6c2 admin admin] PATH_INFO: `/v3/users` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 08:07:55.333555 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fa6dbb-4769-4e13-9a4a-97ff95dfd6c2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 08:07:55.335481 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fa6dbb-4769-4e13-9a4a-97ff95dfd6c2 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 08:07:55.356954 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1448/2877] 10.222.0.57 () {60 vars in 1144 bytes} [Fri Sep 16 08:07:55 2022] POST /identity/v3/users => generated 286 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 16 08:07:55.361515 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6485b74-1d1f-4850-abe4-f1b0a618e6c6 admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 08:07:55.371638 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6485b74-1d1f-4850-abe4-f1b0a618e6c6 admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 08:07:55.376916 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35ad86e-c57f-4841-b362-37cdecf6bf44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 08:07:55.377501 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35ad86e-c57f-4841-b362-37cdecf6bf44 admin admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 08:07:55.377817 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35ad86e-c57f-4841-b362-37cdecf6bf44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 08:07:55.378120 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35ad86e-c57f-4841-b362-37cdecf6bf44 admin admin] PATH_INFO: `/v3/roles` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 08:07:55.378763 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35ad86e-c57f-4841-b362-37cdecf6bf44 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 08:07:55.380324 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35ad86e-c57f-4841-b362-37cdecf6bf44 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 08:07:55.390346 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1430/2878] 10.222.0.57 () {58 vars in 1122 bytes} [Fri Sep 16 08:07:55 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 08:07:55.393986 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fa6dbb-4769-4e13-9a4a-97ff95dfd6c2 admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 08:07:55.403715 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fa6dbb-4769-4e13-9a4a-97ff95dfd6c2 admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 08:07:55.408367 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a576f6b-13fd-480f-aed5-684af4da85d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 08:07:55.408955 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a576f6b-13fd-480f-aed5-684af4da85d7 admin admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 08:07:55.409231 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a576f6b-13fd-480f-aed5-684af4da85d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 08:07:55.409500 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a576f6b-13fd-480f-aed5-684af4da85d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 08:07:55.410158 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a576f6b-13fd-480f-aed5-684af4da85d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 08:07:55.411725 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a576f6b-13fd-480f-aed5-684af4da85d7 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 08:07:55.422666 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1449/2879] 10.222.0.57 () {58 vars in 1122 bytes} [Fri Sep 16 08:07:55 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 08:07:55.426639 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35ad86e-c57f-4841-b362-37cdecf6bf44 admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 08:07:55.437056 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35ad86e-c57f-4841-b362-37cdecf6bf44 admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 08:07:55.441555 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cf24f3-195d-4ed9-a0bf-8b837f88b4e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 08:07:55.442227 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cf24f3-195d-4ed9-a0bf-8b837f88b4e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 08:07:55.442505 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cf24f3-195d-4ed9-a0bf-8b837f88b4e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 08:07:55.442779 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cf24f3-195d-4ed9-a0bf-8b837f88b4e2 admin admin] PATH_INFO: `/v3/projects/e23d37d16b2549e291a6ab9092b35d2b/users/1434bccf1fcb4adb99099448a7149683/roles/4818d38cf2564825b312e66c9eb24762` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 08:07:55.457148 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4cf24f3-195d-4ed9-a0bf-8b837f88b4e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e23d37d16b2549e291a6ab9092b35d2b, user_id=1434bccf1fcb4adb99099448a7149683, role_id=4818d38cf2564825b312e66c9eb24762)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 08:07:55.459782 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4cf24f3-195d-4ed9-a0bf-8b837f88b4e2 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 08:07:55.471820 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1431/2880] 10.222.0.57 () {60 vars in 1483 bytes} [Fri Sep 16 08:07:55 2022] PUT /identity/v3/projects/e23d37d16b2549e291a6ab9092b35d2b/users/1434bccf1fcb4adb99099448a7149683/roles/4818d38cf2564825b312e66c9eb24762 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 08:07:55.476753 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe95db05-b459-4efc-98c8-958359da2380 None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 08:07:55.477232 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe95db05-b459-4efc-98c8-958359da2380 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 08:07:55.477354 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe95db05-b459-4efc-98c8-958359da2380 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 08:07:55.496566 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-fe95db05-b459-4efc-98c8-958359da2380 None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 08:07:55.498423 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-fe95db05-b459-4efc-98c8-958359da2380 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 08:07:55.525909 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 08:07:55.558881 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1450/2881] 10.222.0.57 () {58 vars in 958 bytes} [Fri Sep 16 08:07:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 08:07:55.568628 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cf24f3-195d-4ed9-a0bf-8b837f88b4e2 admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 08:07:55.570397 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-d4cf24f3-195d-4ed9-a0bf-8b837f88b4e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 08:07:55.589767 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 08:07:55.627953 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cf24f3-195d-4ed9-a0bf-8b837f88b4e2 admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 08:07:55.631526 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a275b14b-d731-4912-80ca-f077fc2d116b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1062e457207a41e4ba4f0a0c4bf36f1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4735f453c0c24cc4a1c14e9ac84a0b46', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 08:07:55.632117 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a275b14b-d731-4912-80ca-f077fc2d116b service neutron] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 08:07:55.632393 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a275b14b-d731-4912-80ca-f077fc2d116b service neutron] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 08:07:55.632660 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a275b14b-d731-4912-80ca-f077fc2d116b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 08:07:55.641570 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a275b14b-d731-4912-80ca-f077fc2d116b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 08:07:55.643003 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a275b14b-d731-4912-80ca-f077fc2d116b service neutron] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 08:07:55.652092 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1432/2882] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Sep 16 08:07:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 08:07:56.275403 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7eaf1f-f882-49d0-aa69-b10f72df91cb None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 08:07:56.275951 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7eaf1f-f882-49d0-aa69-b10f72df91cb None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 08:07:56.276322 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7eaf1f-f882-49d0-aa69-b10f72df91cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 08:07:56.304798 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-9f7eaf1f-f882-49d0-aa69-b10f72df91cb None None] MFA Rules not processed for user `1434bccf1fcb4adb99099448a7149683`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 08:07:56.306060 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-9f7eaf1f-f882-49d0-aa69-b10f72df91cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 08:07:56.372854 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1451/2883] 10.222.0.57 () {58 vars in 958 bytes} [Fri Sep 16 08:07:56 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 08:07:56.385422 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a275b14b-d731-4912-80ca-f077fc2d116b service neutron] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 08:07:56.387007 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-a275b14b-d731-4912-80ca-f077fc2d116b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 08:07:56.443929 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a275b14b-d731-4912-80ca-f077fc2d116b service neutron] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 08:07:56.447595 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c009aae3-1b25-4d3e-9c98-905223b81509 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544bf6be4c24454a013ca110c43cef2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4735f453c0c24cc4a1c14e9ac84a0b46', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 08:07:56.448105 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c009aae3-1b25-4d3e-9c98-905223b81509 service cinder] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 08:07:56.448382 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c009aae3-1b25-4d3e-9c98-905223b81509 service cinder] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 08:07:56.448653 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c009aae3-1b25-4d3e-9c98-905223b81509 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 08:07:56.457496 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c009aae3-1b25-4d3e-9c98-905223b81509 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 08:07:56.458942 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c009aae3-1b25-4d3e-9c98-905223b81509 service cinder] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 08:07:56.468172 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1433/2884] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Sep 16 08:07:56 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 08:07:57.831184 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed7e3c3-822a-4fab-b660-a917c6e0ab63 None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 08:07:57.831674 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed7e3c3-822a-4fab-b660-a917c6e0ab63 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 08:07:57.831821 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed7e3c3-822a-4fab-b660-a917c6e0ab63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 08:07:57.851263 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-aed7e3c3-822a-4fab-b660-a917c6e0ab63 None None] MFA Rules not processed for user `1434bccf1fcb4adb99099448a7149683`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 08:07:57.852458 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-aed7e3c3-822a-4fab-b660-a917c6e0ab63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 08:07:57.859865 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1452/2885] 10.222.0.57 () {58 vars in 958 bytes} [Fri Sep 16 08:07:57 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 08:07:58.096066 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c009aae3-1b25-4d3e-9c98-905223b81509 service cinder] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 08:07:58.105375 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c009aae3-1b25-4d3e-9c98-905223b81509 service cinder] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 08:07:58.109591 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93106a77-5416-4b47-bf2d-779e88f39d47 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1062e457207a41e4ba4f0a0c4bf36f1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4735f453c0c24cc4a1c14e9ac84a0b46', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 08:07:58.110209 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93106a77-5416-4b47-bf2d-779e88f39d47 service neutron] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 08:07:58.110486 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93106a77-5416-4b47-bf2d-779e88f39d47 service neutron] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 08:07:58.110752 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93106a77-5416-4b47-bf2d-779e88f39d47 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 08:07:58.112710 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-93106a77-5416-4b47-bf2d-779e88f39d47 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 08:07:58.122809 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93106a77-5416-4b47-bf2d-779e88f39d47 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 08:07:58.124218 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93106a77-5416-4b47-bf2d-779e88f39d47 service neutron] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 08:07:58.132111 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1434/2886] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Sep 16 08:07:58 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 08:07:59.476274 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed7e3c3-822a-4fab-b660-a917c6e0ab63 None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 08:07:59.477707 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-aed7e3c3-822a-4fab-b660-a917c6e0ab63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 08:07:59.548894 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed7e3c3-822a-4fab-b660-a917c6e0ab63 None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 08:07:59.553784 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19f65d1-9ad7-4007-bf7e-95fc28df112e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7d4ccdd6ef9400ba9e344df0964da1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4735f453c0c24cc4a1c14e9ac84a0b46', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 08:07:59.554381 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19f65d1-9ad7-4007-bf7e-95fc28df112e service placement] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 08:07:59.554656 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19f65d1-9ad7-4007-bf7e-95fc28df112e service placement] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 08:07:59.554923 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19f65d1-9ad7-4007-bf7e-95fc28df112e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 08:07:59.556621 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-b19f65d1-9ad7-4007-bf7e-95fc28df112e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 08:07:59.568139 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19f65d1-9ad7-4007-bf7e-95fc28df112e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 08:07:59.569700 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19f65d1-9ad7-4007-bf7e-95fc28df112e service placement] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 08:07:59.579613 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1453/2887] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Sep 16 08:07:59 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 08:08:06.359694 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93106a77-5416-4b47-bf2d-779e88f39d47 service neutron] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 08:08:06.361170 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-93106a77-5416-4b47-bf2d-779e88f39d47 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 08:08:06.457752 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93106a77-5416-4b47-bf2d-779e88f39d47 service neutron] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 08:08:06.463189 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953afda4-621e-4781-b1d7-97e76a269d81 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bec4d9b08514461a1bf63c6b88f53b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4735f453c0c24cc4a1c14e9ac84a0b46', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 08:08:06.463798 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953afda4-621e-4781-b1d7-97e76a269d81 service nova] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 08:08:06.464077 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953afda4-621e-4781-b1d7-97e76a269d81 service nova] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 08:08:06.464347 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953afda4-621e-4781-b1d7-97e76a269d81 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 08:08:06.466856 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-953afda4-621e-4781-b1d7-97e76a269d81 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 08:08:06.479292 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953afda4-621e-4781-b1d7-97e76a269d81 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 08:08:06.480915 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953afda4-621e-4781-b1d7-97e76a269d81 service nova] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 08:08:06.492094 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1435/2888] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Sep 16 08:08:06 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 08:08:09.575833 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=79 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 08:08:11.708236 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138d821b-bc9f-46fa-8ddd-7c772bc4bd7c None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 08:08:11.708873 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138d821b-bc9f-46fa-8ddd-7c772bc4bd7c None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 08:08:11.708873 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138d821b-bc9f-46fa-8ddd-7c772bc4bd7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 08:08:11.728329 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-138d821b-bc9f-46fa-8ddd-7c772bc4bd7c None None] MFA Rules not processed for user `1434bccf1fcb4adb99099448a7149683`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 08:08:11.729675 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-138d821b-bc9f-46fa-8ddd-7c772bc4bd7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 08:08:11.739030 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1454/2889] 10.222.0.57 () {58 vars in 958 bytes} [Fri Sep 16 08:08:11 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 08:08:11.968319 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953afda4-621e-4781-b1d7-97e76a269d81 service nova] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 08:08:11.977670 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953afda4-621e-4781-b1d7-97e76a269d81 service nova] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 08:08:11.981211 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d405a390-dcf8-4c0a-aecd-796d213eb86f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1062e457207a41e4ba4f0a0c4bf36f1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4735f453c0c24cc4a1c14e9ac84a0b46', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 08:08:11.981830 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d405a390-dcf8-4c0a-aecd-796d213eb86f service neutron] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 08:08:11.982133 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d405a390-dcf8-4c0a-aecd-796d213eb86f service neutron] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 08:08:11.982405 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d405a390-dcf8-4c0a-aecd-796d213eb86f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 08:08:11.984257 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-d405a390-dcf8-4c0a-aecd-796d213eb86f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 08:08:11.993899 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d405a390-dcf8-4c0a-aecd-796d213eb86f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 08:08:11.995281 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d405a390-dcf8-4c0a-aecd-796d213eb86f service neutron] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 08:08:12.003742 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1436/2890] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Sep 16 08:08:11 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 08:08:18.128781 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138d821b-bc9f-46fa-8ddd-7c772bc4bd7c None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 08:08:18.130232 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-138d821b-bc9f-46fa-8ddd-7c772bc4bd7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 08:08:18.145244 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138d821b-bc9f-46fa-8ddd-7c772bc4bd7c None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 08:08:18.150293 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3141447b-b35e-4e7d-8b1b-fb44a6cfa4ce service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7d4ccdd6ef9400ba9e344df0964da1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4735f453c0c24cc4a1c14e9ac84a0b46', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 08:08:18.150897 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3141447b-b35e-4e7d-8b1b-fb44a6cfa4ce service placement] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 08:08:18.151305 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3141447b-b35e-4e7d-8b1b-fb44a6cfa4ce service placement] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 08:08:18.151589 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3141447b-b35e-4e7d-8b1b-fb44a6cfa4ce service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 08:08:18.153364 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-3141447b-b35e-4e7d-8b1b-fb44a6cfa4ce service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 08:08:18.166146 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3141447b-b35e-4e7d-8b1b-fb44a6cfa4ce service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 08:08:18.167731 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3141447b-b35e-4e7d-8b1b-fb44a6cfa4ce service placement] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 08:08:18.178682 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1455/2891] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Sep 16 08:08:18 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 08:08:22.000157 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=90 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 08:08:27.275223 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d227dc07-e6c1-4151-bb8a-25e678b85ad9 None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 08:08:27.275790 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d227dc07-e6c1-4151-bb8a-25e678b85ad9 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 08:08:27.275790 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d227dc07-e6c1-4151-bb8a-25e678b85ad9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 08:08:27.324796 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-d227dc07-e6c1-4151-bb8a-25e678b85ad9 None None] MFA Rules not processed for user `56eb9bbabb65436bb095952159df184c`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 08:08:27.325941 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-d227dc07-e6c1-4151-bb8a-25e678b85ad9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 08:08:27.390491 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1437/2892] 10.222.0.57 () {58 vars in 1009 bytes} [Fri Sep 16 08:08:27 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 08:08:27.436492 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3141447b-b35e-4e7d-8b1b-fb44a6cfa4ce service placement] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 08:08:27.437918 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-3141447b-b35e-4e7d-8b1b-fb44a6cfa4ce service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 08:08:27.526998 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3141447b-b35e-4e7d-8b1b-fb44a6cfa4ce service placement] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 08:08:27.533053 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4148b018-36dc-4703-8a67-ba9f70f3fe6d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38abb0283b41449d8183b88912f2574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4735f453c0c24cc4a1c14e9ac84a0b46', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 08:08:27.533690 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4148b018-36dc-4703-8a67-ba9f70f3fe6d service swift] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 08:08:27.534484 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4148b018-36dc-4703-8a67-ba9f70f3fe6d service swift] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 08:08:27.534484 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4148b018-36dc-4703-8a67-ba9f70f3fe6d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 08:08:27.542611 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4148b018-36dc-4703-8a67-ba9f70f3fe6d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 08:08:27.544169 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4148b018-36dc-4703-8a67-ba9f70f3fe6d service swift] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 08:08:27.554047 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1456/2893] 10.222.0.57 () {60 vars in 1384 bytes} [Fri Sep 16 08:08:27 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 16 08:08:37.386939 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=40 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 08:08:37.548948 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=50 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 08:08:41.977519 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f49f7d8-4510-4fe1-ac1b-890ef3e75a84 None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 08:08:41.978034 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f49f7d8-4510-4fe1-ac1b-890ef3e75a84 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 08:08:41.978142 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f49f7d8-4510-4fe1-ac1b-890ef3e75a84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 08:08:41.997935 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-4f49f7d8-4510-4fe1-ac1b-890ef3e75a84 None None] MFA Rules not processed for user `56eb9bbabb65436bb095952159df184c`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 08:08:41.999660 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-4f49f7d8-4510-4fe1-ac1b-890ef3e75a84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 08:08:42.006729 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1438/2894] 10.222.0.57 () {58 vars in 967 bytes} [Fri Sep 16 08:08:41 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 08:08:42.019374 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4148b018-36dc-4703-8a67-ba9f70f3fe6d service swift] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 08:08:42.030043 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4148b018-36dc-4703-8a67-ba9f70f3fe6d service swift] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 08:08:42.035035 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06dcb151-cc33-4d06-b8e1-6668dcd084ca service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38abb0283b41449d8183b88912f2574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4735f453c0c24cc4a1c14e9ac84a0b46', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 08:08:42.035628 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dcb151-cc33-4d06-b8e1-6668dcd084ca service swift] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 08:08:42.035904 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dcb151-cc33-4d06-b8e1-6668dcd084ca service swift] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 08:08:42.036165 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dcb151-cc33-4d06-b8e1-6668dcd084ca service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 08:08:42.044071 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06dcb151-cc33-4d06-b8e1-6668dcd084ca service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 08:08:42.045828 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06dcb151-cc33-4d06-b8e1-6668dcd084ca service swift] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 08:08:42.053667 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1457/2895] 10.222.0.57 () {60 vars in 1384 bytes} [Fri Sep 16 08:08:42 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 16 08:08:44.178005 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f49f7d8-4510-4fe1-ac1b-890ef3e75a84 None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 08:08:44.192247 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f49f7d8-4510-4fe1-ac1b-890ef3e75a84 None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 08:08:44.197443 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908ec6a6-9b19-4fc4-8c74-e86bb9dd74e5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7d4ccdd6ef9400ba9e344df0964da1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4735f453c0c24cc4a1c14e9ac84a0b46', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 08:08:44.198308 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908ec6a6-9b19-4fc4-8c74-e86bb9dd74e5 service placement] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 08:08:44.198587 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908ec6a6-9b19-4fc4-8c74-e86bb9dd74e5 service placement] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 08:08:44.198860 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908ec6a6-9b19-4fc4-8c74-e86bb9dd74e5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 08:08:44.200578 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-908ec6a6-9b19-4fc4-8c74-e86bb9dd74e5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 08:08:44.213206 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908ec6a6-9b19-4fc4-8c74-e86bb9dd74e5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 08:08:44.215377 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908ec6a6-9b19-4fc4-8c74-e86bb9dd74e5 service placement] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 08:08:44.226461 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1439/2896] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Sep 16 08:08:44 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 08:08:44.237119 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06dcb151-cc33-4d06-b8e1-6668dcd084ca service swift] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 08:08:44.249395 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06dcb151-cc33-4d06-b8e1-6668dcd084ca service swift] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 08:08:44.254368 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f47fdd2-1e07-4794-8a10-087520721577 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 08:08:44.255086 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f47fdd2-1e07-4794-8a10-087520721577 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 08:08:44.255430 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f47fdd2-1e07-4794-8a10-087520721577 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 08:08:44.255765 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f47fdd2-1e07-4794-8a10-087520721577 admin admin] PATH_INFO: `/v3/users/1434bccf1fcb4adb99099448a7149683` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 08:08:44.257119 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f47fdd2-1e07-4794-8a10-087520721577 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1434bccf1fcb4adb99099448a7149683)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 08:08:44.259100 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f47fdd2-1e07-4794-8a10-087520721577 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 08:08:44.304530 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-5f47fdd2-1e07-4794-8a10-087520721577 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1434bccf1fcb4adb99099448a7149683'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 08:08:44.316506 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-5f47fdd2-1e07-4794-8a10-087520721577 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1434bccf1fcb4adb99099448a7149683'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 08:08:44.317160 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-5f47fdd2-1e07-4794-8a10-087520721577 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1434bccf1fcb4adb99099448a7149683'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 08:08:44.324538 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-5f47fdd2-1e07-4794-8a10-087520721577 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1434bccf1fcb4adb99099448a7149683'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 08:08:44.332230 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-5f47fdd2-1e07-4794-8a10-087520721577 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1434bccf1fcb4adb99099448a7149683'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 08:08:44.338275 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1458/2897] 10.222.0.57 () {58 vars in 1224 bytes} [Fri Sep 16 08:08:44 2022] DELETE /identity/v3/users/1434bccf1fcb4adb99099448a7149683 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 08:08:44.505837 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908ec6a6-9b19-4fc4-8c74-e86bb9dd74e5 service placement] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 08:08:44.519713 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908ec6a6-9b19-4fc4-8c74-e86bb9dd74e5 service placement] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 08:08:44.575731 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1599a333-984a-46f8-a629-edd3d4581773 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 08:08:44.576482 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1599a333-984a-46f8-a629-edd3d4581773 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 08:08:44.577440 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1599a333-984a-46f8-a629-edd3d4581773 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 08:08:44.577741 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1599a333-984a-46f8-a629-edd3d4581773 admin admin] PATH_INFO: `/v3/projects/e23d37d16b2549e291a6ab9092b35d2b` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 08:08:44.578890 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1599a333-984a-46f8-a629-edd3d4581773 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e23d37d16b2549e291a6ab9092b35d2b)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 08:08:44.580784 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1599a333-984a-46f8-a629-edd3d4581773 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 08:08:44.626017 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-1599a333-984a-46f8-a629-edd3d4581773 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e23d37d16b2549e291a6ab9092b35d2b', 'request_id': 'req-1599a333-984a-46f8-a629-edd3d4581773'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 08:08:44.633767 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-1599a333-984a-46f8-a629-edd3d4581773 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e23d37d16b2549e291a6ab9092b35d2b', 'request_id': 'req-1599a333-984a-46f8-a629-edd3d4581773'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 08:08:44.639926 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-1599a333-984a-46f8-a629-edd3d4581773 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e23d37d16b2549e291a6ab9092b35d2b', 'request_id': 'req-1599a333-984a-46f8-a629-edd3d4581773'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 08:08:44.651207 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-1599a333-984a-46f8-a629-edd3d4581773 admin admin] The token cache is being invalidate because project e23d37d16b2549e291a6ab9092b35d2b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81430) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 08:08:44.651493 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-1599a333-984a-46f8-a629-edd3d4581773 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 08:08:44.652138 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-1599a333-984a-46f8-a629-edd3d4581773 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 08:08:44.653591 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1440/2898] 10.222.0.57 () {58 vars in 1233 bytes} [Fri Sep 16 08:08:44 2022] DELETE /identity/v3/projects/e23d37d16b2549e291a6ab9092b35d2b => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 08:08:44.658614 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d45dad4-3b69-4c91-8d34-f3eee2b243d8 None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 08:08:44.658969 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d45dad4-3b69-4c91-8d34-f3eee2b243d8 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 08:08:44.659310 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d45dad4-3b69-4c91-8d34-f3eee2b243d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 08:08:44.679187 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-7d45dad4-3b69-4c91-8d34-f3eee2b243d8 None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 08:08:44.680384 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-7d45dad4-3b69-4c91-8d34-f3eee2b243d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 08:08:44.737825 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1459/2899] 10.222.0.57 () {58 vars in 958 bytes} [Fri Sep 16 08:08:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 08:08:44.745260 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5907f5-3793-485c-9dae-004fbabf75f7 None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 08:08:44.745548 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5907f5-3793-485c-9dae-004fbabf75f7 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 08:08:44.745847 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5907f5-3793-485c-9dae-004fbabf75f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 08:08:44.765493 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-ab5907f5-3793-485c-9dae-004fbabf75f7 None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 08:08:44.766724 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-ab5907f5-3793-485c-9dae-004fbabf75f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 08:08:44.774460 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1441/2900] 10.222.0.57 () {58 vars in 958 bytes} [Fri Sep 16 08:08:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 08:08:44.778690 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d45dad4-3b69-4c91-8d34-f3eee2b243d8 None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 08:08:44.788228 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d45dad4-3b69-4c91-8d34-f3eee2b243d8 None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 08:08:44.792721 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2c73ca-fa3d-4c55-a048-c3b0b988aff9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 08:08:44.793311 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2c73ca-fa3d-4c55-a048-c3b0b988aff9 admin admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 08:08:44.793585 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2c73ca-fa3d-4c55-a048-c3b0b988aff9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 08:08:44.793902 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2c73ca-fa3d-4c55-a048-c3b0b988aff9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 08:08:44.794540 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2c73ca-fa3d-4c55-a048-c3b0b988aff9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 08:08:44.794855 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2c73ca-fa3d-4c55-a048-c3b0b988aff9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 08:08:44.796980 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2c73ca-fa3d-4c55-a048-c3b0b988aff9 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 08:08:44.810207 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1460/2901] 10.222.0.57 () {58 vars in 1153 bytes} [Fri Sep 16 08:08:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 08:08:44.815342 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5907f5-3793-485c-9dae-004fbabf75f7 None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 08:08:44.824552 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5907f5-3793-485c-9dae-004fbabf75f7 None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 08:08:44.829230 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bc309a-2a82-4964-81ff-a89c6a3b0abd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 08:08:44.829846 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bc309a-2a82-4964-81ff-a89c6a3b0abd admin admin] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 08:08:44.830129 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bc309a-2a82-4964-81ff-a89c6a3b0abd admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 08:08:44.830403 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bc309a-2a82-4964-81ff-a89c6a3b0abd admin admin] PATH_INFO: `/v3/projects` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 08:08:44.831034 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8bc309a-2a82-4964-81ff-a89c6a3b0abd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 08:08:44.832898 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8bc309a-2a82-4964-81ff-a89c6a3b0abd admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 08:08:44.859184 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1442/2902] 10.222.0.57 () {60 vars in 1153 bytes} [Fri Sep 16 08:08:44 2022] POST /identity/v3/projects => generated 385 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 08:08:44.863571 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2c73ca-fa3d-4c55-a048-c3b0b988aff9 admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 08:08:44.873545 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2c73ca-fa3d-4c55-a048-c3b0b988aff9 admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 08:08:44.918912 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 08:08:44.933616 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7930166d-db5c-47c0-a489-31b97a331a21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 08:08:44.934249 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7930166d-db5c-47c0-a489-31b97a331a21 admin admin] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 08:08:44.934527 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7930166d-db5c-47c0-a489-31b97a331a21 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 08:08:44.934796 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7930166d-db5c-47c0-a489-31b97a331a21 admin admin] PATH_INFO: `/v3/users` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 08:08:44.935423 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7930166d-db5c-47c0-a489-31b97a331a21 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 08:08:44.937974 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7930166d-db5c-47c0-a489-31b97a331a21 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 08:08:44.959591 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1461/2903] 10.222.0.57 () {60 vars in 1144 bytes} [Fri Sep 16 08:08:44 2022] POST /identity/v3/users => generated 293 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 08:08:44.963826 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bc309a-2a82-4964-81ff-a89c6a3b0abd admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 08:08:44.974082 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bc309a-2a82-4964-81ff-a89c6a3b0abd admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 08:08:44.978674 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ebfc01-d9a7-415e-bf12-1581ae58a40a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 08:08:44.979265 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ebfc01-d9a7-415e-bf12-1581ae58a40a admin admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 08:08:44.979543 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ebfc01-d9a7-415e-bf12-1581ae58a40a admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 08:08:44.979816 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ebfc01-d9a7-415e-bf12-1581ae58a40a admin admin] PATH_INFO: `/v3/roles` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 08:08:44.980454 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ebfc01-d9a7-415e-bf12-1581ae58a40a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 08:08:44.982285 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ebfc01-d9a7-415e-bf12-1581ae58a40a admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 08:08:44.992215 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1443/2904] 10.222.0.57 () {58 vars in 1122 bytes} [Fri Sep 16 08:08:44 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 08:08:44.996057 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7930166d-db5c-47c0-a489-31b97a331a21 admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 08:08:45.006768 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7930166d-db5c-47c0-a489-31b97a331a21 admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 08:08:45.011412 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd55fd7d-e288-4795-97ce-b765a0a58c9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 08:08:45.012026 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd55fd7d-e288-4795-97ce-b765a0a58c9e admin admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 08:08:45.012303 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd55fd7d-e288-4795-97ce-b765a0a58c9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 08:08:45.012574 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd55fd7d-e288-4795-97ce-b765a0a58c9e admin admin] PATH_INFO: `/v3/roles` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 08:08:45.013201 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd55fd7d-e288-4795-97ce-b765a0a58c9e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 08:08:45.015743 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd55fd7d-e288-4795-97ce-b765a0a58c9e admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 08:08:45.026157 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1462/2905] 10.222.0.57 () {58 vars in 1122 bytes} [Fri Sep 16 08:08:44 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 08:08:45.030360 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ebfc01-d9a7-415e-bf12-1581ae58a40a admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 08:08:45.040155 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ebfc01-d9a7-415e-bf12-1581ae58a40a admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 08:08:45.044742 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a94442e-524a-48b0-abf8-efbe9094e982 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 08:08:45.045386 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a94442e-524a-48b0-abf8-efbe9094e982 admin admin] REQUEST_METHOD: `PUT` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 08:08:45.045661 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a94442e-524a-48b0-abf8-efbe9094e982 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 08:08:45.045966 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a94442e-524a-48b0-abf8-efbe9094e982 admin admin] PATH_INFO: `/v3/projects/9526a889346e44cb8aa9af6a30bf8238/users/7617dd9f662146eca17104f9230408f3/roles/4818d38cf2564825b312e66c9eb24762` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 08:08:45.060181 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a94442e-524a-48b0-abf8-efbe9094e982 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9526a889346e44cb8aa9af6a30bf8238, user_id=7617dd9f662146eca17104f9230408f3, role_id=4818d38cf2564825b312e66c9eb24762)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 08:08:45.064500 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a94442e-524a-48b0-abf8-efbe9094e982 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 08:08:45.078519 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1444/2906] 10.222.0.57 () {60 vars in 1483 bytes} [Fri Sep 16 08:08:45 2022] PUT /identity/v3/projects/9526a889346e44cb8aa9af6a30bf8238/users/7617dd9f662146eca17104f9230408f3/roles/4818d38cf2564825b312e66c9eb24762 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 08:08:45.088641 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1fe264-e592-41ef-a5e2-15d26b9f4e1c None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 08:08:45.088940 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1fe264-e592-41ef-a5e2-15d26b9f4e1c None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 08:08:45.089270 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1fe264-e592-41ef-a5e2-15d26b9f4e1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 08:08:45.117783 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-2b1fe264-e592-41ef-a5e2-15d26b9f4e1c None None] MFA Rules not processed for user `7617dd9f662146eca17104f9230408f3`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 08:08:45.119005 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-2b1fe264-e592-41ef-a5e2-15d26b9f4e1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 08:08:45.181336 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1463/2907] 10.222.0.57 () {58 vars in 958 bytes} [Fri Sep 16 08:08:45 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 08:08:45.192757 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a94442e-524a-48b0-abf8-efbe9094e982 admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 08:08:45.194509 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-2a94442e-524a-48b0-abf8-efbe9094e982 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 08:08:45.204898 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 08:08:45.252458 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a94442e-524a-48b0-abf8-efbe9094e982 admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 08:08:45.256235 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdace42-1f98-4c7d-a649-f6350cbe8ff3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544bf6be4c24454a013ca110c43cef2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4735f453c0c24cc4a1c14e9ac84a0b46', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 08:08:45.256829 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdace42-1f98-4c7d-a649-f6350cbe8ff3 service cinder] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 08:08:45.257104 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdace42-1f98-4c7d-a649-f6350cbe8ff3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 08:08:45.257373 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdace42-1f98-4c7d-a649-f6350cbe8ff3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 08:08:45.266105 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fdace42-1f98-4c7d-a649-f6350cbe8ff3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 08:08:45.267510 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fdace42-1f98-4c7d-a649-f6350cbe8ff3 service cinder] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 08:08:45.276087 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1445/2908] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Sep 16 08:08:45 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 08:08:47.813958 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1fe264-e592-41ef-a5e2-15d26b9f4e1c None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 08:08:47.875099 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1fe264-e592-41ef-a5e2-15d26b9f4e1c None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 08:08:47.879546 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb9e3c6-c1a6-4bee-8db0-33689db0047a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 08:08:47.880169 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb9e3c6-c1a6-4bee-8db0-33689db0047a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 08:08:47.880445 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb9e3c6-c1a6-4bee-8db0-33689db0047a admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 08:08:47.880716 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb9e3c6-c1a6-4bee-8db0-33689db0047a admin admin] PATH_INFO: `/v3/users/7617dd9f662146eca17104f9230408f3` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 08:08:47.881849 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb9e3c6-c1a6-4bee-8db0-33689db0047a admin admin] RBAC: Authorizing `identity:delete_user(user_id=7617dd9f662146eca17104f9230408f3)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 08:08:47.883755 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb9e3c6-c1a6-4bee-8db0-33689db0047a admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 08:08:47.929243 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-3eb9e3c6-c1a6-4bee-8db0-33689db0047a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7617dd9f662146eca17104f9230408f3'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 08:08:47.937087 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=89,keystone:INSERT=3,keystone:DELETE=8 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 08:08:47.943748 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-3eb9e3c6-c1a6-4bee-8db0-33689db0047a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7617dd9f662146eca17104f9230408f3'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 08:08:47.944668 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-3eb9e3c6-c1a6-4bee-8db0-33689db0047a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7617dd9f662146eca17104f9230408f3'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 08:08:47.952436 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-3eb9e3c6-c1a6-4bee-8db0-33689db0047a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7617dd9f662146eca17104f9230408f3'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 08:08:47.959505 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-3eb9e3c6-c1a6-4bee-8db0-33689db0047a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7617dd9f662146eca17104f9230408f3'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 08:08:47.965454 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1464/2909] 10.222.0.57 () {58 vars in 1224 bytes} [Fri Sep 16 08:08:47 2022] DELETE /identity/v3/users/7617dd9f662146eca17104f9230408f3 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 08:08:47.970627 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f78a6f-d9ce-4a4c-bb4e-831f63e479a6 None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 08:08:47.971119 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f78a6f-d9ce-4a4c-bb4e-831f63e479a6 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 08:08:47.971234 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f78a6f-d9ce-4a4c-bb4e-831f63e479a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 08:08:47.990504 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-d7f78a6f-d9ce-4a4c-bb4e-831f63e479a6 None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 08:08:47.991700 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-d7f78a6f-d9ce-4a4c-bb4e-831f63e479a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 08:08:48.049199 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1446/2910] 10.222.0.57 () {58 vars in 958 bytes} [Fri Sep 16 08:08:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 16 08:08:48.058761 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb9e3c6-c1a6-4bee-8db0-33689db0047a admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 08:08:48.060148 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-3eb9e3c6-c1a6-4bee-8db0-33689db0047a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 08:08:48.119633 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb9e3c6-c1a6-4bee-8db0-33689db0047a admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 08:08:48.123226 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894da9f2-502d-4122-aa56-f320cd135142 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1062e457207a41e4ba4f0a0c4bf36f1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4735f453c0c24cc4a1c14e9ac84a0b46', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 08:08:48.123873 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894da9f2-502d-4122-aa56-f320cd135142 service neutron] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 08:08:48.124150 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894da9f2-502d-4122-aa56-f320cd135142 service neutron] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 08:08:48.124418 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894da9f2-502d-4122-aa56-f320cd135142 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 08:08:48.133562 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894da9f2-502d-4122-aa56-f320cd135142 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 08:08:48.135070 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894da9f2-502d-4122-aa56-f320cd135142 service neutron] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 08:08:48.144745 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1465/2911] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Sep 16 08:08:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 08:08:48.415488 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f78a6f-d9ce-4a4c-bb4e-831f63e479a6 None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 08:08:48.416926 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-d7f78a6f-d9ce-4a4c-bb4e-831f63e479a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 08:08:48.429341 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f78a6f-d9ce-4a4c-bb4e-831f63e479a6 None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 08:08:48.434163 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297be92b-5721-4bc8-a7b6-fcac76ada382 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 08:08:48.434803 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297be92b-5721-4bc8-a7b6-fcac76ada382 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 08:08:48.435078 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297be92b-5721-4bc8-a7b6-fcac76ada382 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 08:08:48.435349 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297be92b-5721-4bc8-a7b6-fcac76ada382 admin admin] PATH_INFO: `/v3/projects/9526a889346e44cb8aa9af6a30bf8238` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 08:08:48.436486 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297be92b-5721-4bc8-a7b6-fcac76ada382 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9526a889346e44cb8aa9af6a30bf8238)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 08:08:48.438428 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297be92b-5721-4bc8-a7b6-fcac76ada382 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 08:08:48.485311 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-297be92b-5721-4bc8-a7b6-fcac76ada382 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9526a889346e44cb8aa9af6a30bf8238', 'request_id': 'req-297be92b-5721-4bc8-a7b6-fcac76ada382'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 08:08:48.492488 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-297be92b-5721-4bc8-a7b6-fcac76ada382 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9526a889346e44cb8aa9af6a30bf8238', 'request_id': 'req-297be92b-5721-4bc8-a7b6-fcac76ada382'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 08:08:48.497935 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-297be92b-5721-4bc8-a7b6-fcac76ada382 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9526a889346e44cb8aa9af6a30bf8238', 'request_id': 'req-297be92b-5721-4bc8-a7b6-fcac76ada382'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 08:08:48.508739 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-297be92b-5721-4bc8-a7b6-fcac76ada382 admin admin] The token cache is being invalidate because project 9526a889346e44cb8aa9af6a30bf8238 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81430) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 08:08:48.509024 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-297be92b-5721-4bc8-a7b6-fcac76ada382 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 08:08:48.509649 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-297be92b-5721-4bc8-a7b6-fcac76ada382 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 08:08:48.511139 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1447/2912] 10.222.0.57 () {58 vars in 1233 bytes} [Fri Sep 16 08:08:48 2022] DELETE /identity/v3/projects/9526a889346e44cb8aa9af6a30bf8238 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 08:08:48.516544 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b00e61f-330f-48e7-8737-3e3c69972a94 None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 08:08:48.516921 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b00e61f-330f-48e7-8737-3e3c69972a94 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 08:08:48.517200 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b00e61f-330f-48e7-8737-3e3c69972a94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 08:08:48.538015 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-6b00e61f-330f-48e7-8737-3e3c69972a94 None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 08:08:48.539224 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-6b00e61f-330f-48e7-8737-3e3c69972a94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 08:08:48.597632 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1466/2913] 10.222.0.57 () {58 vars in 958 bytes} [Fri Sep 16 08:08:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 08:08:48.606264 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd0e32c-4649-46c3-a5e6-2a67313e8e26 None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 08:08:48.606552 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd0e32c-4649-46c3-a5e6-2a67313e8e26 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 08:08:48.606828 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd0e32c-4649-46c3-a5e6-2a67313e8e26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 08:08:48.626457 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-dfd0e32c-4649-46c3-a5e6-2a67313e8e26 None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 08:08:48.627648 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-dfd0e32c-4649-46c3-a5e6-2a67313e8e26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 08:08:48.635414 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1448/2914] 10.222.0.57 () {58 vars in 958 bytes} [Fri Sep 16 08:08:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 08:08:48.640101 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b00e61f-330f-48e7-8737-3e3c69972a94 None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 08:08:48.649664 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b00e61f-330f-48e7-8737-3e3c69972a94 None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 08:08:48.654238 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb73f567-85c2-4b0c-8709-b3ef7fb25848 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 08:08:48.655425 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb73f567-85c2-4b0c-8709-b3ef7fb25848 admin admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 08:08:48.655697 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb73f567-85c2-4b0c-8709-b3ef7fb25848 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 08:08:48.655963 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb73f567-85c2-4b0c-8709-b3ef7fb25848 admin admin] PATH_INFO: `/v3/domains` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 08:08:48.656595 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb73f567-85c2-4b0c-8709-b3ef7fb25848 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 08:08:48.656889 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb73f567-85c2-4b0c-8709-b3ef7fb25848 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 08:08:48.658502 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb73f567-85c2-4b0c-8709-b3ef7fb25848 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 08:08:48.669709 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1467/2915] 10.222.0.57 () {58 vars in 1153 bytes} [Fri Sep 16 08:08:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 08:08:48.673933 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd0e32c-4649-46c3-a5e6-2a67313e8e26 None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 08:08:48.683046 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd0e32c-4649-46c3-a5e6-2a67313e8e26 None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 08:08:48.688340 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26275ca9-3f00-4496-a23a-cde89fd371ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 08:08:48.688933 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26275ca9-3f00-4496-a23a-cde89fd371ca admin admin] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 08:08:48.689214 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26275ca9-3f00-4496-a23a-cde89fd371ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 08:08:48.689491 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26275ca9-3f00-4496-a23a-cde89fd371ca admin admin] PATH_INFO: `/v3/projects` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 08:08:48.690210 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26275ca9-3f00-4496-a23a-cde89fd371ca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 08:08:48.692130 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26275ca9-3f00-4496-a23a-cde89fd371ca admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 08:08:48.719103 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1449/2916] 10.222.0.57 () {60 vars in 1153 bytes} [Fri Sep 16 08:08:48 2022] POST /identity/v3/projects => generated 383 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 08:08:48.723240 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb73f567-85c2-4b0c-8709-b3ef7fb25848 admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 08:08:48.732993 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb73f567-85c2-4b0c-8709-b3ef7fb25848 admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 08:08:48.787911 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e074211-cb56-4d9f-be41-32ad45776a84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 08:08:48.788503 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e074211-cb56-4d9f-be41-32ad45776a84 admin admin] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 08:08:48.788783 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e074211-cb56-4d9f-be41-32ad45776a84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 08:08:48.789061 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e074211-cb56-4d9f-be41-32ad45776a84 admin admin] PATH_INFO: `/v3/users` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 08:08:48.789859 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e074211-cb56-4d9f-be41-32ad45776a84 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 08:08:48.791814 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e074211-cb56-4d9f-be41-32ad45776a84 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 08:08:48.801622 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 08:08:48.814670 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1468/2917] 10.222.0.57 () {60 vars in 1144 bytes} [Fri Sep 16 08:08:48 2022] POST /identity/v3/users => generated 292 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 16 08:08:48.818699 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26275ca9-3f00-4496-a23a-cde89fd371ca admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 08:08:48.825132 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 08:08:48.829370 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26275ca9-3f00-4496-a23a-cde89fd371ca admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 08:08:48.835605 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5ce5f7-4e88-40a2-8d78-c12c806dd9fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 08:08:48.836313 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5ce5f7-4e88-40a2-8d78-c12c806dd9fd admin admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 08:08:48.836773 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5ce5f7-4e88-40a2-8d78-c12c806dd9fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 08:08:48.837053 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5ce5f7-4e88-40a2-8d78-c12c806dd9fd admin admin] PATH_INFO: `/v3/roles` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 08:08:48.837698 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5ce5f7-4e88-40a2-8d78-c12c806dd9fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 08:08:48.839331 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5ce5f7-4e88-40a2-8d78-c12c806dd9fd admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 08:08:48.849363 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1450/2918] 10.222.0.57 () {58 vars in 1122 bytes} [Fri Sep 16 08:08:48 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 08:08:48.853359 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e074211-cb56-4d9f-be41-32ad45776a84 admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 08:08:48.863448 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e074211-cb56-4d9f-be41-32ad45776a84 admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 08:08:48.867958 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857054aa-8db5-4a54-84d9-e3124d66f495 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 08:08:48.868548 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857054aa-8db5-4a54-84d9-e3124d66f495 admin admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 08:08:48.868823 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857054aa-8db5-4a54-84d9-e3124d66f495 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 08:08:48.869091 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857054aa-8db5-4a54-84d9-e3124d66f495 admin admin] PATH_INFO: `/v3/roles` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 08:08:48.869716 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857054aa-8db5-4a54-84d9-e3124d66f495 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 08:08:48.871317 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857054aa-8db5-4a54-84d9-e3124d66f495 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 08:08:48.882310 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1469/2919] 10.222.0.57 () {58 vars in 1122 bytes} [Fri Sep 16 08:08:48 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 08:08:48.886222 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5ce5f7-4e88-40a2-8d78-c12c806dd9fd admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 08:08:48.896609 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5ce5f7-4e88-40a2-8d78-c12c806dd9fd admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 08:08:48.902077 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fba5af8-30eb-4359-acff-0d7773613d47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 08:08:48.903178 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fba5af8-30eb-4359-acff-0d7773613d47 admin admin] REQUEST_METHOD: `PUT` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 08:08:48.903456 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fba5af8-30eb-4359-acff-0d7773613d47 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 08:08:48.903727 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fba5af8-30eb-4359-acff-0d7773613d47 admin admin] PATH_INFO: `/v3/projects/50010f016d7f43719388e6b29394b022/users/f61eca8f62994c1ba23040fb470314f9/roles/4818d38cf2564825b312e66c9eb24762` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 08:08:48.919532 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fba5af8-30eb-4359-acff-0d7773613d47 admin admin] RBAC: Authorizing `identity:create_grant(project_id=50010f016d7f43719388e6b29394b022, user_id=f61eca8f62994c1ba23040fb470314f9, role_id=4818d38cf2564825b312e66c9eb24762)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 08:08:48.922389 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fba5af8-30eb-4359-acff-0d7773613d47 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 08:08:48.934999 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1451/2920] 10.222.0.57 () {60 vars in 1483 bytes} [Fri Sep 16 08:08:48 2022] PUT /identity/v3/projects/50010f016d7f43719388e6b29394b022/users/f61eca8f62994c1ba23040fb470314f9/roles/4818d38cf2564825b312e66c9eb24762 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 08:08:48.940461 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce343fa2-211d-4b24-81d6-1c483ef2d360 None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 08:08:48.940749 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce343fa2-211d-4b24-81d6-1c483ef2d360 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 08:08:48.941024 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce343fa2-211d-4b24-81d6-1c483ef2d360 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 08:08:48.960281 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-ce343fa2-211d-4b24-81d6-1c483ef2d360 None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 08:08:48.961484 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-ce343fa2-211d-4b24-81d6-1c483ef2d360 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 08:08:49.018647 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1470/2921] 10.222.0.57 () {58 vars in 958 bytes} [Fri Sep 16 08:08:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 08:08:49.028248 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fba5af8-30eb-4359-acff-0d7773613d47 admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 08:08:49.030562 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-3fba5af8-30eb-4359-acff-0d7773613d47 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 08:08:49.086921 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fba5af8-30eb-4359-acff-0d7773613d47 admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 08:08:49.090517 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d082548-33ac-48f1-b995-2d353a89c745 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1062e457207a41e4ba4f0a0c4bf36f1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4735f453c0c24cc4a1c14e9ac84a0b46', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 08:08:49.091113 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d082548-33ac-48f1-b995-2d353a89c745 service neutron] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 08:08:49.091393 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d082548-33ac-48f1-b995-2d353a89c745 service neutron] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 08:08:49.091662 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d082548-33ac-48f1-b995-2d353a89c745 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 08:08:49.101291 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d082548-33ac-48f1-b995-2d353a89c745 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 08:08:49.102725 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d082548-33ac-48f1-b995-2d353a89c745 service neutron] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 08:08:49.112371 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1452/2922] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Sep 16 08:08:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 08:08:49.730251 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadba3a6-86a7-4832-a9fc-d36b2a021226 None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 08:08:49.730526 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadba3a6-86a7-4832-a9fc-d36b2a021226 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 08:08:49.730804 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadba3a6-86a7-4832-a9fc-d36b2a021226 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 08:08:49.760172 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-dadba3a6-86a7-4832-a9fc-d36b2a021226 None None] MFA Rules not processed for user `f61eca8f62994c1ba23040fb470314f9`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 08:08:49.761413 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-dadba3a6-86a7-4832-a9fc-d36b2a021226 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 08:08:49.831548 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1471/2923] 10.222.0.57 () {58 vars in 958 bytes} [Fri Sep 16 08:08:49 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 08:08:49.842325 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d082548-33ac-48f1-b995-2d353a89c745 service neutron] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 08:08:49.843806 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-0d082548-33ac-48f1-b995-2d353a89c745 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 08:08:49.902231 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d082548-33ac-48f1-b995-2d353a89c745 service neutron] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 08:08:49.907596 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bee2d0-df53-4b69-b074-d2008105aa6d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544bf6be4c24454a013ca110c43cef2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4735f453c0c24cc4a1c14e9ac84a0b46', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 08:08:49.908214 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bee2d0-df53-4b69-b074-d2008105aa6d service cinder] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 08:08:49.908499 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bee2d0-df53-4b69-b074-d2008105aa6d service cinder] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 08:08:49.908801 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bee2d0-df53-4b69-b074-d2008105aa6d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 08:08:49.917553 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30bee2d0-df53-4b69-b074-d2008105aa6d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 08:08:49.918938 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30bee2d0-df53-4b69-b074-d2008105aa6d service cinder] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 08:08:49.927674 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1453/2924] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Sep 16 08:08:49 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 08:08:51.290563 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69c23ea-a547-48ea-a497-7c8edec722db None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 08:08:51.291074 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69c23ea-a547-48ea-a497-7c8edec722db None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 08:08:51.291175 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69c23ea-a547-48ea-a497-7c8edec722db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 08:08:51.310208 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-a69c23ea-a547-48ea-a497-7c8edec722db None None] MFA Rules not processed for user `f61eca8f62994c1ba23040fb470314f9`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 08:08:51.311438 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-a69c23ea-a547-48ea-a497-7c8edec722db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 08:08:51.318183 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1472/2925] 10.222.0.57 () {58 vars in 958 bytes} [Fri Sep 16 08:08:51 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 08:08:59.923648 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=65,keystone:INSERT=1 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 08:09:01.304874 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:INSERT=1,keystone:SELECT=69 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 08:09:16.286077 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5592f328-09e0-4705-9d74-f04b8301dc30 None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 08:09:16.286677 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5592f328-09e0-4705-9d74-f04b8301dc30 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 08:09:16.286677 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5592f328-09e0-4705-9d74-f04b8301dc30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 08:09:16.306401 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-5592f328-09e0-4705-9d74-f04b8301dc30 None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 08:09:16.307609 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-5592f328-09e0-4705-9d74-f04b8301dc30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 08:09:16.315747 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1454/2926] 10.222.0.33 () {58 vars in 1016 bytes} [Fri Sep 16 08:09:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 08:09:16.332738 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69c23ea-a547-48ea-a497-7c8edec722db None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 08:09:16.334301 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-a69c23ea-a547-48ea-a497-7c8edec722db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 08:09:16.407517 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69c23ea-a547-48ea-a497-7c8edec722db None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 08:09:16.413038 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6b8165-f9d2-4b20-a3dd-1510cd21d373 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bec4d9b08514461a1bf63c6b88f53b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4735f453c0c24cc4a1c14e9ac84a0b46', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 08:09:16.413664 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6b8165-f9d2-4b20-a3dd-1510cd21d373 service nova] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 08:09:16.413991 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6b8165-f9d2-4b20-a3dd-1510cd21d373 service nova] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 08:09:16.414263 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6b8165-f9d2-4b20-a3dd-1510cd21d373 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 08:09:16.422978 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6b8165-f9d2-4b20-a3dd-1510cd21d373 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 08:09:16.424640 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6b8165-f9d2-4b20-a3dd-1510cd21d373 service nova] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 08:09:16.433976 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1473/2927] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Sep 16 08:09:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 08:09:19.373604 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de317397-b4d4-4735-9105-a287d4402448 None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 08:09:19.374180 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de317397-b4d4-4735-9105-a287d4402448 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 08:09:19.374180 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de317397-b4d4-4735-9105-a287d4402448 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 08:09:19.393852 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-de317397-b4d4-4735-9105-a287d4402448 None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 08:09:19.395048 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-de317397-b4d4-4735-9105-a287d4402448 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 08:09:19.403002 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1455/2928] 10.222.0.33 () {58 vars in 1016 bytes} [Fri Sep 16 08:09:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 08:09:19.417604 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6b8165-f9d2-4b20-a3dd-1510cd21d373 service nova] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 08:09:19.419051 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-1f6b8165-f9d2-4b20-a3dd-1510cd21d373 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 08:09:19.434253 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6b8165-f9d2-4b20-a3dd-1510cd21d373 service nova] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 08:09:19.440499 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965e944b-7a9b-49c7-a96c-e1eb9af76a79 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bec4d9b08514461a1bf63c6b88f53b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4735f453c0c24cc4a1c14e9ac84a0b46', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 08:09:19.441090 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965e944b-7a9b-49c7-a96c-e1eb9af76a79 service nova] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 08:09:19.441370 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965e944b-7a9b-49c7-a96c-e1eb9af76a79 service nova] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 08:09:19.441642 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965e944b-7a9b-49c7-a96c-e1eb9af76a79 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 08:09:19.449702 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965e944b-7a9b-49c7-a96c-e1eb9af76a79 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 08:09:19.451300 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965e944b-7a9b-49c7-a96c-e1eb9af76a79 service nova] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 08:09:19.460941 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1474/2929] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Sep 16 08:09:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 08:09:22.610892 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a05ecab-bc7a-4b47-bb06-96ec25f63d93 None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 08:09:22.611483 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a05ecab-bc7a-4b47-bb06-96ec25f63d93 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 08:09:22.611483 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a05ecab-bc7a-4b47-bb06-96ec25f63d93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 08:09:22.631158 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-7a05ecab-bc7a-4b47-bb06-96ec25f63d93 None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 08:09:22.632345 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-7a05ecab-bc7a-4b47-bb06-96ec25f63d93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 08:09:22.640033 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1456/2930] 10.222.0.33 () {58 vars in 1016 bytes} [Fri Sep 16 08:09:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 08:09:22.656797 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965e944b-7a9b-49c7-a96c-e1eb9af76a79 service nova] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 08:09:22.667928 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965e944b-7a9b-49c7-a96c-e1eb9af76a79 service nova] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 08:09:22.674472 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6baed0ad-6c27-41e5-b654-261f78dd0519 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bec4d9b08514461a1bf63c6b88f53b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4735f453c0c24cc4a1c14e9ac84a0b46', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 08:09:22.675062 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6baed0ad-6c27-41e5-b654-261f78dd0519 service nova] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 08:09:22.675338 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6baed0ad-6c27-41e5-b654-261f78dd0519 service nova] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 08:09:22.675608 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6baed0ad-6c27-41e5-b654-261f78dd0519 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 08:09:22.683752 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6baed0ad-6c27-41e5-b654-261f78dd0519 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 08:09:22.685323 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6baed0ad-6c27-41e5-b654-261f78dd0519 service nova] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 08:09:22.694691 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1475/2931] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Sep 16 08:09:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 08:09:25.712877 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a887c5-4300-4625-96f9-f4ed54f8630c None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 08:09:25.713348 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a887c5-4300-4625-96f9-f4ed54f8630c None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 08:09:25.713466 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a887c5-4300-4625-96f9-f4ed54f8630c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 08:09:25.732942 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-25a887c5-4300-4625-96f9-f4ed54f8630c None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 08:09:25.734156 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-25a887c5-4300-4625-96f9-f4ed54f8630c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 08:09:25.742720 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1457/2932] 10.222.0.33 () {58 vars in 1016 bytes} [Fri Sep 16 08:09:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 08:09:25.757653 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6baed0ad-6c27-41e5-b654-261f78dd0519 service nova] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 08:09:25.769387 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6baed0ad-6c27-41e5-b654-261f78dd0519 service nova] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 08:09:25.774902 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d0dbe9-5f7d-460c-a6b0-58e94ea9edd8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bec4d9b08514461a1bf63c6b88f53b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4735f453c0c24cc4a1c14e9ac84a0b46', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 08:09:25.775488 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d0dbe9-5f7d-460c-a6b0-58e94ea9edd8 service nova] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 08:09:25.775770 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d0dbe9-5f7d-460c-a6b0-58e94ea9edd8 service nova] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 08:09:25.776045 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d0dbe9-5f7d-460c-a6b0-58e94ea9edd8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 08:09:25.784917 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d0dbe9-5f7d-460c-a6b0-58e94ea9edd8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 08:09:25.786535 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d0dbe9-5f7d-460c-a6b0-58e94ea9edd8 service nova] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 08:09:25.795772 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1476/2933] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Sep 16 08:09:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 08:09:28.875846 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4189914-181a-49e7-9374-5eb7ed74409c None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 08:09:28.876355 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4189914-181a-49e7-9374-5eb7ed74409c None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 08:09:28.876458 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4189914-181a-49e7-9374-5eb7ed74409c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 08:09:28.895636 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-e4189914-181a-49e7-9374-5eb7ed74409c None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 08:09:28.896825 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-e4189914-181a-49e7-9374-5eb7ed74409c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 08:09:28.905521 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1458/2934] 10.222.0.33 () {58 vars in 1016 bytes} [Fri Sep 16 08:09:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 08:09:28.921982 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d0dbe9-5f7d-460c-a6b0-58e94ea9edd8 service nova] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 08:09:28.933574 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d0dbe9-5f7d-460c-a6b0-58e94ea9edd8 service nova] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 08:09:28.939263 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8f6714-15b9-49ae-aff9-b4beb433034f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bec4d9b08514461a1bf63c6b88f53b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4735f453c0c24cc4a1c14e9ac84a0b46', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 08:09:28.939856 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8f6714-15b9-49ae-aff9-b4beb433034f service nova] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 08:09:28.940133 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8f6714-15b9-49ae-aff9-b4beb433034f service nova] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 08:09:28.940404 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8f6714-15b9-49ae-aff9-b4beb433034f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 08:09:28.948534 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8f6714-15b9-49ae-aff9-b4beb433034f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 08:09:28.950126 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8f6714-15b9-49ae-aff9-b4beb433034f service nova] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 08:09:28.959907 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1477/2935] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Sep 16 08:09:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 08:09:32.043529 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ef3626-a82d-4c09-9dfb-00584485fe2f None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 08:09:32.044017 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ef3626-a82d-4c09-9dfb-00584485fe2f None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 08:09:32.044198 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ef3626-a82d-4c09-9dfb-00584485fe2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 08:09:32.063573 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-f1ef3626-a82d-4c09-9dfb-00584485fe2f None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 08:09:32.064770 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-f1ef3626-a82d-4c09-9dfb-00584485fe2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 08:09:32.072644 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1459/2936] 10.222.0.33 () {58 vars in 1016 bytes} [Fri Sep 16 08:09:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 08:09:32.089662 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8f6714-15b9-49ae-aff9-b4beb433034f service nova] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 08:09:32.100906 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8f6714-15b9-49ae-aff9-b4beb433034f service nova] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 08:09:32.106602 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4c8eda-24aa-4f38-8201-888fc553d289 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bec4d9b08514461a1bf63c6b88f53b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4735f453c0c24cc4a1c14e9ac84a0b46', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 08:09:32.107203 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4c8eda-24aa-4f38-8201-888fc553d289 service nova] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 08:09:32.107480 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4c8eda-24aa-4f38-8201-888fc553d289 service nova] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 08:09:32.107749 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4c8eda-24aa-4f38-8201-888fc553d289 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 08:09:32.116957 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4c8eda-24aa-4f38-8201-888fc553d289 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 08:09:32.118569 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4c8eda-24aa-4f38-8201-888fc553d289 service nova] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 08:09:32.128132 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1478/2937] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Sep 16 08:09:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 08:09:42.058073 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=18 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 08:09:42.123795 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=64 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 08:09:46.185835 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9aaba52-63a8-46aa-a07c-4f68a02f3cad None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 08:09:46.186350 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9aaba52-63a8-46aa-a07c-4f68a02f3cad None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 08:09:46.186466 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9aaba52-63a8-46aa-a07c-4f68a02f3cad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 08:09:46.205585 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-d9aaba52-63a8-46aa-a07c-4f68a02f3cad None None] MFA Rules not processed for user `f61eca8f62994c1ba23040fb470314f9`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 08:09:46.206815 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-d9aaba52-63a8-46aa-a07c-4f68a02f3cad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 08:09:46.213506 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1460/2938] 10.222.0.57 () {58 vars in 958 bytes} [Fri Sep 16 08:09:46 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 08:09:56.200356 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=3 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 08:09:57.992405 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015c97ca-4311-4b73-ad45-c009f4ce3362 None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 08:09:57.992976 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015c97ca-4311-4b73-ad45-c009f4ce3362 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 08:09:57.992976 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015c97ca-4311-4b73-ad45-c009f4ce3362 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 08:09:58.012589 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-015c97ca-4311-4b73-ad45-c009f4ce3362 None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 08:09:58.013879 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-015c97ca-4311-4b73-ad45-c009f4ce3362 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 08:09:58.022300 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1479/2939] 10.222.0.33 () {58 vars in 1016 bytes} [Fri Sep 16 08:09:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 08:09:58.038416 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9aaba52-63a8-46aa-a07c-4f68a02f3cad None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 08:09:58.052141 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9aaba52-63a8-46aa-a07c-4f68a02f3cad None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 08:09:58.077619 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5b6853-4287-4766-a503-efef5a34249b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bec4d9b08514461a1bf63c6b88f53b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4735f453c0c24cc4a1c14e9ac84a0b46', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 08:09:58.078283 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5b6853-4287-4766-a503-efef5a34249b service nova] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 08:09:58.078563 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5b6853-4287-4766-a503-efef5a34249b service nova] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 08:09:58.078838 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5b6853-4287-4766-a503-efef5a34249b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 08:09:58.089376 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5b6853-4287-4766-a503-efef5a34249b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 08:09:58.091000 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5b6853-4287-4766-a503-efef5a34249b service nova] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 08:09:58.100671 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1461/2940] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Sep 16 08:09:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 08:10:01.252217 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e832f6f0-9972-496e-9ab2-b2c89eae65eb None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 08:10:01.252750 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e832f6f0-9972-496e-9ab2-b2c89eae65eb None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 08:10:01.252750 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e832f6f0-9972-496e-9ab2-b2c89eae65eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 08:10:01.272108 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-e832f6f0-9972-496e-9ab2-b2c89eae65eb None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 08:10:01.273311 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-e832f6f0-9972-496e-9ab2-b2c89eae65eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 08:10:01.281181 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1480/2941] 10.222.0.33 () {58 vars in 1016 bytes} [Fri Sep 16 08:10:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 08:10:01.302213 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5b6853-4287-4766-a503-efef5a34249b service nova] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 08:10:01.313277 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5b6853-4287-4766-a503-efef5a34249b service nova] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 08:10:01.318706 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df24315-051f-4a91-b47c-2e4e1178f1d0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bec4d9b08514461a1bf63c6b88f53b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4735f453c0c24cc4a1c14e9ac84a0b46', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 08:10:01.319293 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df24315-051f-4a91-b47c-2e4e1178f1d0 service nova] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 08:10:01.319569 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df24315-051f-4a91-b47c-2e4e1178f1d0 service nova] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 08:10:01.319838 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df24315-051f-4a91-b47c-2e4e1178f1d0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 08:10:01.327654 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df24315-051f-4a91-b47c-2e4e1178f1d0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 08:10:01.329403 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df24315-051f-4a91-b47c-2e4e1178f1d0 service nova] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 08:10:01.338666 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1462/2942] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Sep 16 08:10:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 08:10:04.342253 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf51c4e-c627-417d-ace1-10dfcfb2127a None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 08:10:04.342744 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf51c4e-c627-417d-ace1-10dfcfb2127a None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 08:10:04.342844 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf51c4e-c627-417d-ace1-10dfcfb2127a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 08:10:04.363272 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-3cf51c4e-c627-417d-ace1-10dfcfb2127a None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 08:10:04.364676 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-3cf51c4e-c627-417d-ace1-10dfcfb2127a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 08:10:04.372459 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1481/2943] 10.222.0.33 () {58 vars in 1016 bytes} [Fri Sep 16 08:10:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 08:10:04.386896 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df24315-051f-4a91-b47c-2e4e1178f1d0 service nova] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 08:10:04.398640 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df24315-051f-4a91-b47c-2e4e1178f1d0 service nova] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 08:10:04.404001 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454cb0c5-0848-48c6-a370-190fd2656300 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bec4d9b08514461a1bf63c6b88f53b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4735f453c0c24cc4a1c14e9ac84a0b46', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 08:10:04.404589 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454cb0c5-0848-48c6-a370-190fd2656300 service nova] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 08:10:04.404868 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454cb0c5-0848-48c6-a370-190fd2656300 service nova] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 08:10:04.405141 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454cb0c5-0848-48c6-a370-190fd2656300 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 08:10:04.413349 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454cb0c5-0848-48c6-a370-190fd2656300 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 08:10:04.414945 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454cb0c5-0848-48c6-a370-190fd2656300 service nova] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 08:10:04.424132 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1463/2944] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Sep 16 08:10:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 08:10:07.491439 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b5d83b-d444-4adb-8a40-a00fcfec9a32 None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 08:10:07.491920 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b5d83b-d444-4adb-8a40-a00fcfec9a32 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 08:10:07.492022 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b5d83b-d444-4adb-8a40-a00fcfec9a32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 08:10:07.511569 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-10b5d83b-d444-4adb-8a40-a00fcfec9a32 None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 08:10:07.512761 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-10b5d83b-d444-4adb-8a40-a00fcfec9a32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 08:10:07.520511 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1482/2945] 10.222.0.33 () {58 vars in 1016 bytes} [Fri Sep 16 08:10:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 16 08:10:07.536236 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454cb0c5-0848-48c6-a370-190fd2656300 service nova] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 08:10:07.547477 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454cb0c5-0848-48c6-a370-190fd2656300 service nova] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 08:10:07.553413 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0645ad84-8923-46e2-97b8-b321fab62819 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bec4d9b08514461a1bf63c6b88f53b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4735f453c0c24cc4a1c14e9ac84a0b46', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 08:10:07.554030 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0645ad84-8923-46e2-97b8-b321fab62819 service nova] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 08:10:07.554314 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0645ad84-8923-46e2-97b8-b321fab62819 service nova] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 08:10:07.554584 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0645ad84-8923-46e2-97b8-b321fab62819 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 08:10:07.562444 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0645ad84-8923-46e2-97b8-b321fab62819 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 08:10:07.563981 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0645ad84-8923-46e2-97b8-b321fab62819 service nova] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 08:10:07.573365 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1464/2946] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Sep 16 08:10:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 08:10:10.656530 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e49c622-efe7-4a5c-a96f-45aa359d9f75 None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 08:10:10.657058 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e49c622-efe7-4a5c-a96f-45aa359d9f75 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 08:10:10.657058 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e49c622-efe7-4a5c-a96f-45aa359d9f75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 08:10:10.676971 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-2e49c622-efe7-4a5c-a96f-45aa359d9f75 None None] MFA Rules not processed for user `a76c683889e54d429dbaa09123371861`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 08:10:10.678186 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-2e49c622-efe7-4a5c-a96f-45aa359d9f75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 08:10:10.685809 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1483/2947] 10.222.0.33 () {58 vars in 1016 bytes} [Fri Sep 16 08:10:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 08:10:10.702596 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0645ad84-8923-46e2-97b8-b321fab62819 service nova] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 08:10:10.713693 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0645ad84-8923-46e2-97b8-b321fab62819 service nova] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 08:10:10.719155 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5ad70f-fb98-41f4-987e-d7efa406c03a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bec4d9b08514461a1bf63c6b88f53b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4735f453c0c24cc4a1c14e9ac84a0b46', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 08:10:10.719739 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5ad70f-fb98-41f4-987e-d7efa406c03a service nova] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 08:10:10.720018 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5ad70f-fb98-41f4-987e-d7efa406c03a service nova] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 08:10:10.720288 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5ad70f-fb98-41f4-987e-d7efa406c03a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 08:10:10.728670 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5ad70f-fb98-41f4-987e-d7efa406c03a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 08:10:10.730317 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5ad70f-fb98-41f4-987e-d7efa406c03a service nova] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 08:10:10.741361 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1465/2948] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Sep 16 08:10:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 08:10:20.671058 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=15 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 08:10:20.735724 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=30 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 08:10:38.629223 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e49c622-efe7-4a5c-a96f-45aa359d9f75 None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 08:10:38.630801 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-2e49c622-efe7-4a5c-a96f-45aa359d9f75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 08:10:38.696313 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5ad70f-fb98-41f4-987e-d7efa406c03a service nova] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 08:10:38.706095 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e49c622-efe7-4a5c-a96f-45aa359d9f75 None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 08:10:38.706276 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5ad70f-fb98-41f4-987e-d7efa406c03a service nova] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 08:10:38.711074 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09392835-670d-413d-b1fc-7193421f4e5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 08:10:38.711733 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09392835-670d-413d-b1fc-7193421f4e5e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 08:10:38.712012 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09392835-670d-413d-b1fc-7193421f4e5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 08:10:38.712122 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c83403e-0a6b-4c84-a39c-21e7c884fbef service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7d4ccdd6ef9400ba9e344df0964da1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4735f453c0c24cc4a1c14e9ac84a0b46', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 08:10:38.712284 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09392835-670d-413d-b1fc-7193421f4e5e admin admin] PATH_INFO: `/v3/users/f61eca8f62994c1ba23040fb470314f9` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 08:10:38.712614 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c83403e-0a6b-4c84-a39c-21e7c884fbef service placement] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 08:10:38.712888 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c83403e-0a6b-4c84-a39c-21e7c884fbef service placement] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 08:10:38.713158 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c83403e-0a6b-4c84-a39c-21e7c884fbef service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 08:10:38.713441 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09392835-670d-413d-b1fc-7193421f4e5e admin admin] RBAC: Authorizing `identity:delete_user(user_id=f61eca8f62994c1ba23040fb470314f9)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 08:10:38.715066 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-9c83403e-0a6b-4c84-a39c-21e7c884fbef service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 08:10:38.715398 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09392835-670d-413d-b1fc-7193421f4e5e admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 08:10:38.727617 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c83403e-0a6b-4c84-a39c-21e7c884fbef service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 08:10:38.729186 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c83403e-0a6b-4c84-a39c-21e7c884fbef service placement] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 08:10:38.740858 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1484/2949] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Sep 16 08:10:38 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 08:10:38.766583 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-09392835-670d-413d-b1fc-7193421f4e5e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f61eca8f62994c1ba23040fb470314f9'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 08:10:38.767368 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-09392835-670d-413d-b1fc-7193421f4e5e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f61eca8f62994c1ba23040fb470314f9'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 08:10:38.776081 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-09392835-670d-413d-b1fc-7193421f4e5e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f61eca8f62994c1ba23040fb470314f9'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 08:10:38.788846 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-09392835-670d-413d-b1fc-7193421f4e5e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f61eca8f62994c1ba23040fb470314f9'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 08:10:38.795928 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-09392835-670d-413d-b1fc-7193421f4e5e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f61eca8f62994c1ba23040fb470314f9'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 08:10:38.802776 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1466/2950] 10.222.0.57 () {58 vars in 1224 bytes} [Fri Sep 16 08:10:38 2022] DELETE /identity/v3/users/f61eca8f62994c1ba23040fb470314f9 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 16 08:10:38.974917 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c83403e-0a6b-4c84-a39c-21e7c884fbef service placement] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 08:10:38.987166 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c83403e-0a6b-4c84-a39c-21e7c884fbef service placement] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 08:10:39.047376 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d32aa0-e72a-4a94-b3a4-a8fba8cf8d3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a76c683889e54d429dbaa09123371861', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca665dd48e60491fbe57a7dec14fd437', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 08:10:39.048000 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d32aa0-e72a-4a94-b3a4-a8fba8cf8d3d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 08:10:39.048277 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d32aa0-e72a-4a94-b3a4-a8fba8cf8d3d admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 08:10:39.048547 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d32aa0-e72a-4a94-b3a4-a8fba8cf8d3d admin admin] PATH_INFO: `/v3/projects/50010f016d7f43719388e6b29394b022` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 08:10:39.049652 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d32aa0-e72a-4a94-b3a4-a8fba8cf8d3d admin admin] RBAC: Authorizing `identity:delete_project(project_id=50010f016d7f43719388e6b29394b022)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 08:10:39.051607 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d32aa0-e72a-4a94-b3a4-a8fba8cf8d3d admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 08:10:39.097026 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-b9d32aa0-e72a-4a94-b3a4-a8fba8cf8d3d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '50010f016d7f43719388e6b29394b022', 'request_id': 'req-b9d32aa0-e72a-4a94-b3a4-a8fba8cf8d3d'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 08:10:39.103972 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-b9d32aa0-e72a-4a94-b3a4-a8fba8cf8d3d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '50010f016d7f43719388e6b29394b022', 'request_id': 'req-b9d32aa0-e72a-4a94-b3a4-a8fba8cf8d3d'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 08:10:39.111308 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-b9d32aa0-e72a-4a94-b3a4-a8fba8cf8d3d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '50010f016d7f43719388e6b29394b022', 'request_id': 'req-b9d32aa0-e72a-4a94-b3a4-a8fba8cf8d3d'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 08:10:39.122599 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-b9d32aa0-e72a-4a94-b3a4-a8fba8cf8d3d admin admin] The token cache is being invalidate because project 50010f016d7f43719388e6b29394b022 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81431) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 08:10:39.122890 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-b9d32aa0-e72a-4a94-b3a4-a8fba8cf8d3d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 08:10:39.123517 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-b9d32aa0-e72a-4a94-b3a4-a8fba8cf8d3d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 08:10:39.124993 dv-cinder-740146-20-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1485/2951] 10.222.0.57 () {58 vars in 1233 bytes} [Fri Sep 16 08:10:38 2022] DELETE /identity/v3/projects/50010f016d7f43719388e6b29394b022 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 08:10:48.798291 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=29,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 08:10:49.119247 dv-cinder-740146-20-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=83,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 08:13:22.157808 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09392835-670d-413d-b1fc-7193421f4e5e admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 08:13:22.159208 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-09392835-670d-413d-b1fc-7193421f4e5e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 08:13:22.297899 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09392835-670d-413d-b1fc-7193421f4e5e admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 08:13:22.354663 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db161d43-c01d-4d22-a9fc-798d94530781 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7d4ccdd6ef9400ba9e344df0964da1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4735f453c0c24cc4a1c14e9ac84a0b46', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 08:13:22.355258 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db161d43-c01d-4d22-a9fc-798d94530781 service placement] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 08:13:22.355534 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db161d43-c01d-4d22-a9fc-798d94530781 service placement] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 08:13:22.355803 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db161d43-c01d-4d22-a9fc-798d94530781 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 08:13:22.357550 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-db161d43-c01d-4d22-a9fc-798d94530781 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 08:13:22.369223 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db161d43-c01d-4d22-a9fc-798d94530781 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 08:13:22.370803 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db161d43-c01d-4d22-a9fc-798d94530781 service placement] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 08:13:22.381071 dv-cinder-740146-20-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1467/2952] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Sep 16 08:13:22 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 08:13:32.376978 dv-cinder-740146-20-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=89 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}